hadoop

There are 3327 repositories under hadoop topic.

  • donnemartin/data-science-ipython-notebooks

    Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

    Language:Python26.5k1.6k397.7k

  • spotify/luigi

    Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

    Language:Python17.4k4739822.4k

  • Tencent/APIJSON

    🏆 零代码、全功能、强安全 ORM 库 🚀 后端接口和文档零代码，前端(客户端) 定制返回 JSON 的数据和结构。 🏆 A JSON Transmission Protocol and an ORM Library 🚀 provides APIs and Docs without writing any code.

    Language:Java16.7k3815722.1k
  • presto

    prestodb/presto

    The official home of the Presto distributed SQL query engine for big data

    Language:Java15.6k8626.3k5.3k

  • heibaiying/BigData-Notes

    大数据入门指南 :star:

    Language:Java15.3k442434.2k

  • apache/hadoop

    Apache Hadoop

    Language:Java14.4k99408.7k

  • deeplearning4j/deeplearning4j

    Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learning using automatic differentiation.

    Language:Java13.5k7685.7k3.8k

  • apache/doris

    Apache Doris is an easy-to-use, high performance and unified analytics database.

    Language:Java11.5k2806.8k3.1k

  • trinodb/trino

    Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

    Language:Java9.6k1686.2k2.8k

  • wangzhiwubigdata/God-Of-BigData

    专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

    9.3k33103.1k
  • school-of-sre

    linkedin/school-of-sre

    At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.

    Language:HTML7.7k15348696

  • h2oai/h2o-3

    H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

    Language:Jupyter Notebook6.7k3849.3k2k

  • Alluxio/alluxio

    Alluxio, data orchestration for analytics and machine learning in the cloud

    Language:Java6.7k4402.2k2.9k

  • apache/hive

    Apache Hive

    Language:Java5.3k33604.6k

  • apache/ignite

    Apache Ignite

    Language:Java4.7k2801061.9k

  • apache/calcite

    Apache Calcite

    Language:Java4.4k16902.3k

  • tomwhite/hadoop-book

    Example source code accompanying O'Reilly's "Hadoop: The Definitive Guide" by Tom White

    Language:Makefile3.5k450312.6k

  • WeBankFinTech/DataSphereStudio

    DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

    Language:Java3k181742987

  • apache/nutch

    Apache Nutch is an extensible and scalable web crawler

    Language:Java2.8k23701.2k

  • LuckyZXL2016/Movie_Recommend

    基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

    Language:Java2.7k108181k

  • MoRan1607/BigDataGuide

    大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

    Language:Java2.5k465842

  • HariSekhon/DevOps-Bash-tools

    1000+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..

    Language:Shell2.5k578690
  • SZT-bigdata

    geekyouth/SZT-bigdata

    深圳地铁大数据客流分析系统🚇🚄🌟

    Language:Scala2.2k6021605

  • big-data-europe/docker-hadoop

    Apache Hadoop docker image

    Language:Shell2.1k821111.2k

  • dahuoyzs/javapdf

    🍣100本 Java电子书 技术书籍PDF(以下载阅读为荣，以点赞收藏为耻)

    2k383457

  • apache/kyuubi

    Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

    Language:Scala2k622.2k861

  • apache/drill

    Apache Drill is a distributed MPP query layer for self describing data

    Language:Java1.9k156123979

  • cdarlint/winutils

    winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows

    Language:Shell1.8k47342.1k

  • gchq/Gaffer

    A large-scale entity and relation database supporting aggregation of properties

    Language:Java1.7k1411.5k354

  • Qihoo360/XLearning

    AI on Hadoop

    Language:Java1.7k14867383

  • moosefs/moosefs

    MooseFS – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System (Software-Defined Storage)

    Language:C1.6k107420199

  • will-che/BigData-Interview

    :dart: :star2:[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

    1.5k512441

  • apache/carbondata

    High performance data store solution

    Language:Scala1.4k12641703

  • collabH/bigdata-growth

    大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

    Language:Shell1.3k304321

  • DTStack/Taier

    Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display

    Language:Java1.3k33477320

  • HariSekhon/Dockerfiles

    50+ DockerHub public images for Docker & Kubernetes - DevOps, CI/CD, GitHub Actions, CircleCI, Jenkins, TeamCity, Alpine, CentOS, Debian, Fedora, Ubuntu, Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak

    Language:Shell1.2k4849459