hadoop

There are 3593 repositories under hadoop topic.

  • donnemartin/data-science-ipython-notebooks

    Data science Python notebooks: Deep learning (TensorFlow, Theano, Caffe, Keras), scikit-learn, Kaggle, big data (Spark, Hadoop MapReduce, HDFS), matplotlib, pandas, NumPy, SciPy, Python essentials, AWS, and various command lines.

    Language:Python28.5k1.6k418k

  • spotify/luigi

    Luigi is a Python module that helps you build complex pipelines of batch jobs. It handles dependency resolution, workflow management, visualization etc. It also comes with Hadoop support built in.

    Language:Python18.5k4661k2.4k

  • Tencent/APIJSON

    🏆 实时 零代码、全功能、强安全 ORM 库 🚀 后端接口和文档零代码，前端(客户端) 定制返回 JSON 的数据和结构 🏆 Real-Time coding-free, powerful and secure ORM 🚀 providing APIs and Docs without coding by Backend, and the returned JSON of API can be customized by Frontend(Client) users

    Language:Java18.2k3876782.3k

  • heibaiying/BigData-Notes

    大数据入门指南 :star:

    Language:Java16.6k448434.3k
  • presto

    prestodb/presto

    The official home of the Presto distributed SQL query engine for big data

    Language:Java16.5k8437k5.5k

  • apache/hadoop

    Apache Hadoop

    Language:Java15.3k97909.1k

  • deeplearning4j/deeplearning4j

    Suite of tools for deploying and training deep learning models using the JVM. Highlights include model import for keras, tensorflow, and onnx/pytorch, a modular and tiny c++ library for running math code and a java based math library on top of the core c++ library. Also includes samediff: a pytorch/tensorflow like library for running deep learn...

    Language:Java14.1k7675.8k3.9k

  • trinodb/trino

    Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

    Language:Java11.9k1797.4k3.3k

  • wangzhiwubigdata/God-Of-BigData

    专注大数据学习面试，大数据成神之路开启。Flink/Spark/Hadoop/Hbase/Hive...

    10.3k33003.2k
  • school-of-sre

    linkedin/school-of-sre

    At LinkedIn, we are using this curriculum for onboarding our entry-level talents into the SRE role.

    Language:HTML8k15349731

  • h2oai/h2o-3

    H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.

    Language:Jupyter Notebook7.3k3809.6k2k

  • HariSekhon/DevOps-Bash-tools

    1000+ DevOps Bash Scripts - AWS, GCP, Kubernetes, Docker, CI/CD, APIs, SQL, PostgreSQL, MySQL, Hive, Impala, Kafka, Hadoop, Jenkins, GitHub, GitLab, BitBucket, Azure DevOps, TeamCity, Spotify, MP3, LDAP, Code/Build Linting, pkg mgmt for Linux, Mac, Python, Perl, Ruby, NodeJS, Golang, Advanced dotfiles: .bashrc, .vimrc, .gitconfig, .screenrc, tmux..

    Language:Shell7.1k93111.3k

  • Alluxio/alluxio

    Alluxio, data orchestration for analytics and machine learning in the cloud

    Language:Java7.1k4392.2k3k

  • apache/hive

    Apache Hive

    Language:Java5.8k31804.8k

  • apache/ignite

    Apache Ignite

    Language:Java5k2702141.9k

  • apache/calcite

    Apache Calcite

    Language:Java4.9k16402.4k

  • tomwhite/hadoop-book

    Example source code accompanying O'Reilly's "Hadoop: The Definitive Guide" by Tom White

    Language:Makefile3.5k449312.6k

  • WeBankFinTech/DataSphereStudio

    DataSphereStudio is a one stop data application development& management portal, covering scenarios including data exchange, desensitization/cleansing, analysis/mining, quality measurement, visualization, and task scheduling.

    Language:Java3.2k1817501k

  • apache/nutch

    Apache Nutch is an extensible and scalable web crawler

    Language:Java3.1k23401.3k

  • MoRan1607/BigDataGuide

    大数据学习，从零开始学习大数据，包含大数据学习各阶段学习视频、面试资料

    3k485898

  • CodeRayZhang/Movie_Recommend

    基于Spark的电影推荐系统，包含爬虫项目、web网站、后台管理系统以及spark推荐系统

    Language:Java3k1.1k
  • SZT-bigdata

    geekyouth/SZT-bigdata

    深圳地铁大数据客流分析系统🚇🚄🌟

    Language:Scala2.4k6222608

  • big-data-europe/docker-hadoop

    Apache Hadoop docker image

    Language:Shell2.3k801131.4k

  • apache/kyuubi

    Apache Kyuubi is a distributed and multi-tenant gateway to provide serverless SQL on data warehouses and lakehouses.

    Language:Scala2.2k632.4k961

  • cdarlint/winutils

    winutils.exe hadoop.dll and hdfs.dll binaries for hadoop windows

    Language:Shell2.1k43402.3k

  • dahuoyzs/javapdf

    🍣100本 Java电子书 技术书籍PDF(以下载阅读为荣，以点赞收藏为耻)

    2.1k374474

  • apache/drill

    Apache Drill is a distributed MPP query layer for self describing data

    Language:Java2k149150976

  • gchq/Gaffer

    A large-scale entity and relation database supporting aggregation of properties

    Language:Java1.8k1371.6k363

  • Qihoo360/hbox

    AI on Hadoop

    Language:Java1.7k14570386

  • collabH/bigdata-growth

    大数据知识仓库涉及到数据仓库建模、实时计算、大数据、数据中台、系统设计、Java、算法等。

    Language:Shell1.7k344377

  • water8394/BigData-Interview

    :dart: :star2:[大数据面试题]分享自己在网络上收集的大数据相关的面试题以及自己的答案总结.目前包含Hadoop/Hive/Spark/Flink/Hbase/Kafka/Zookeeper框架的面试题知识总结

    1.6k523447

  • apache/carbondata

    High performance data store solution

    Language:Scala1.4k12243703

  • OBenner/data-engineering-interview-questions

    More than 2000+ Data engineer interview questions.

    1.4k213494

  • HariSekhon/Dockerfiles

    50+ DockerHub public images for Docker & Kubernetes - DevOps, CI/CD, GitHub Actions, CircleCI, Jenkins, TeamCity, Alpine, CentOS, Debian, Fedora, Ubuntu, Hadoop, Kafka, ZooKeeper, HBase, Cassandra, Solr, SolrCloud, Presto, Apache Drill, Nifi, Spark, Consul, Riak

    Language:Shell1.4k4849476
  • Addax

    wgzhao/Addax

    A fast and versatile ETL tool that can transfer data between RDBMS and NoSQL seamlessly

    Language:Java1.3k35320318

  • DTStack/Taier

    Taier is a big data development platform for submission, scheduling, operation and maintenance, and indicator information display

    Language:Java1.3k33489342