map-reduce
There are 336 repositories under map-reduce topic.
chrislusf/gleam
Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.
Qihoo360/poseidon
A search engine which can hold 100 trillion lines of log data.
numaproj/numaflow
Kubernetes-native platform to run massively parallel data/streaming jobs
JuliaFolds/Transducers.jl
Efficient transducers for Julia
tirthajyoti/Spark-with-Python
Fundamentals of Spark with Python (using PySpark), code examples
tkf/ThreadsX.jl
Parallelized Base functions
commoncrawl/cc-mrjob
Demonstration of using Python to process the Common Crawl dataset with the mrjob framework
phelps-sg/python-bigdata
Data science and Big Data with Python
xarray-contrib/flox
Fast & furious GroupBy operations for dask.array
asavinov/prosto
Prosto is a data processing toolkit radically changing how data is processed by heavily relying on functions and operations with functions - an alternative to map-reduce and join-groupby
daleroberts/pypar
Efficient and scalable parallelism using the message passing interface (MPI) to handle big data and highly computational problems.
JuliaFolds/FoldsCUDA.jl
Data-parallelism on CUDA using Transducers.jl and for loops (FLoops.jl)
rvantonder/hack_parallel
The core parallel and shared memory library used by Hack, Flow, and Pyre
dragonly/pingcap_interview
pingcap 面试小作业
RedisGears/redisgears-py
RedisGears python client
Cheng-Lin-Li/Spark
There are Python 2.7 codes and learning notes for Spark 2.1.1
CaptainCodeman/datastore-mapper
Appengine Datastore Mapper in Go
nglthu/infoRetrieval
Inverted Indexer, web crawler, sort, search and poster steamer written using Python for information retrieval.
ihor/Phadoop
Map/reduce jobs for Hadoop in PHP
loveyacper/raft_for_dummies
2017春季MIT分布式系统课程实验
shellyln/open-soql
Open source implementation of the SOQL.
imehrdadmahdavi/map-reduce-inverted-index
Creating an Inverted Index of words occurring in a large set of documents extracted from web pages using Hadoop MapReduce and Google Dataproc
pscosta/go-strm
A rich Map/Reduce API in Go
HenrikBengtsson/future.mapreduce
[EXPERIMENTAL] R package: future.mapreduce - Utility Functions for Future Map-Reduce API Packages
kalmyk/fox-wamp
Web Application Message Async Server and WAMP/MQTT bridge
gwr3n/jsdp
A Java Stochastic Dynamic Programming Library
fangvv/EdgeLD
Code for paper "Locally Distributed Deep Learning Inference on Edge Device Clusters"
lorenzo-stacchio/Big_Data_Course_Rimini_2021
Questa repository contiene tutto il materiale didattico utilizzato durante il corso di "Laboratorio Big Data" in collaborazione con il comune di Rimini.
codelibra/Time-series-analysis-nyc-taxi
⏰ 📓 Time series analysis of new york taxi data
deeperunderstanding/scala-map-reduce
Map-Reduce implemented with Scala
DICL/VeloxMR
Data processing component of the Velox Big Data Framework (VBDF)
pipecraft/pipes
Core part of pipes framework plus some commonly used extensions
123vivekr/distributed-map-reduce
An experimental distributed map reduce system based on Google's MapReduce, written in Rust!
Drapegnik/bsuir
🎓Repository for masters labs on FCSN, BSUIR
natelalor/AI_report_generator
A tool that converts long audio files into a thorough, summarized report. Leverages OpenAI and its API (ChatGPT backend), Langchain for text processing, and Pinecone for vector database facilitation.