distributed-computing
There are 1766 repositories under distributed-computing topic.
hpcaitech/ColossalAI
Making large AI models cheaper, faster and more accessible
ty4z2008/Qix
Machine Learning、Deep Learning、PostgreSQL、Distributed System、Node.Js、Golang
hazelcast/hazelcast
Hazelcast is a unified real-time data platform combining stream processing with a fast data store, allowing customers to act instantly on data-in-motion for real-time insights.
asynkron/protoactor-go
Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin
chrislusf/gleam
Fast, efficient, and scalable distributed map/reduce system, DAG execution, in memory or on disk, written in pure Go, runs standalone or distributedly.
catalyst-team/catalyst
Accelerated deep learning R&D
alpa-projects/alpa
Training and serving large-scale neural networks with auto parallelization.
heidihoward/distributed-consensus-reading-list
A list of papers about distributed consensus.
Eventual-Inc/Daft
Distributed data engine for Python/SQL designed for the cloud, powered by Rust
pytorch/rl
A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
jostmey/NakedTensor
Bare bone examples of machine learning in TensorFlow
microsoft/GraphEngine
Microsoft Graph Engine
BOINC/boinc
Open-source software for volunteer computing and grid computing.
fugue-project/fugue
A unified interface for distributed computing. Fugue executes SQL, Python, Pandas, and Polars code on Spark, Dask and Ray without any rewrites.
innovation-cat/Awesome-Federated-Machine-Learning
Everything about federated learning, including research papers, books, codes, tutorials, videos and beyond
chapel-lang/chapel
a Productive Parallel Programming Language
asynkron/protoactor-dotnet
Proto Actor - Ultra fast distributed actors for Go, C# and Java/Kotlin
moosefs/moosefs
MooseFS Distributed Storage – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System / Software-Defined Storage
dask/distributed
A distributed task scheduler for Dask
b4rtaz/distributed-llama
Tensor parallelism is all you need. Run LLMs on an AI cluster at home using any device. Distribute the workload, divide RAM usage, and increase inference speed.
maxpumperla/elephas
Distributed Deep learning with Keras & Spark
eclipse-zenoh/zenoh
zenoh unifies data in motion, data in-use, data at rest and computations. It carefully blends traditional pub/sub with geo-distributed storages, queries and computations, while retaining a level of time and space efficiency that is well beyond any of the mainstream stacks.
TsingZ0/PFLlib
37 traditional FL (tFL) or personalized FL (pFL) algorithms, 3 scenarios, and 24 datasets. www.pfllib.com/
wx-chevalier/DistributedSystem-Notes
:books: 深入浅出分布式基础架构,Linux 与操作系统篇 | 分布式系统篇 | 分布式计算篇 | 数据库篇 | 网络篇 | 虚拟化与编排篇 | 大数据与云计算篇
google/vizier
Python-based research interface for blackbox and hyperparameter optimization, based on the internal Google Vizier Service.
AshwinRJ/Federated-Learning-PyTorch
Implementation of Communication-Efficient Learning of Deep Networks from Decentralized Data
s8sg/goflow
A Golang based high performance, scalable and distributed workflow framework
holochain/holochain
The current, performant & industrial strength version of Holochain on Rust.
lensacom/sparkit-learn
PySpark + Scikit-learn = Sparkit-learn
Haidra-Org/AI-Horde
A crowdsourced distributed cluster for AI art and text generation
dotnetcore/SmartSql
SmartSql = MyBatis in C# + .NET Core+ Cache(Memory | Redis) + R/W Splitting + PropertyChangedTrack +Dynamic Repository + InvokeSync + Diagnostics
mahmoudparsian/data-algorithms-book
MapReduce, Spark, Java, and Scala for Data Algorithms Book
uber/fiber
Distributed Computing for AI Made Simple
futureverse/future
:rocket: R package: future: Unified Parallel and Distributed Processing in R for Everyone
lizardfs/lizardfs
LizardFS is an Open Source Distributed File System licensed under GPLv3.
couler-proj/couler
Unified Interface for Constructing and Managing Workflows on different workflow engines, such as Argo Workflows, Tekton Pipelines, and Apache Airflow.