et3tsy

et3tsy's Stars

• mlcommons/storage

  MLPerf™ Storage Benchmark Suite

  Language:Shell8830

• NVIDIA/DALI

  A GPU-accelerated library containing highly optimized building blocks and an execution engine for data processing to accelerate deep learning training and inference applications.

  Language:C++5.1k615

• huggingface/accelerate

  🚀 A simple way to launch, train, and use PyTorch models on almost any device and distributed configuration, automatic mixed precision (including fp8), and easy-to-configure FSDP and DeepSpeed support

  Language:Python7.8k951

• Lizonghang/TPI-LLM

  TPI-LLM: A High-Performance Tensor Parallelism Inference System for Edge LLM Services.

  Language:Python15710

• HqWu-HITCS/Awesome-Chinese-LLM

  整理开源的中文大语言模型，以规模较小、可私有化部署、训练成本较低的模型为主，包括底座模型，垂直领域微调及应用，数据集与教程等。

  15.5k1.4k

• zhengqmark/deltafs

  Transient file system service featuring highly paralleled indexing on both file data and file system metadata

  Language:C++23

• hopshadoop/hops

  Hops Hadoop is a distribution of Apache Hadoop with distributed metadata.

  Language:Java30581

• minghuaw/toy-rpc

  An async RPC in rust-lang that mimics golang's net/rpc

  Language:Rust292

• talent-plan/tinykv

  A course to build distributed key-value service based on TiKV model

  Language:Go3.4k1k

• cnosdb/cnosdb

  A cloud-native open source distributed time series database with high performance, high compression ratio and high availability. http://www.cnosdb.cloud

  Language:Rust1.7k321

• databendlabs/openraft

  rust raft with improvements

  Language:Rust1.4k155

• ShisoftResearch/bifrost

  Pure rust building block for distributed systems

  Language:Rust16119

• ica-ced/.github

  1

• OpenFogStack/FReD

  FReD: Fog Replicated Data

  Language:Go53

• irods/irods

  Open Source Data Management Software

  Language:C++446141

• minio/minio

  MinIO is a high-performance, S3 compatible object store, open sourced under GNU AGPLv3 license.

  Language:Go47.4k5.5k

• juicedata/juicefs

  JuiceFS is a distributed POSIX file system built on top of Redis and S3.

  Language:Go10.7k932

• SineZHAN/deepALplus

  This is a toolbox for Deep Active Learning, an extension from previous work https://github.com/ej0cl6/deep-active-learning (DeepAL toolbox).

  Language:Python16824

• hegongshan/File-System-Paper

  Must-read Papers for File System (FS)

  21119

• apache/flink

  Apache Flink

  Language:Java23.9k13.3k

• lcj2021/split-merge-partitioner

  Source code for VLDB2024 - FSM: A Fine-grained Splitting and Merging Framework for Dual-balanced Graph Partition

  Language:C++3

• LMAX-Exchange/disruptor

  High Performance Inter-Thread Messaging Library

  Language:Java17.4k3.9k

• NetApp/trident

  Storage orchestrator for containers

  Language:Go760219

• rexray/rexray

  REX-Ray is a container storage orchestration engine enabling persistence for cloud native workloads

  Language:Go2.2k327

• LLNL/magpie

  Magpie contains a number of scripts for running Big Data software in HPC environments, including Hadoop and Spark. There is support for Lustre, Slurm, Moab, Torque. LSF, Flux, and more.

  Language:Shell19353

• brianfrankcooper/YCSB

  Yahoo! Cloud Serving Benchmark

  Language:Java4.9k2.2k

• facebookresearch/nougat

  Implementation of Nougat Neural Optical Understanding for Academic Documents

  Language:Python8.9k560

• microsoft/windows-drivers-rs

  Platform that enables Windows driver development in Rust. Developed by Surface.

  Language:Rust1.5k64

• tokio-rs/tokio-uring

  An io_uring backed runtime for Rust

  Language:Rust1.1k121

• axboe/fio

  Flexible I/O Tester

  Language:C5.2k1.3k