distributed-file-system

There are 151 repositories under distributed-file-system topic.

  • seaweedfs

    seaweedfs/seaweedfs

    SeaweedFS is a fast distributed storage system for blobs, objects, files, and data lake, for billions of files! Blob store has O(1) disk seek, cloud tiering. Filer supports Cloud Drive, xDC replication, Kubernetes, POSIX FUSE mount, S3 API, S3 Gateway, Hadoop, WebDAV, encryption, Erasure Coding. Enterprise version is at seaweedfs.com.

    Language:Go25.8k5303.2k2.5k
  • ceph

    ceph/ceph

    Ceph is a distributed object, block, and file storage platform

    Language:C++15.5k64206.2k

  • deepseek-ai/3FS

    A high-performance distributed file system designed to address the challenges of AI training and inference workloads.

    Language:C++9.3k86207938

  • happyfish100/fastdfs

    FastDFS is a high performance distributed file system (DFS). It's major functions include: file storing, file syncing and file accessing, and design for high capacity and load balance. Wechat/Weixin public account (Chinese Language): fastdfs

    Language:C9.2k5047192k

  • cubefs/cubefs

    cloud-native distributed storage

    Language:Go5.2k104972673

  • sjqzhang/go-fastdfs

    go-fastdfs 是一个简单的分布式文件系统(私有云存储)，具有无中心、高性能，高可靠，免维护等优点，支持断点续传，分块上传，小文件合并，自动同步，自动修复。Go-fastdfs is a simple distributed file system (private cloud storage), with no center, high performance, high reliability, maintenance free and other advantages, support breakpoint continuation, block upload, small file merge, automatic synchronization, automatic repair.(similar fastdfs).

    Language:Go4.1k127413763

  • moosefs/moosefs

    MooseFS Distributed Storage – Open Source, Petabyte, Fault-Tolerant, Highly Performing, Scalable Network Distributed File System / Software-Defined Storage

    Language:C1.9k109455223

  • leo-project/leofs

    The LeoFS Storage System

    Language:Erlang1.6k84986155

  • wenweihu86/raft-java

    Raft Java implementation which is simple and easy to understand.

    Language:Java1.2k4447415
  • awesome-distributed-system-projects

    roma-glushko/awesome-distributed-system-projects

    🚀 List of distributed system projects for inspiration and learning to build distributed services from real world examples

    9386279

  • Hexilee/tifs

    A distributed POSIX filesystem based on TiKV, with partition tolerance and strict consistency.

    Language:Rust36210423

  • hegongshan/File-System-Paper

    Must-read Papers for File System (FS)

    3003031

  • freakmaxi/kertish-dos

    Kertish-dos is a simple distributed object storage platform, implements object storage on a single distributed computer cluster, and provides interfaces for file/folder handling. Kertish-dos aims primarily for completely distributed operation without a single point of failure, scalable to the exabyte level.

    Language:Go1101229

  • richardschneider/net-ipfs-engine

    IPFS Core API implementation in .Net

    Language:C#109810751
  • saunafs

    leil-io/saunafs

    SaunaFS is a free-and open source, distributed POSIX file system inspired by Google File System.

    Language:C++9052111

  • pitchpoint-solutions/sfs

    The legacy distributed object storage server developed by PitchPoint Solutions can store billions of large and small files using minimal resources. Object data is stored in replicated volumes implemented like Facebooks Haystack Object Store. Object metadata which essentially maps an object name to a volume position is stored in an elasticsearch index. (Development by PitchPoint Solutions has been discontinued)

    Language:Java878111

  • IBM/IPFSfB

    InterPlanetary File System for Business (IPFSfB) is an enterprise blockchain storage network based on InterPlanetary File System.

    Language:Go7917226

  • fangpin/miniDFS

    Simple version of Distributed File System on multiple threads

    Language:C++593123

  • wenweihu86/distkv

    Distributed KV Storage System based on Raft and RocksDB, can be use to store small files, like images.

    Language:Java587021

  • cholcombe973/rusix

    Distributed filesystem in Rust

    Language:Rust5571211

  • chengdedeng/yfs

    :house:超精简分布式对象存储

    Language:Java484210

  • dingodb/dingofs

    DingoFS is a project fork from Curve. Curve is a sandbox project hosted by the CNCF Foundation. It's cloud-native, high-performance, and easy to operate. Curve is an open-source distributed storage system for block and shared file storage.

    Language:C++387019

  • mbajer42/ucz-dfs

    A distributed file system written in Rust.

    Language:Rust28212

  • shubhamsawantsjsu/Distributed-File-Storage-System

    An open-source, scalable, decentralized, robust, heterogeneous file storage solution which is fault tolerant, replicated, distributed and lets you upload, download, and see the catalog of other cluster with low latency and LRU cache capabilities.

    Language:Python27206

  • UnixJunkie/daft

    DAFT Allows File Transfers

    Language:OCaml236861

  • foreverbell/yfs

    Yet Another File System (yfs) based on Paxos algorithm.

    Language:C++16305

  • ks-amit/Distributed-Database

    A travel agency app with a distributed database implemented from scratch!

    Language:Python16116

  • MrCirca/zabbix-glusterfs

    Monitoring GlusterFS Discovery storage with Zabbix 3.4

    Language:Python162521

  • putdotio/efes

    A distributed filesystem evolved from MogileFS

    Language:Go161301

  • abbyssoul/libstyxe

    Implementation of 9P parser and message writer.

    Language:C++15303

  • rajatgarg149/BigData-Essentials-HDFS-SPARK-RDD

    Language:Jupyter Notebook15203

  • PasaLab/dfs-perf

    A general performance test framework for Distributed File System

    Language:Java14514

  • James-QiuHaoran/distributed-computing-platform-mapreduce

    This repository contains a simple Hadoop-like (MapReduce) distributed computing platform implemented in Java. It is extended from a course project at UIUC awarded the best Java version implementation and it's open-sourced for reference.

    Language:Java13325

  • SyncFree/antidote-fs

    A file system backed by AntidoteDB.

    Language:Java133210

  • chaitanya100100/Google-File-System

    A python implementation of Google File System

    Language:Python11101

  • ds2-lab/LambdaFS

    λFS: an elastic, high-performance, serverless-function-based metadata service for large-scale distributed file systems (ACM ASPLOS'23)

    Language:Java11302