data-storage

There are 336 repositories under data-storage topic.

  • ammarahm-ed/react-native-mmkv-storage

    An ultra fast (0.0002s read/write), small & encrypted mobile key-value storage framework for React Native written in C++ using JSI

    Language:C++1.7k15264120

  • fstpackage/fst

    Lightning Fast Serialization of Data Frames for R

    Language:R6263826741

  • datalad/datalad

    Keep code, data, containers under control with git and git-annex

    Language:Python615204k115

  • knoxite/knoxite

    A data storage & backup system

    Language:Go488912635

  • qsbase/qs

    Quick serialization of R objects

    Language:C432128819
  • HDF5.jl

    JuliaIO/HDF5.jl

    Save and load data in the HDF5 file format from Julia

    Language:Julia40516511142

  • pracdata/awesome-open-source-data-engineering

    A curated list of open source tools used in analytics platforms and data engineering ecosystem

    39223141
  • autotier

    45Drives/autotier

    A passthrough FUSE filesystem that intelligently moves files between storage tiers based on frequency of use, file age, and tier fullness.

    Language:C++31592815

  • airscholar/e2e-data-engineering

    An end-to-end data engineering pipeline that orchestrates data ingestion, processing, and storage using Apache Airflow, Python, Apache Kafka, Apache Zookeeper, Apache Spark, and Cassandra. All components are containerized with Docker for easy deployment and scalability.

    Language:Python28758132

  • JuliaIO/JLD.jl

    Saving and loading julia variables while preserving native types

    Language:Julia2842218155

  • karthik/rdrop2

    Dropbox Interface from R

    Language:R2541414159

  • ganweisoft/Gateway

    Gateway is a high-performance, centralized communication and scheduling module for various device plugins. It uniformly converts heterogeneous data into standardized models and delivers core functionalities such as real-time data storage, alarm triggering, linkage control, and task planning.

    Language:C#232001

  • Weedshaker/PeerWebSite

    Peer to Peer decentral Web Site hosting at your fingertips! Send full featured HTML (incl. CSS, JS) sites from your browser and attach files eg. videos, audios, images, etc.

    Language:JavaScript19312125

  • GridProtectionAlliance/openHistorian

    The Open Source Time-Series Data Historian

    Language:TypeScript192445752

  • GlitterWare/Passy

    Offline password manager with cross-platform synchronization

    Language:Dart172510824

  • marceloboeira/bojack

    🐴 The unreliable key-value store

    Language:Crystal11273513

  • lf-edge/edge-home-orchestration-go

    Home Edge Project in LF Edge - Edge Orchestration for home edge devices to enabling smart home use cases.

    Language:Go1011113951

  • artiomn/NAS

    Scripts and config files for the secure Linux-based multiservice server on ZFS

    Language:Python737120

  • Jayvardhan-Reddy/Azure-Certification-DP-200

    Road to Azure Data Engineer Part-I: DP-200 - Implementing an Azure Data Solution

    676050

  • hegongshan/Storage-for-AI-Paper

    Accelerating AI Training and Inference from Storage Perspective (Must-read Papers on Storage for AI)

    50305

  • bearframework/bearframework

    An open-source PHP framework. Incredibly lightweight. Powerful enough.

    Language:PHP46638

  • msdeep14/DeepDataBase

    A relational database engine using B+ tree indexing

    Language:C++463112

  • khoih-prog/RP2040_SD

    This library enables you to use SPI SD cards with RP2040-based boards such as Nano_RP2040_Connect, RASPBERRY_PI_PICO using either RP2040 Arduino-mbed or arduino-pico core. This SD-Fat v2 can support FAT16, FAT32, exFAT file systems. exFAT supports files larger than 4GB by using uint64_t as file offset.

    Language:C++451711

  • qsbase/qs2

    Language:C434151

  • MannLabs/alpharaw

    An open-source Python package to unify raw MS data accession and storage.

    Language:Jupyter Notebook289209

  • mozilla-lockwise/lockbox-datastore

    Experimental Data Storage module for Firefox Lockbox project, not being actively developed

    Language:JavaScript2814353

  • PFund-Software-Ltd/pfeed

    Data Engine for Manual/Algo Trading: Download/Stream -> Clean -> Store. Supports Data Lakehouse Architecture. Clean Once and Forget.

    Language:Python28005

  • bitdust-io/public

    BitDust project source codes : official Public Git repository (mirror on GitHub) : https://bitdust.io

    Language:Python25713

  • bitdust-io/devel

    BitDust project source codes development cycle, official Development Git repository (mirror on GitHub) : https://bitdust.io

    Language:Python2463314

  • deverte/awesome-science

    A currated list of awesome scientific software, libraries and services.

    Language:Just24102

  • gerold-penz/bun-sqlite-key-value

    A super fast key-value store with SQLite that uses bun:sqlite and v8 as a fast JSON replacement.

    Language:HTML241231

  • gbeckers/Darr

    A Python library for numpy arrays that persist on disk in a format that is simple, self-documented and tool-independent, and maximizes universal readability.

    Language:Python23173

  • khoih-prog/LittleFS_Mbed_RP2040

    Wrapper of LittleFS for Arduino MBED RP2040 boards. This library facilitates your usage of LittleFS for the onboard flash. LittleFS supports power fail safety and high performance

    Language:C++23225

  • AAROC/DevOps

    DevOps code to deploy eScience services

    Language:Jinja201023940

  • aureleoules/bitcandle

    Store data on Bitcoin for 350 sats/KB up to 185 KB by using P2SH-P2WSH witness scripts

    Language:Go19403

  • ZorPastaman/Event-Based-Blackboard

    Event Based Blackboard for Unity is a flexible data storage that can contain any count of properties of any type. The properties can be accessed with property names.

    Language:C#19300