Fido [Active Development]
E2E Solution for your distributed file storage
Real-World use case
- you need to download a file, many files, a bunch of file from your scraper
- one disk is not enough, you always need more
- then you decide to use Fido with Systemd
- Fido will automatically distribute your files into selected external disk
- When your files getting bigger again, just add external disk again to your server
Prerequisite
- Make sure you have running mongodb server, if not, install mongodb
- Setup mongodb url in here
Installation
git clone
cd Fido
cargo build --release
Usage
# generate symbolic link for any data that already in brick/slave/disk
# --path are not used in --cmd 0
./target/release/Fido --cmd 0 --path / --bricks /mnt/disks/disk-1
# move temporary file to brick/slave/disk, then create ln from disk to temporary location
./target/release/Fido --cmd 1 --path /path/to/scrapped-data --bricks /mnt/disks/