- Install Go
- Install Redis & RedisBloom
- Clone this repository
go build
, to build binary
./main
, to run bloom-server
/deduplicate/
, to remove duplicate from list of data. This will return list of unique data
curl -s -v -F "file=@urls.txt" -F "key=clipped" localhost:8000/deduplicate/
/add/
, to add urls to bloom filter from list of data. This will return 200OK if successfully added to bloom filter
curl -s -v -F "file=@urls.txt" -F "key=clipped" localhost:8000/add/
/info/
, to check information about duplicate count & bloom filter