Seed Database

Question

Seed Database

owocki opened this issue 9 years ago · 18 comments

I have a database of price, volume, bid/ask spread history for the entire poloniex index, at a minute-by-minute- granularity, for the last several months (from 2/21 to present). I will post if there is enough interest.

Answer 1 · 2016-03-27T00:16:56.000Z

Definitely interested, and thanks for the writeup

Answer 2 · 2016-03-27T14:48:42.000Z

Will run the DB dump today.

Answer 3 · 2016-03-27T15:03:52.000Z

I'd love to see the data. Great work on the project!

Answer 4 · 2016-03-27T15:04:05.000Z

OK, i've created a 1.3 GB postgres dump with prices/volume/bidask spread (from 2/21 to present) and put it in the following bittorrent file. (redacted)

File is also available as a direct HTTP download: http://experiments.owocki.com/pytrader/prices.zip

EDIT: Please see the more up to date price historys posted @ #2 (comment)

Answer 5 · 2016-03-27T16:02:31.000Z

Bittorrent is a little slow. I zipped up the file to 152MB and posted it @ http://experiments.owocki.com/pytrader/prices.zip

Answer 6 · 2016-03-27T20:00:18.000Z

Thanks for sharing! Made a mirror in case of problems with download: https://densmirnov.com/prices.psql.zip

Answer 7 · 2016-03-28T16:06:31.000Z

linked to this issue from the readme so others can find the seed DB, going to close it since it's now resolved.

Answer 8 · 2016-04-02T20:00:03.000Z

Notes from slack channel. To restore

Make sure none of the cornjobs are running
Drop or truncate the history_prices table
psql <dbname> < filename

Answer 9 · 2016-04-03T20:29:24.000Z

For anyone interested, I'm dumping my history_price every two hours:
http://dumps.snipanet.com/history_price-latest.psql.gz

Archival dumps for 7 days (In theory!) are at: http://dumps.snipanet.com/

I'll be moving this likely this week to a new server that will be running a copy of pytrader master

Answer 10 · 2016-04-05T13:30:13.000Z

A script to restore these prices available @ https://github.com/owocki/pytrader/pull/54/files#diff-0730bb7c2e8f9ea2438b52e419dd86c9R262

Answer 11 · 2016-12-30T20:24:26.000Z

Anther good source of data => http://api.bitcoincharts.com/v1/csv/

Answer 12 · 2016-12-30T20:29:57.000Z

Just curious, has anyone been collecting pytrader data for the last several months? I'm holed up with some friends who are deep learning experts and we're trying to have another go at making a profit.... but it looks like there's some holes in my data set i've been collecting (my server had some downtime and ran out of disk space a couple times in 2016)

Answer 13 · 2016-12-30T22:02:00.000Z

I have not unfortunately, I purged almost everything a couple days ago when my main server needed a rebuild. Might be fun to pick this up again though if there's interest.

Answer 14 · 2017-08-20T10:26:53.000Z

Hi. is it possible to get a new link for the prices?
Anyone has anything on bittrex by chance?

Thanks

Answer 15 · 2017-09-18T10:01:56.000Z

Can someone reup the file?

Answer 16 · 2017-10-29T14:33:27.000Z

All links are not available ((

Answer 17 · 2018-01-03T17:37:51.000Z

Does anyone have the format of the pre-existing DB. I would like to use http://api.bitcoincharts.com/v1/csv/ and run a script to format it how it needs to be

Answer 18 · 2020-05-09T08:10:10.000Z

I understand I'm late to the party here, but if anyone is still looking for data CCXT and CCXTPro are both great libraries which can easily be scripted to populate a database with OHLCV prices from many crypto exchanges. I'm not affiliated with CCXT at all, just been using it for a couple years and a big fan of the authors' work. They've done a great job of transpiling the library into Python, PHP, and JavaScript.