Import journals in database

Question

Import journals in database

Closed this issue 9 years ago · 6 comments

bartaelterman commented 9 years ago

Answer 1 · 2015-07-20T13:21:53.000Z

I have a csvfile with news journals. These should be imported in the application.

Column 1: name
Column 2: spider_name

Delimiter: ";"

Answer 2 · 2015-07-20T13:55:30.000Z

I needed a data migration script for developement. Maybe this can help: https://github.com/Datafable/epu-index/blob/master/tmp/migrate_data.py

Answer 3 · 2015-09-07T12:18:03.000Z

Command implemented. Two addiditonal questions:

Should I run it on Heroku now with the journals.csv file from old_data (Google Docs folder)?
For now, the command expects the CSV dialect to be the one from old_data/journals.csv (no header line, ; separator, ...). If we ever need more flexibility, tell me and I'll implement something more sophisticated.

Answer 4 · 2015-09-07T12:27:31.000Z

Thanks!

Yes, should be run on Heroku.
No, no more flexibility is needed for this.

Answer 5 · 2015-09-07T13:22:47.000Z

Data loaded on Heroku. Please note there was already an entry for "Het Laatste Nieuws", I didn't dared to delete it since there were linked articles!

Answer 6 · 2015-09-07T20:06:31.000Z

Ok. Actually that's all dummy data. So next time, the table can be trunced before uploading new data. I did not consider that database as production so far.