innoq/iqvoc

Export and Import issue

Opened this issue · 1 comments

I've deployed the iqvoc application on Heroku.
I have two running dynos (web+worker):
=== web (Free): bin/rails server -p $PORT -e $RAILS_ENV (1)
web.1: up 2018/06/26 16:45:15 +0300 (~ 16m ago)
=== worker (Free): bundle exec rake jobs:work (1)
worker.1: up 2018/06/26 16:43:13 +0300 (~ 18m ago)

I try to import hobbies.nt from 'data' folder via Dashboard->Import feature. In the log file (via dashboard.heroku.com) I see the messages:

2018-06-26T13:59:51.277195+00:00 app[worker.1]: [Worker(host:550a339e-8dcc-4ee2-8cc3-caaf99b4d9a8 pid:4)] Job ImportJob (id=6) RUNNING
2018-06-26T13:59:51.281906+00:00 app[worker.1]: [Worker(host:550a339e-8dcc-4ee2-8cc3-caaf99b4d9a8 pid:4)] Job ImportJob (id=6) FAILED (3 prior attempts) with ActiveRecord::RecordInvalid: Validation failed: NTriples file can't be blank
2018-06-26T13:59:51.290705+00:00 app[worker.1]: [Worker(host:550a339e-8dcc-4ee2-8cc3-caaf99b4d9a8 pid:4)] 1 jobs processed at 38.3818 j/s, 1 failed

And the import process isn't ended successfully. What I doing wrong?

Then I've created a few Concepts/Collections/Scheme and tried to Export it, but without success also. The Export process ended, but when I click on 'Download' button I get the error:
'An error occurred. Export could not be found.'
What does it mean?
Export log is:

I, [2018-06-26T13:54:55.240854 #4]  INFO -- : Starting export...
I, [2018-06-26T13:54:55.240891 #4]  INFO -- : file_path = /app/public/export/74406413935200762808872225698046776866.nt
I, [2018-06-26T13:54:55.240916 #4]  INFO -- : type = nt
I, [2018-06-26T13:54:55.241012 #4]  INFO -- : Exporting namespaces...
I, [2018-06-26T13:54:55.242187 #4]  INFO -- : Finished exporting namespaces.
I, [2018-06-26T13:54:55.242243 #4]  INFO -- : Exporting collections...
I, [2018-06-26T13:54:55.368218 #4]  INFO -- : Collections 1-3 exported.
I, [2018-06-26T13:54:55.374029 #4]  INFO -- : Finished exporting collections (3 collections exported).
I, [2018-06-26T13:54:55.374120 #4]  INFO -- : Exporting concepts...
I, [2018-06-26T13:54:55.709058 #4]  INFO -- : Concepts 1-69 exported.
I, [2018-06-26T13:54:55.714463 #4]  INFO -- : Finished exporting concepts (69 concepts exported).
I, [2018-06-26T13:54:55.714534 #4]  INFO -- : Saving export to '/app/public/export/74406413935200762808872225698046776866.nt'
I, [2018-06-26T13:54:55.724519 #4]  INFO -- : Export Job finished in 0 seconds.

I've just encountered the same issue with an import.

I think the issue might be to do with heroku only giving you an ephemeral file system. https://help.heroku.com/K1PPS2WM/why-are-my-file-uploads-missing-deleted

I worked around this by running a local copy of the application connecting to the remote database I provisioned for my Heroku app. This means I can do the import, then manage things further on the instance.

I expect exports will still be a problem though. So will investigate that separately.