Increase upload limit of /media/db/iati_import/ folder in RSR

Question

Increase upload limit of /media/db/iati_import/ folder in RSR

KasperBrandt opened this issue 9 years ago · 8 comments

For the Cordaid import in RSR, they send us a large file (approx 120 MB) that we need to process. Our new IATI import allows for uploading that file, but the folder (/media/db/iati_import/) does not support uploads of more than 5 MB I think. Could this be increased to 150 MB or so, just for this folder?

And maybe for Test / UAT as well, while we're at it.

Answer 1 · 2016-03-08T10:25:59.000Z

@orifito please close this issue if you're happy to do so.

Answer 2 · 2016-03-08T10:27:48.000Z

@peeb sure, more than happy to close it 👍

Answer 3 · 2016-10-05T12:43:54.000Z

@orifito @peeb the fix says it's temporary. I was wondering, if this is going away soon, or if there's a better fix, or if this is stay as is for the foreseeable future?

Answer 4 · 2016-10-05T13:44:18.000Z

The better fix would have to be discussed and should ideally be done on the RSR side - i.e. if you have "expensive" API endpoints, they should be paginated or limited in some way and dealt with on the client.

I personally see both caching and timeout increases as the last resort.

What I would propose would be auditing and fixing expensive API calls and then disabling this timeout hack.

@orifito - thoughs?

Answer 5 · 2016-10-05T14:07:04.000Z

Same than yours, paginating expensive API endpoints. Once it's done, we will be more than happy to remove such huge timeout.

Answer 6 · 2016-10-05T14:21:20.000Z

This is the client_max_body_size hack for file uploads/POSTs. But, I guess your comments still hold?

Answer 7 · 2016-10-05T15:50:08.000Z

Ah I misread then... sorry! I guess that's no longer needed

Answer 8 · 2016-10-05T17:38:50.000Z

I misread as well. Apologies!