frappant/frp_form_answers

Allow to work with large data sets (pagination?)

DanielSiepmann opened this issue · 2 comments

We have some forms with larger data sets e.g. 14912 records for one form.
The initial loading takes very long, as well as the export.

I've seen that f:be.tableList is used to build the output, this does support the argument recordsPerPage. But this is not used once the argument filter is used. So I don't know how to enable pagination there easily.

Furthermore, that doesn't solve the slow export. I didn't investigate the export yet, but will comment once I've something to share.

I'm not able to come up with proper suggestions. Maybe once v12 is released: Add a queue which is processed and will send the exported file via email.

We for now will workaround by hand.

I can confirm this with the large amounts of data.

We had almost 34,000 entries from one form. It was impossible to export them. All we got was a blank page. Error 503.
We had to set the 'memory_limit' in php.ini to 2048MB before we could do anything.

Pagination or something else for large amounts of data would be very desirable.