codelibs/elasticsearch-dataformat

Only first 100 results are downloaded (instead of full download)

fbaligand opened this issue · 3 comments

fbaligand commented

Hi,

I just tested the plugin, without setting "from" or "size" options, but I get only the first 100 hits.
As documentation says, I expected a full data download.

I do this GET query:
curl "http://localhost:9200/my-index/_data?format=csv"

I tested elasticsearch-dataformat version 7.9.0.

fbaligand commented

When I tell "as documentation says", I speak about this sentence in README:

This plugin allows you to download data as a format you want. If the query dsl contains "from" parameter, the query is processed as search query. If not, it's as scan query(all data are stored.).

Is there a special param to indicate that I want a full download?

fbaligand commented

Hi,

I finally found how to generate a full download:
add scroll=1m parameter.

I find it only after having read plugin's code.
I think a line about this feature in the documentation would be nice.

  • 👍1
martinszy commented

This bug is still open and this solution is still valid.