logstash-plugins/logstash-input-elasticsearch

Deprecate `size` setting

Opened this issue · 3 comments

The size setting is how many records are returned per scroll request, and it can easily be confused with "how many records to return, period" which is not what it does.

In practice, users should not care about this setting, and I find no reason why a user would want to set it.

The default (1000) is probably fine for every use case.

@jordansissel do you think users should need to change any of the scroll settings? Or is the use case always "process every record returned by the query no matter how long it takes"? For example I always use 60000m in mine.

Hi,
Can someone tell me, whats the valid parameter to use in order to get specific number of records i.e. 10 records only. As it is mentioned above, one can confuse this size parameter. I am one of the victim :p
Can please specify which parameter/attribute to use to get specific number of records instead?