aws-solutions/content-analysis-on-aws

Elasticsearch consumer failing is with incompatibility error

ianwow opened this issue · 1 comments

I just started noticing that the data pipeline is no longer sending data to Elasticsearch. Digging into the logs, the bulk load function is failing with this error:

Unable to load data into es: The client noticed that the server is not a supported distribution of Elasticsearch

I'm seeing this happening with AWS Elasticsearch Service version 7.10

To fix this, we need to peg the python elasticsearch library to version 7.13.4 because the latest version (7.14.0) artificially breaks compatibility