opensearch-project/opensearch-spark

[FEATURE]Add Docker-compose setting for IT testing

Opened this issue · 0 comments

Is your feature request related to a problem?
Create a docker compose that will allow local IT testing using a spark + opensearch containers and being able to query spark directly using opensearch dashboard

What solution would you like?
Create a docker compose with the following services:

  • Spark cluster
  • OpenSearch server
  • OpenSearch dashboard server
    Be able to run the OpenSearch dashboard to directly (async API) query data residing on the local file system (hadoop ?)
    using a spark based datasource