[FEATURE]Add Docker-compose setting for IT testing
Opened this issue · 0 comments
YANG-DB commented
Is your feature request related to a problem?
Create a docker compose that will allow local IT testing using a spark + opensearch containers and being able to query spark directly using opensearch dashboard
What solution would you like?
Create a docker compose with the following services:
- Spark cluster
- OpenSearch server
- OpenSearch dashboard server
Be able to run the OpenSearch dashboard to directly (async API) query data residing on the local file system (hadoop ?)
using a spark based datasource