Terraform module for managing Elasticsearch sink connector on Aiven managed KafkaConnect cluster. This module depends on Aiven kafka init module to access basic information about Aiven's KafkaConnect cluster
Access to Aiven terraform provider requires an API authentication token which can be generated
from Aiven console
Aiven authentication token can be provided as an environment variable with TF_VAR_ prefix or in a .tfvars file,
otherwise from Harness Secrets Manager if you are provisioning from Harness.
To be able to sink data to Elasticsearch server you need to figure out
- the topics on the Kafka cluster to sink data from
- the target Elasticsearch service URL(s)
- credentials(username and password) to get access to the Elasticsearch service
- Kafka user with permission to read topic schema
module "elasticsearch-sink" {
source = "github.com/entur/terraform-aiven-kafka-connect-elasticsearch-sink//modules/elasticsearch-sink?ref=v0.1.3"
...
}
See the README.md under module's subfolder for a list of supported inputs and outputs. For examples showing how
they're implemented, check the examples subfolder.
You can control the version of a module dependency by adding ?ref=TAG at the end of the source argument, as shown in
the example above. This is highly recommended. You can find a list of available
versions here.
Dependency automation tools such as Renovate Bot will be able to discover new releases and suggest updates automatically.