This project contains a series of libraries and utilities to create KV stores backed by HBase (but possibly by other KV databases). The main use of a KV store is to use it as fast lookup caches of pre-computed data.
This project contains 4 main modules:
- kvs-core: base model and a default implementation based on Apache HBase.
- kvs-indexing: Apache Beam pipelines to index GBIF data in HBase tables.
- kvs-rest-client: Retrofit REST clients to access GBIF API services.
- kvs-gbif: Implementation of GBIF KV stores/caches for commonly used data in the data ingestion process.
To build, install and run tests, execute the Maven command:
mvn clean package install -U