FosterConstructionGroup/tap-costcon

PythonAGPL-3.0

tap-costcon

This is a Singer tap that produces JSON-formatted data from Costcon exports following the Singer spec.

This tap:

Parses Costcon exports
Outputs the schema for each resource

Quick start

Install

We recommend using a virtualenv:

> virtualenv -p python3 venv
> source venv/bin/activate
> pip install -e .

Create the config file

Create a JSON file called config.json containing the path to the folder with the exports.
```
{
  "folder": "path/to/folder"
}
```

Run the tap in discovery mode to get properties.json file

tap-costcon --config config.json --discover > properties.json

In the properties.json file, select the streams to sync

Each stream in the properties.json file has a "schema" entry. To select a stream to sync, add "selected": true to that stream's "schema" entry. For example, to sync the jobs stream:
```
...
"tap_stream_id": "jobs",
"schema": {
  "selected": true,
  "properties": {
...
```

Run the application

tap-costcon can be run with:

tap-costcon --config config.json --properties properties.json