replicate data from odata api into sql tables. it is not usable for ANY automation yet.
This program creates libraries and allows configuration - such as recording data sources or data bases or managing scraper and schedulers.
This program allows configuration for schedulers and scrapers in particular.
This program is responsible for issuing sql statements according to their assigned data source and database.
This library does all heavy lifting. It defines workspace management, odata requests and so on...
- implement altering of tables and conditional creation of tables
- store merge results into a table
- create user interface for configuring scrapers ($select, merge strategy, etc.)
- implement OAuth2 authentification for OData Sources
- create windowing of tables (create SQL and ODATA where clause / filters based on PKs to reduce table locking)
- determine migrations