/stetl

SETL stands for Simple ETL (or Spatial ETL or Streaming ETL if you want). SETL uses existing transformation tools like GDAL/OGR and XSLT and is glued through Python. A config file specifies the ETL chain of modules. SETL is speed-optimized by using native calls like ogr2ogr, libxml and libxslt (via lxml). SETL is in particularly meant in ETL cases where either ogr2ogr or XSLT alone is not sufficient. This mostly involves schema transformations as required for INSPIRE and local GML-based complex datasets. SETL has proven to be able to handle 10's of millions of features/records through a technique dubbed "gml-splitting" (and outputting into a deegree blobstore, which could be dubbed "gml-spitting").

Primary LanguagePythonGNU General Public License v3.0GPL-3.0

Stargazers

No one’s star this repository yet.