PDOK/geopackage-optimizer-go

Optimizes geopackage so that it can be used as datasource for PDOK OGC services

geopackage-optimizer-go

Optimizes geopackage so that it can be used as datasource for PDOK ogc services.

Optimizations

• create index PUUID using UUID4
• create index FUUID using [tablename].[PUUID]

This ensures that there are randomly generated UUID's usable as index, which has a couple of advantages:

• having an index is good for performance
• having a UUID instead of an incremental ID prevents crawling
• having a UUID prevents users from creating applications that assumes that id has meaning and will not change in the future

TLDR Usage

Run from the root of this repo (note modifies geopackage/original.gpkg):

docker run \
  -v geopackage:/geopackage \
  pdok/geopackage-optimizer-go:latest "/geopackage/original.gpkg"

Workflow examples

spec:
  templates:
    - name: optimize-gpkg
      retryStrategy:
        limit: 2
        retryPolicy: "Always"
        backoff:
          duration: "10"
          factor: 3
      volumes:
        - name: gpkg-volume
          emptyDir: {}
        - name: optimize-gpkg
          configMap:
            name: optimize-gpkg
            defaultMode: 0777
      inputs:
        parameters:
          - name: source-key
          - name: destination-key
        artifacts:
          - name: "gpkg"
            path: "/data/input.gpkg"
            archive:
              none: {}
      outputs:
        artifacts:
          - name: gpkg
            path: "/data/input.gpkg"
            archive:
              none: {}
            azure:
              endpoint: "$(BLOBS_ENDPOINT)"
              container: geopackages
              blob: "{{inputs.parameters.destination-key}}"
              accountKeySecret:
                name: blobs-argo
                key: BLOBS_KEY
      container:
        image: geopackage-optimizer-go
        imagePullPolicy: IfNotPresent
        volumeMounts:
          - name: gpkg-volume
            mountPath: /data
        command: ["/optimizer", "-s"] # Needed with argo 3.4.4 Emissary workflow executor
        args: ["/data/input.gpkg"]
        resources:
          limits:
            cpu: "0.1"
            memory: "650Mi"
            ephemeral-storage: # PATCH
          requests:
            cpu: "0.1"
            memory: "650Mi"
            ephemeral-storage: # PATCH