Tilesizer

Background

Tilesizer measures the average size of a tile in a set of files, weighted by weights. It is designed for tiles and accesses but could work with any type of files where you want a weighted average of size.

Install

For local development

python3 -m venv venv
. venv/bin/activate
pip install --editable .

Usage

Give tilesizer a list of files on stdin, relative to the path you give it. The list of files is in the format path weight, e.g. 0/0/0 838360.

cat access_list | tilesizer /location/of/tiles

Tilesizer can read from anything PyFilesystem supports

cat access_list | tilesizer s3://mybucket

OpenStreetMap provides statistics in the required form

curl -s 'https://planet.openstreetmap.org/tile_logs/tiles-2020-01-01.txt.xz' \
  | tilesizer /location/of/tiles

Use grep to filter the access list

xzgrep '^10/' tiles-2020-01-01.txt.xz | tilesizer /location/of/tiles

Contributing

All code should be formatted according to flake8. Check this with flake8 tilekiln tests

License