File cleanup
Opened this issue · 0 comments
zacharlie commented
There still seems to be large blobs. I will remove the SeoulOSMMirror.gpkg which is causing bloat, but I think a number of the other sample data files need to be pruned or at least use a smaller subset of data to keep the repo size relatively lean. Storing PDF files etc in the repo is also less than ideal so we need clear resolutions and better data management practices.
To get the blob sizes:
git rev-list --objects --all |
git cat-file --batch-check='%(objecttype) %(objectname) %(objectsize) %(rest)' |
sed -n 's/^blob //p' |
sort --numeric-sort --key=2 |
cut -c 1-12,41- |
$(command -v gnumfmt || echo numfmt) --field=2 --to=iec-i --suffix=B --padding=7 --round=nearest
source: https://stackoverflow.com/questions/10622179/how-to-find-identify-large-commits-in-git-history
Results ( Subset>250kb):
32c7ba7d3758 256KiB QGISProject.sql
ec0cd9037ae6 257KiB hugo_conf/static/unsplash/photo-1614728672820-e88260ce6d0d.jpg
46a0ccc99ff6 259KiB QGISProject.sql
ee94f23c7406 269KiB hugo_conf/static/unsplash/photo-1579818136210-457ff9197a99.jpg
50937333b99a 281KiB docs/_static/jquery-3.5.1.js
f9d52c601799 288KiB html/assets/img/background.jpg
16d26dfba293 294KiB qgis_projects/SeoulOSMMirror/SeoulOSMMirror.qgz
b64090da19da 297KiB diagrams/QGIS-Server-PG-Project-Design.drawio
3b0e00a9c8cf 297KiB hugo_conf/static/unsplash/photo-1620136908072-b8d7207a2547.jpg
c39295294750 310KiB docs/_images/node-red-worldmap-8.png
f3432c4f6284 325KiB docs/OpenSource GIS Stack Installation From Scratch.docx
e1d3f62aa0a1 327KiB docs/OpenSource GIS Stack Installation From Scratch.docx
a43ce74d2b8a 334KiB hugo_conf/static/unsplash/photo-1579159279464-d12b399393a6.jpg
2820c39c799c 343KiB docs/_images/osm-mirror-workflow-12.png
33b408645f50 346KiB docs/OpenSource GIS Stack Installation From Scratch.docx
12183fba4bc7 349KiB docs/_images/node-red-postgres-table-5.png
d2539a02b965 352KiB hugo_conf/static/unsplash/photo-1573489176014-6d0176081570.jpg
677419c640f4 357KiB QGISProject.sql
d716a4c37a60 376KiB hugo_conf/static/unsplash/photo-1576767810583-046a1f7da256.jpg
b136b218aa94 391KiB sphinx/source/img/publish-using-pgservice-file-3.png
10834438c19a 400KiB html/package-lock.json
2fd6f3bcd990 412KiB docs/OpenSource GIS Stack Installation From Scratch.docx
aff0712bf65e 412KiB docs/OpenSource GIS Stack Installation From Scratch.docx
63435ac14c3d 412KiB docs/OpenSource GIS Stack Installation From Scratch.docx
f973613527b5 416KiB sphinx/OpenSource GIS Stack Installation From Scratch.docx
42ea7a4099a2 416KiB docs/OpenSource GIS Stack Installation From Scratch.docx
5bc384367eed 430KiB docs/_images/geoserver-osm-4.png
855c845e538b 434KiB html/assets/fonts/fontawesome-webfont.svg
d7a4492ee3ac 448KiB diagrams/QGIS-Server-PG-Project-Workflow.png
4697eac7a1e6 450KiB sphinx/source/img/upload-qgis-project-5.png
865fc79ba556 452KiB qgis_projects/osm_mirror_qgis_project/osm_mirror_qgis_project.sql
4990d4d9c339 454KiB sphinx/source/img/publish-using-pgservice-file-3.png
e04ae398440c 456KiB hugo_conf/static/unsplash/photo-1579159279743-4c5fefb3ba11.jpg
8dee77b1e01a 471KiB docs/_images/upload-qgis-project-5.png
c6b47c8ec1a7 474KiB hugo_conf/static/unsplash/photo-1578589303256-5675a36857c8.jpg
40aa5ea2214b 482KiB docs/_images/node-red-worldmap-5.png
172e814d2f47 522KiB QGIS-Server-PG-Project-Design.png
a01e2d418426 536KiB docs/_images/node-red-worldmap-4.png
9fa95710f388 544KiB QGISProject.sql
299718285b7b 548KiB diagrams/QGIS-Server-PG-Project-Design.drawio
8fde3de7f492 548KiB diagrams/QGIS-Server-PG-Project-Design.drawio
6e249c622f7a 549KiB html/ol-ext.min.js
31e7ddaedb48 550KiB diagrams/QGIS-Server-PG-Project-Design.drawio
f92dc1d96ee1 559KiB README.pdf
de48c6c088e4 630KiB sphinx/source/img/QGIS-Server-PG-Project-Workflow.png
d2651dfe5cf6 636KiB qgis_projects/osm_mirror_qgis_project/osm_mirror_qgis_project.sql
5bd471dab14e 637KiB qgis_projects/osm_mirror_qgis_project/osm_mirror_qgis_project.sql
a700ff185eda 638KiB qgis_projects/osm_mirror_qgis_project/osm_mirror_qgis_project.sql
eee9df07bb8f 639KiB diagrams/QGIS-Server-PG-Project-Design.png
81c89771fc38 656KiB qgis_projects/osm_mirror_qgis_project/osm_mirror_qgis_project.sql
f8f9146d6c53 675KiB qgis_projects/osm_mirror_qgis_project/osm_mirror_qgis_project.sql
46e0af487b15 701KiB docs/_images/pg-service-14.png
4c6888aad3cc 710KiB conf/hugo_conf/site_template/static/images/Note-Snippet.gif
4f32a77a77af 850KiB docker-compose.png
df616bfc2a45 894KiB QGISProject.sql
f1f1fb351e8b 973KiB hugo_conf/static/js/ol/v6.5.0/ol.js
4d59f726f8cd 1.1MiB html/ol-ext.js
670c5976aa58 1.2MiB docs/_images/QGIS-Server-PG-Project-Design.png
2559756aa206 1.3MiB docs/_images/node-red-worldmap-31.png
5a397f6850a9 1.4MiB docs/OpenGISStack-Presentation.pptx
8ad124b45591 1.4MiB diagrams/Activities.drawio
ef9d1fa14207 1.5MiB sphinx/OpenGISStack-Presentation.pptx
13ec26777849 1.6MiB osgs-manual.pdf
3624f1966bdb 1.6MiB osgs-manual.pdf
0f7dad690c35 1.6MiB osgs-manual.pdf
6609fb8bc8e2 1.7MiB osgs-manual.pdf
6b758bf8c95a 1.7MiB osgs-manual.pdf
cf38c1542eb4 1.7MiB osgs-manual.pdf
52c5183bebef 1.7MiB osgs-manual.pdf
fb7c3d6509c9 1.7MiB osgs-manual.pdf
0afc47a30b21 1.7MiB osgs-manual.pdf
1a021964b7b3 1.7MiB osgs-manual.pdf
e39d5c3ad37b 1.7MiB osgs-manual.pdf
2fa156c3bb34 1.8MiB osgs-manual.pdf
52ac89ce0bf3 1.8MiB osgs-manual.pdf
4fd468b7c149 1.8MiB osgs-manual.pdf
9fee87baf3f5 1.8MiB osgs-manual.pdf
09571a722d34 1.8MiB osgs-manual.pdf
2e017d217fbc 1.8MiB osgs-manual.pdf
dcd0b099240c 2.2MiB qgis_projects/demo/portugal.shp
1e96b16fa64b 2.4MiB conf/osm_conf/qgis_style.sql
2cc0e9e3699a 2.4MiB conf/osm_conf/qgis_style.sql
9c8c76a3164f 2.9MiB conf/osm_conf/qgis_style.sql
d849f27d7298 3.0MiB conf/osm_conf/qgis_style.sql
6a6a011568ab 3.0MiB conf/osm_conf/qgis_style.sql
d514fe5576b2 3.1MiB conf/osm_conf/qgis_style.sql
992ba91a0c6d 4.8MiB html/libs/ol.js.map
2d18c3bfafb1 5.0MiB sphinx/OpenGISStack-Presentation.pdf
6f06d6684cd0 5.4MiB mapproxy_conf/cache_data/airports.mbtiles
c4f7928d6da8 87MiB qgis_projects/SeoulOSMMirror/SeoulOSMMirror.gpkg