LaGriT repo size is huge
daniellivingston opened this issue · 3 comments
daniellivingston commented
The LaGriT repo on clone is ~1.67 GB. The vast majority of this is from git deltas (1.014 GB), followed by testing (0.293 GB) and documentation (0.233 GB):
$ du -hs $(ls -A)
12K .DS_Store
1014M .git
4.0K .gitignore
4.0K .travis.yml
8.0K CONTRIBUTING.md
4.0K LICENSE.md
8.0K Makefile
9.7M PyLaGriT
4.0K README.md
233M docs
4.0K docssite_map.md
916K documentation
4.0K lagrit.log
4.0K lagrit.out
1.3M lg_util
2.4M original_pylagrit_website
260K screenshots
37M src
293M test
daniellivingston commented
On a local repo, I was able to reduce folder size to ~30% of the original by using git gc --aggressive.
Before making any modifications to the remote (GitHub) repo, I'll do some testing to make sure everything that needs to be preserved is. Also will investigate more robust methods of cleaning.
Before
❯ du -h -d 0
1.6G .
❯ du -h -d 1
916K ./documentation
260K ./screenshots
293M ./test
233M ./docs
1.3M ./lg_util
2.4M ./original_pylagrit_website
1014M ./.git
9.7M ./PyLaGriT
37M ./src
1.6G .
After
❯ du -h -d 0
551M .
❯ du -h -d 1
916K ./documentation
260K ./screenshots
293M ./test
233M ./docs
512K ./lg_util
2.4M ./original_pylagrit_website
9.5M ./PyLaGriT
12M ./src
551M .
daniellivingston commented
526 MB are used by test and docs alone. Here's a breakdown of where that size is coming from:
test/
$ du -h -d 2 test/ | sort -h -r
293M test/
239M test//level01
58M test//level01/intrp_2D_sizes
52M test//level03
40M test//level01/zone_outside_minmax
30M test//level01/zone_outside
23M test//level01/interp_voronoi
21M test//level03/lin_extp
20M test//level03/grid2grid
18M test//level01/smooth_massage
16M test//level01/addmesh_doublemesh
11M test//level01/test_results
9.6M test//level01/recon1
9.3M test//level03/attderive
4.3M test//level01/addmesh_add
3.7M test//level01/cmo_readatt
3.6M test//level01/cmo_addatt_normals
2.9M test//level01/intersect
2.9M test//level01/interp_map
2.8M test//level01/interp_continuous
2.7M test//level02
2.1M test//level01/hybrid_volume
1.9M test//level02/exodus_prisms
1.9M test//level01/connect_cube
1.6M test//level01/refine_octree
1.2M test//level01/smooth
792K test//level01/write_exo
764K test//level03/pflotran_stor
540K test//level01/rmpoint
484K test//level01/createpts
416K test//level01/pset
404K test//level01/setpts
400K test//level02/exodus_cube
400K test//level01/eltset
344K test//level01/quad_quality
284K test//level01/io_agf_simple
256K test//level02/exo_pset_eltset
256K test//level01/sort
240K test//level01/pflotran_stor
176K test//level03/read_3token
172K test//level01/quality
136K test//level01/refine_octree_prd
124K test//level01/pset_readwrite
104K test//level02/exo_eltset
76K test//level01/hextotet
56K test//level01/single_triangle
56K test//level01/refine_recon_quality
52K test//level01/rotateln
52K test//level01/filter
52K test//level01/addmesh_append
48K test//level01/triangulate_polygon
48K test//level01/connect_errors
44K test//level01/addmesh_merge
40K test//level01/createpts_filter
36K test//lg_test_lib
20K test//level01/surface
docs/
$ du -h -d 2 docs/ | sort -h -r
233M docs/
166M docs//assets
163M docs//assets/images
61M docs//pages
21M docs//pages/docs
17M docs//pages/tutorial
3.3M docs//pylagrit/original
3.3M docs//pylagrit
3.0M docs//pages/release_notes
2.6M docs//_layouts
1.6M docs//assets/img
1.3M docs//_layouts/img
1.1M docs//assets/font-awesome-4.7.0
1.1M docs//_layouts/font-awesome-4.7.0
472K docs//assets/css
192K docs//assets/slick
188K docs//assets/js
152K docs//_layouts/css
132K docs//pages/mstkla
36K docs//assets/tipuesearch
32K docs//edit_scripts
daniellivingston commented
An easier-to-parse breakdown:
test/level01/
$ ❯ du -h -d 1 test/level01 | sort -h -r | tail -n +2
58M test/level01/intrp_2D_sizes
40M test/level01/zone_outside_minmax
30M test/level01/zone_outside
23M test/level01/interp_voronoi
18M test/level01/smooth_massage
16M test/level01/addmesh_doublemesh
11M test/level01/test_results
9.6M test/level01/recon1
4.3M test/level01/addmesh_add
3.7M test/level01/cmo_readatt
3.6M test/level01/cmo_addatt_normals
2.9M test/level01/intersect
2.9M test/level01/interp_map
2.8M test/level01/interp_continuous
2.1M test/level01/hybrid_volume
1.9M test/level01/connect_cube
1.6M test/level01/refine_octree
1.2M test/level01/smooth
792K test/level01/write_exo
540K test/level01/rmpoint
484K test/level01/createpts
416K test/level01/pset
404K test/level01/setpts
400K test/level01/eltset
344K test/level01/quad_quality
284K test/level01/io_agf_simple
256K test/level01/sort
240K test/level01/pflotran_stor
172K test/level01/quality
136K test/level01/refine_octree_prd
124K test/level01/pset_readwrite
76K test/level01/hextotet
56K test/level01/single_triangle
56K test/level01/refine_recon_quality
52K test/level01/rotateln
52K test/level01/filter
52K test/level01/addmesh_append
48K test/level01/triangulate_polygon
48K test/level01/connect_errors
44K test/level01/addmesh_merge
40K test/level01/createpts_filter
20K test/level01/surface
test/level02/
❯ du -h -d 1 test/level02 | sort -h -r | tail -n +2
1.9M test/level02/exodus_prisms
400K test/level02/exodus_cube
256K test/level02/exo_pset_eltset
104K test/level02/exo_eltset
test/level03/
$ du -h -d 1 test/level03 | sort -h -r | tail -n +2
21M test/level03/lin_extp
20M test/level03/grid2grid
9.3M test/level03/attderive
764K test/level03/pflotran_stor
176K test/level03/read_3token
docs/
❯ du -h -d 1 docs/ | sort -h -r
233M docs/
166M docs//assets
61M docs//pages
3.3M docs//pylagrit
2.6M docs//_layouts
32K docs//edit_scripts
docs/pages/
61M docs/pages
20M docs/pages/docs/demos
17M docs/pages/tutorial/stratigraphy
14M lasetupdoc.ps
1.9M lasetupdoc.pdf
1.4M lasetupsgi
930K lasetupsolaris
docs/assets/images/ (largest 25 files)
❯ du -h -d 1 docs/assets/images | sort -h -r
163M docs/assets/images
$ ls -lhS docs/assets/images | awk '{print $5,"\t",$9}' | head -25
20M ahmandrew1.pdf
9.5M dendrite.gif
9.5M dendriteng.gif
5.7M gmtri_shear.gif
5.5M vertgrid_rotation_10-4.gif
5.2M 99.gif
4.7M tmap-a.gif
4.6M nasa.pdf
4.6M volume_conserving_smoothing.pdf
4.2M vertgridshort_swe_10-3.gif
3.5M siam222.pdf
3.2M 2005_vadose_zone_j_robinson_cole_carey_witkowski_gable_lu_gray.pdf
3.2M 2001_gji_lowman_king_gable.pdf
3.2M BORON.pdf
3.1M side_rotation_10-4.gif
3.1M gmquad_shear.gif
2.8M nogmquad_shear.gif
2.7M volume_kuprat.pdf
2.7M backsideshort_swe_10-3.gif
2.1M 2000_er_cad_gid_mode#4FE92C.pdf
1.9M lasetupdoc.pdf
1.9M 2004_g3_lowman_king_gable.pdf
1.8M sidegridshort_swe_10-3.gif
1.7M lagrit.pdf