Significantly different output for GC times depending on whether benchmark is run directly or through the CLI

[d-netto]

Example:

• directly:

../julia-stock/julia --gcthreads=1 --project=. benches/serial/linked/tree.jl 

GC: pause 24.28ms. collected 63.577698MB. incr 
Heap stats: bytes_mapped 128.03 MB, bytes_resident 128.03 MB,
heap_size 83.68 MB, heap_target 130.18 MB, Fragmentation 0.495

GC: pause 33.71ms. collected 64.622284MB. full 
Heap stats: bytes_mapped 128.03 MB, bytes_resident 85.91 MB,
heap_size 83.96 MB, heap_target 120.18 MB, Fragmentation 0.554

GC: pause 129.62ms. collected 24.792351MB. incr 
Heap stats: bytes_mapped 128.03 MB, bytes_resident 85.91 MB,
heap_size 105.57 MB, heap_target 152.59 MB, Fragmentation 0.446

GC: pause 257.01ms. collected 0.133347MB. incr 
Heap stats: bytes_mapped 128.03 MB, bytes_resident 111.33 MB,
heap_size 152.43 MB, heap_target 235.51 MB, Fragmentation 0.493

GC: pause 760.00ms. collected 17.473351MB. full 
Heap stats: bytes_mapped 256.06 MB, bytes_resident 250.31 MB,
heap_size 228.08 MB, heap_target 321.53 MB, Fragmentation 0.548
(value = -4192633690078234733, times = 0x0000000100b63e3d, gc_diff = Base.GC_Diff(167772640, 1, 0, 4194314, 0, 101, 386626515, 2, 0), gc_start = Base.GC_Num(14647352, 0, 0, 2986, 0, 5276942, 1254, 2592, 325682843, 314985560, 0x0000000002bc0000, 6, 2, 112956088, 111855641, 10224, 15240, 62803, 20980681, 12730348, 50553001, 275064223, 9078620960059293, 9078620844326467), gc_end = Base.GC_Num(74668288, 0, 0, 2987, 0, 9471256, 1254, 2693, 712309358, 422737264, 0x0000000002bc0000, 8, 2, 257005408, 111855641, 15507, 15507, 91649, 6989427, 250015623, 61368525, 650854878, 9078620960059293, 9078623367010371))

• CLI:

../julia-stock/julia --project=. run_benchmarks.jl serial linked tree -n1
bench = "tree.jl"

GC: pause 25.16ms. collected 62.320648MB. incr 
Heap stats: bytes_mapped 128.03 MB, bytes_resident 128.03 MB,
heap_size 88.44 MB, heap_target 135.03 MB, Fragmentation 0.469

GC: pause 33.09ms. collected 67.997505MB. full 
Heap stats: bytes_mapped 128.03 MB, bytes_resident 84.97 MB,
heap_size 114.39 MB, heap_target 156.54 MB, Fragmentation 0.408

GC: pause 359.39ms. collected 8.745331MB. incr 
Heap stats: bytes_mapped 128.03 MB, bytes_resident 109.05 MB,
heap_size 148.87 MB, heap_target 232.44 MB, Fragmentation 0.516

GC: pause 18.04ms. collected 171.679581MB. incr 
Heap stats: bytes_mapped 192.05 MB, bytes_resident 113.00 MB,
heap_size 76.92 MB, heap_target 115.11 MB, Fragmentation 1.565
┌─────────┬────────────┬─────────┬───────────┬────────────┬──────────────┬───────────────────┬──────────┬────────────┐
│         │ total time │ gc time │ mark time │ sweep time │ max GC pause │ time to safepoint │ max heap │ percent gc │
│         │         ms │      ms │        ms │         ms │           ms │                us │       MB │          % │
├─────────┼────────────┼─────────┼───────────┼────────────┼──────────────┼───────────────────┼──────────┼────────────┤
│ minimum │       4376 │     392 │       363 │         30 │          359 │                22 │      140 │          9 │
│  median │       4376 │     392 │       363 │         30 │          359 │                22 │      140 │          9 │
│ maximum │       4376 │     392 │       363 │         30 │          359 │                22 │      140 │          9 │
│   stdev │        NaN │     NaN │       NaN │        NaN │          NaN │               NaN │      NaN │        NaN │
└─────────┴────────────┴─────────┴───────────┴────────────┴──────────────┴───────────────────┴──────────┴────────────┘