Display workload balance using d3 js
How I saved hundreds of hours of computing time by workload balance between shards.
Before balancing the workload it was a normal splitting of the number of tasks between shards. But without taking into consideration the execution time for every task, shards will be unbalanced and very often will happen that a shard will finish the work and wait and do nothing when other shards still doing the work.
If we take into consideration the execution time for each task we can achieve a perfect balance of workload between shards.