msr-fiddle/pipedream

"stage_to_depth_map" not found

Closed this issue · 2 comments

Hi! I think I found a problem.

With this script (convert_graph_to_model.py) , we can get the configuration file (vgg16.gpus=16.hybrid_conf.json). But I didn't find the field "stage_to_depth_map" in the script(convert_graph_to_model.py). This field appears in vgg16.gpus=16.hybrid_conf.json.
{ "module_to_stage_map": [0, 1, 1], "stage_to_rank_map": { "0": [0, 1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14], "1": [15] }, "stage_to_depth_map": { "0": 1, "1": 0 } }
I don't know how this field appears.

After checking the code, we found that without this field, there would be no impact

stage_to_depth_map is an optional field. It's meant to override default logic we have to compute the number of warmup minibatches in each stage: https://github.com/msr-fiddle/pipedream/blob/master/runtime/runtime.py#L166.