How to plot timeline with the label added by torch.profiler.record_function?

[zhouyiyuan-mt]

What is your question?

I want to plot the timeline of training GPT with pipeline parallelism. I use torch.profiler.record_function to label some functions , such as forward_step and backward_step of each micro_batch. I want to plot these functions for all ranks into one image, how can I do it? If using the example code (https://github.com/facebookresearch/HolisticTraceAnalysis/blob/main/examples/plot_timeline.ipynb), I get an image with kernels rather than record_function.

[starstream]

same question

[GuWei007]

same question