facebookresearch/HolisticTraceAnalysis

[Question] Can HTA work on other trace files (not generated by pytorch) too?

Opened this issue · 1 comments

What is your question?

I really liked the HTA and the data it generates is quite useful. I think same analysis can be useful for other cases as well hence I was wondering if trace generated for other workloads such as OpenVINO or pure MPI applications which are not using pytorch but using GPU can be analyzed using HTA.

It will be great if HTA can provide unified parser which can analyze files having predefined formats. For example prefetto.ui which can parse prefetto formats hence any file written in prefetto format can be parsed and visualized by the tool.

Code

No response

What have you tried?

No response

Environment

No response

@Sarbojit2019 in principle we should be able to parse other traces. Currently the parser only works on chrome trace format (thought that can be improved).
If we chrome traces from non PyTorch frameworks it could still work. Note that most of the analysis has some in-built assumptions on pytorch profiler or use of NVIDIA CUDA, this means many analysis may not work out-of-box and need generalization.