ROCm/Tensile

[Question] | How to generate config YAMLs for GridBased tensile tuning?

Closed this issue · 2 comments

rtmadduri commented

Hello Team,

We are trying to do Gridbased Tensile tuning for a project and we are following the instructions highlighted over here , however, it seems like the config generator only generate YAML files that correspond to Equality tuning. Are there special instructions to generate GridBased tuning YAML files?

Additionally, I went through a few config files mentioned in your repo. Can you help me understand what is the difference between Exact and Range? Is that the primary differentiator between Equality and Grid?

cc: @itej89, @feifei14119

ppanchad-amd commented

Hi @rtmadduri. Internal ticket has been created to assist with your issue. Thanks!

zichguan-amd commented

Hi @rtmadduri, Equality and GridBased are different searching methods for kernel selection. Equality is better because the library has the actual GEMM size kernel tuned, and if the library does not have the exact kernel size, it will fall back to GridBased and chose a kernel that is close to the GEMM size. The generated kernel YAML files is found based on this rule. The YAML files found in hipBLASLt are the ones that are tuned and used in the search process of Tensile.

Additionally, I went through a few config files mentioned in your repo. Can you help me understand what is the difference between Exact and Range? Is that the primary differentiator between Equality and Grid?

The difference between Exact and Range can be found here. Range specifies a range of sizes to benchmark while Exact specifies the exact size to benchmark.