ROCm/TransformerEngine

Issues

• [Build Issue]: Error: setup script specifies an absolute path:

  #102 opened 2 days ago
  3

• [Build issue]: Building wheel for specific arch not supported without GPU but with all ROCm components installed

  #92 opened 2 months ago
  2

• [Out of Box Experience]: ROCm Transformer Engine Should Be Included in AMD Pytorch Images

  #82 opened 3 months ago
  2

• [FSDP 8xMI300X] Llama3 8B FP8 is 21% slower than BF16 & OOMs on the same batch size

  #79 opened 3 months ago
  6

• [FSDP 8xMI300X]: LLama3 70B 4 Layer Proxy Model GPU Core Dumps

  #78 opened 3 months ago
  24

• [DDP 8xMI300X] GPT2-1.5B FP8 is 25% slower than BF16 & OOMs on the same batch size

  #76 opened 3 months ago
  3

• [Issue]: MI300X fused_attn CK Backend Broken HIP runtime error: invalid device function 3rdparty/composable_kernel/include/ck_tile/host/hip_check_error.hpp: 18in function: hip_check_error

  #74 opened 2 months ago
  10

• MI300X FP8 TE.Linear 2x Slower than AMP BF16 F.Linear

  #73 opened 3 months ago
  14

• [1xMI300X] GPT-2 XL 1.5B FP8 Training ~30% slower than H100 FP8

  #72 opened 3 months ago
  22

• [Issue]: ROCm TE Installation Error: no member named 'getCurrentHIPStreamMasqueradingAsCUDA' in namespace 'c10::hip'

  #71 opened 3 months ago
  3

• [Issue]: install TransformerEngine error, cannot reach llvm tar file

  #50 opened 3 months ago
  2

• [TE] Investigate parallelism implementation in Transformer Engine

  #34 opened 9 months ago
  1

• F8: Interop investigation considering G's discussion and feedback

  #6 opened a year ago
  0