pytorch/ao

torchao release compatibility table

vkuzo opened this issue · 6 comments

vkuzo commented

This issue describes the compatibility matrix between torchao releases and its dependencies. If you are seeing an error when importing torchao that looks like this,

(pytorch_nightly) [vasiliy@devgpu007.eag6 ~/local]$ python -c "import torchao"
Fatal Python error: Aborted

then most likely you can resolve this error by ensuring that the torch version in your environment is compatible with the torch version used to build your torchao version.

torch

torchao version torch version torch version, torchao's Python API only
0.14.x (nightly) 2.9.0 (nightly) 2.9.0 (fix needed to relax this)
0.13.0 2.8.0 2.8.0, 2.7.1, 2.6.0
0.12.0 2.7.1, 2.6.0, 2.5.0 n/a

fbgemm_gpu

torchao has an optional runtime dependency on fbgemm_gpu. Please see https://docs.pytorch.org/FBGEMM/general/Releases.html for the compatibility matrix for fbgemm_gpu. Note that while torchao's Python API supports multiple torch versions, each fbgemm_gpu version only supports a single torch version. Therefore, if you are using torchao together with fbgemm_gpu, you should use the torch version corresponding to your fbgemm_gpu version.

jerryzh168 commented

any ideas when we can fix the compatibility of torchao nightly with torch? currently it's blocking tests in vllm: https://github.com/vllm-project/vllm/pull/21982/files#diff-2fe466060a88bb6a57175df8ca7175849db82a2cf2ba082295d481ab57e58868R512

yushangdi commented

I'm also having the same issue here. Blocking testing executorch with torch nightly.

I have torch on latest master (with some python-only local changes) '2.9.0a0+git3564a8a', and torchao torchao-0.14.0.dev20250909+cu126.

  • 👍1
yushangdi commented

I'm also having the same issue here. Blocking testing executorch with torch nightly.

I have torch on latest master (with some python-only local changes) '2.9.0a0+git3564a8a', and torchao torchao-0.14.0.dev20250909+cu126.

I have it resolved by installing pip install fbgemm-gpu-nightly to override fbgemm-gpu. So far importing torchao doesn't error anymore. Not sure if there're any other issues if I actually run anything.

jerryzh168 commented

executorch doesn't need fbgem-gpu I think? if you use torchao nightly, can you also use torch nightly in ET?

vkuzo commented

we also need to update the following check https://github.com/pytorch/ao/blob/ea8c00fc90c99f0bf19fe87d22eb186c3dd19bf6/torchao/__init__.py#L38C45-L38C76 for PyTorch 2.10.x, as str(torch.__version__) >= "2.9" will not work properly for PyTorch 2.10