AutoGPTQ/AutoGPTQ

[BUG] Marlin/AWQ cache collision + Marlin device validation returns false for Ada/Hopper

Closed this issue · 0 comments

Qubitium commented

This is a placeholder issue so bug can be tracked to PR for user searches.

Bugs:

  1. Marlin/AWQ code paths shared the same cache file name causing toggling the two modes to fail as one would wrongly reuse the cache from another.

  2. Marlin device check is too strict and returns false for Ada/Hopper.

Fixed in PR #603