Is it possible to add support for other models?

[wlll123456]

Hi, this is great work. I found under /Atom/model/main.py file that it seems to only support llama, opt, mixtral models. If I need to add support for Qwen model, which files should I change?

[happierpig]

Hi @wlll123456 ,

Thanks for your interest! Sure it is possible to add support for models with human efforts. Basically, you need to add wrapper functions corresponding to the model architecture. You can follow this commit(7dafad0) where we add support for Mixtral models.