FMInference/FlexLLMGen

May i ask why the model is hard coded as "facebook/opt-30b"?

AISuperMa opened this issue 2 years ago · 1 comments

AISuperMa commented 2 years ago

https://github.com/FMInference/FlexGen/blob/25438f6bc3507e1fbd6f88e4812beb2a102d7315/flexgen/flex_opt.py#L1162

merrymercy commented 2 years ago

I think all OPT models share the same tokenizer.