updated medusa models in huggingface?
Opened this issue · 0 comments
hustxiayang commented
Hi, based on https://github.com/FasterDecoding/Medusa/blob/main/notebooks/medusa_introduction.ipynb, "FasterDecoding/medusa-vicuna-7b-v1.3" should have 4 medusa_num_heads. However, in huggingface, it only has 2, https://huggingface.co/FasterDecoding/medusa-vicuna-7b-v1.3/blob/main/config.json. Do you have any plan to share the trained medusa-heads in huggingface?