Using Medusa with Whisper

Question

Using Medusa with Whisper

AvivSham opened this issue 8 months ago · 5 comments

Hi All,
Thank you for your awesome work!
Is it possible to integrate Medusa into Whisper's Decoder enhancing the decoding speed?
Do you have any plans supporting Whisper?

Thanks in advance.

eldadcohen1 commented 8 months ago

+1

AvivSham commented 7 months ago

^^

AvivNavon commented 7 months ago

+1

Answer 1 · 2024-06-03T09:22:00.000Z

@ctlllll @leeyeehoo
Can you please help with this?

Answer 2 · 2024-06-16T08:52:29.000Z

@tridao Can you please help with this?