Discard too old buffers
shirayu opened this issue · 1 comments
shirayu commented
Currently, the buffer_tokens and buffer_mel is being used again in a later process.
However, when they become too large, the processing will take too long and exhaust VRAM.
Therefore, it is necessary to discard old buffers in them at the appropriate time.
shirayu commented
--condition_on_previous_text is added in the original Whisper
That is related to here.