xenova/transformers.js

How to unload/destroy a pipeline?

Closed this issue · 2 comments

Question

I tried to find how to unload a pipeline to free up memory in the documentation, but couldn't find a mention of how to do that properly.

If there a proper way to "unload" a pipeline?

I'd be happy to add the answer to the documentation.

Hi there 👋 You can use pipeline.dispose(), which returns a promise that resolves when the pipeline has been disposed (see here). However, I definitely agree this should be documented and handled better... Let me know if you have any ideas!

Is there a way to edit the documentation