PAIR-code/lit

Keep one model in memory at any given time

Opened this issue · 0 comments

Would it be possible to clean up memory usage when switching models? Right now it appears all models listed as options get loaded into memory.

Ideally LIT would not necessarily load on class instantiation (not on init) and would unload the model when switching to another (del model?)