[Feature request] Add nllb support

Question

bil-ash opened this issue 10 months ago · 4 comments

Please add nllb inference support. This(gguf inference for nllb) is already implemented elsewhere (acording to the documentation at https://github.com/facebookresearch/seamless_communication/tree/main/ggml#t2tt )and so I guess will not require too much effort

Answer 1 · 2024-02-04T07:11:14.000Z

@bil-ash Hi~Thanks for your issue. We have noticed this model.

We'll take it into account in our plan. Thanks again.

Answer 2 · 2024-02-04T12:24:44.000Z

Fine,looking forward to the support for nllb

Answer 3 · 2024-02-05T08:19:41.000Z

Thank you.

I closed this issue. I'll let you know if we enable the NLLB model.

Answer 4 · 2024-03-19T14:51:43.000Z

Commenting on this issue to request for supporting nllb before the next release on pypi(most probable v0.4)