FMInference/FlexLLMGen

Where is the chatbot? I miss it!

Closed this issue · 7 comments

Why delete it?

Agreed. They also deleted all the readme instructions for some reason.

It's not too good to remove all instructions from the README and example files, while not adding docs. This is extremely confusing for beginners and generally complicates the understanding of the library.

Add another request to bring the chatbot back, and if possible get it to be able to handle multiple line responses.

Also is it able to use 2 GPUs with FlexGen and how?

Perhaps they removed it for fear of abuse.

Perhaps they removed it for fear of abuse.

It is unlikely, since there was just an input by the type of Person: Bot:, nothing special.
And to think about the abuse of this library is slightly stupid, just as it is possible for the same reasons, for example, to prohibit the use of Google Colab.