LLM Integration: implement Claude 2.0 in `models.py`

Question

LLM Integration: implement Claude 2.0 in `models.py`

kaustubh-cf opened this issue a year ago · 8 comments

What do we need?

If you go to the textbase/models.py, there exists classes for various models like OpenAI (GPT3.5/4), Dalle-2, Huggingface inference API etc that can be used for various tasks from text generation to chatbots and many more.

Claude 2.0 is another such promising LLM that we would very much like to integrate in textbase.

Just make another class in there like:

class Claude:
    def generate():
        pass

You can refer to the Python Client SDK mentioned in the documentation. Keep in mind that you might have to restructure the response in the format that textbase accepts. 👉🏻 Reference

Refer to the code in models.py, play around with it after setting things up locally.

After implementing the model, import that and test it by making a main.py, just like the one for OpenAI.
Reference -> docs.textbase.ai

Docs

After writing the code make sure you update the corresponding docs as well in here.
Create a file named claude-bot.md and add relevant information there.

Let us know if you face any issues!

Answer 1 · 2023-09-28T20:28:28.000Z

hey @kaus-cofactory , I want to work on this issue. Can you please assign this to me.

Answer 2 · 2023-09-29T06:04:57.000Z

Hi @morgoth9808 Yes, please go ahead with it!

Answer 3 · 2023-09-29T09:26:13.000Z

Hey @kaus-cofactory I cannot create an api key for testing Claude 2.0. It is saying that I have to apply for the early access. Is there any workaround for that.

Answer 4 · 2023-09-29T10:12:46.000Z

@morgoth9808 I'm afraid Claude is available only in the US and UK as of now. So it might be not possible to do this from your side. Although if you want to implement the tentative code, the internal team can then check it with an API key that we might get access to.

If not I'll be adding other issues, you can have a look at them 🙌🏻

Answer 5 · 2023-09-29T12:31:41.000Z

Thanks for the update @kaus-cofactory , I am implementing the tentative code.

Answer 6 · 2023-09-29T16:36:01.000Z

Hey @kaus-cofactory so I tried writing the code but I cannot test without an api key and I can't access Claude2 here in India. So I am exploring different projects now . Anyway thank you for assigning this issue to me , really learned a lot from this project.

Answer 7 · 2023-09-29T18:10:30.000Z

No worries @morgoth9808, this would be taken up by someone from the internal team probably. Thanks!

Over the course of Hacktoberfest we'll be adding a number of different issues. Feel free to have a look at the issues section anytime!

Answer 8 · 2023-11-22T20:07:46.000Z

Hello project Maintainer I have tried to add the Claude api in the models the only issue I faced while development that I ddint have the api key for running purpose because it is not accesible But I have added the code you can review it. If you want can I push this code.? Give me as a assignee here