CodeGPT - LLM Client

A user-friendly Java HTTP client, providing access to the large language model (LLM) APIs and services.

Installation

To use the package, you need to use following Maven dependency:

<dependency>
    <groupId>ee.carlrobert</groupId>
    <artifactId>llm-client</artifactId>
    <version>0.8.11</version>
</dependency>

Gradle dependency:

dependencies {
  implementation("ee.carlrobert:llm-client:0.8.11")
}

Usage

Chat Completion SSE

OpenAIClient client = new OpenAIClient.Builder(System.getenv("OPENAI_API_KEY"))
    .setOrganization("MY_ORGANIZATION")
    .build();

EventSource call = client.getChatCompletionAsync(
    new OpenAIChatCompletionRequest.Builder(List.of(new OpenAIChatCompletionStandardMessage("user", prompt)))
        .setModel(OpenAIChatCompletionModel.GPT_4)
        .setTemperature(0.1)
        .build(),
    new CompletionEventListener<String>(){
      @Override
      public void onMessage(String message, EventSource eventSource) {
        System.out.println(message);
      }
    });

call.cancel();

Contributing

Contributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are greatly appreciated.

If you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag "enhancement".

Fork the Project
Create your Feature Branch (git checkout -b feature/AmazingFeature)
Commit your Changes (git commit -m 'Add some AmazingFeature')
Push to the Branch (git push origin feature/AmazingFeature)
Open a Pull Request

License