/semantic-kernel-LLamaSharp

Custom TextCompletion using LLamaSharp

Primary LanguageC#MIT LicenseMIT

⚠️The implementation of this project has been migrated to the LlamaSharp repository, and maintenance will be continued there in the future.

semantic-kernel-LLamaSharp

Using LLamaSharp to implement custom TextCompletion and EmbeddingGeneration of Semantic Kernel

Basic Usage

  1. Clone this repository.
  2. Download a llama model. If you don't know which model is available, please refer to LLamaSharp Verified Models.
  3. Modify the path of model and prompt file in samples/SK_LLamaSharpWebApi/appsettings.json.
  4. Change the backend type if you want to, by modifying SK_LLamaSharpWebApi.csproj and Directory.Packages.props.
  5. Run the sample. It's recommended to run with release mode or x64 configuration.
  6. Send the request to the web api to test.