llm-chain is a collection of Rust crates designed to help you work with Large Language Models (LLMs) more effectively. Our primary focus is on providing robust support for prompt templates and chaining together prompts in multi-step chains, enabling complex tasks that LLMs can't handle in a single step. This includes, but is not limited to, summarizing lengthy texts or performing advanced data processing tasks.
To help you get started, here is an example demonstrating how to use llm-chain. You can find more examples in the examples folder in the repository.
let exec = Executor::new_default();
let chain = Step::new(
Model::ChatGPT3_5Turbo,
[
(Role::System, "You are a bot for making personalized greetings"),
(Role::User, "Make a personalized greet for Joe"),
]
).to_chain();
let res = chain.run(Parameters::new(), exec).await.unwrap();
println!("{:?}", res);- Prompt templates: Create reusable and easily customizable prompt templates for consistent and structured interactions with LLMs.
- Chains: Build powerful chains of prompts that allow you to execute more complex tasks, step by step, leveraging the full potential of LLMs.
- ChatGPT support: Supports ChatGPT models, with plans to add OpenAI's other models in the future.
- LLaMa support: Provides seamless integration with LLaMa models, enabling natural language understanding and generation tasks with Facebook's research models.
- Alpaca support: Incorporates support for Stanford's Alpaca models, expanding the range of available language models for advanced AI applications.
- Tools: Enhance your AI agents' capabilities by giving them access to various tools, such as running Bash commands, executing Python scripts, or performing web searches, enabling more complex and powerful interactions.
- Extensibility: Designed with extensibility in mind, making it easy to integrate additional LLMs as the ecosystem grows.
- Community-driven: We welcome and encourage contributions from the community to help improve and expand the capabilities of
llm-chain.
To start using llm-chain, add it as a dependency in your Cargo.toml:
[dependencies]
llm-chain = "0.1.0"
llm-chain-openai = "0.1.0Then, refer to the documentation and examples to learn how to create prompt templates, chains, and more.
We warmly welcome contributions from everyone! If you're interested in helping improve llm-chain, please check out our CONTRIBUTING.md file for guidelines and best practices.
llm-chain is licensed under the MIT License.
If you have any questions, suggestions, or feedback, feel free to open an issue or join our community discussions. We're always excited to hear from our users and learn about your experiences with llm-chain.
We hope you enjoy using llm-chain to unlock the full potential of Large Language Models in your projects. Happy coding! 🎉