/spring-ai-alibaba

An Application Framework for Java Developers

Primary LanguageJavaScriptApache License 2.0Apache-2.0

Spring AI Alibaba

中文版本

An AI application framework for Java developers built on top of Spring AI that provides seamless integration with Alibaba Cloud QWen LLM services and cloud-native infrastructures.

Get Started

Please refer to quick start for how to quickly add generative AI to your Spring Boot applications.

Overall, it takes only two steps to turn your Spring Boot application into an intelligent agent:

  1. Add 'spring-ai-alibaba-starter' dependency to your project.
<dependency>
	<groupId>com.alibaba.ai</groupId>
	<artifactId>spring-ai-alibaba-starter</artifactId>
	<version>1.0.0-M2</version>
</dependency>
  1. Inject the default 'ChatClient' Bean to regular Controller beans.
@RestController
public class ChatController {

	private final ChatClient chatClient;

	public ChatController(ChatClient.Builder builder) {
		this.chatClient = builder.build();
	}

	@GetMapping("/chat")
	public String chat(String input) {
		return this.chatClient.prompt()
				.user(input)
				.call()
				.content();
	}
}

Examples

More examples can be found at spring-ai-alibaba-examples.

  • Hello World
  • Chat Model
  • Function Calling
  • Structured Output
  • Prompt
  • RAG
  • Flight Booking Playground, an advanced example showcasing usage of prompt template, function calling, chat memory and rag at the same time.

Core Features

Spring AI Alibaba provides the following features, read the documentation on our website for more details of how to use these features.

  • Support for Alibaba Cloud QWen Model and Dashscope Model service.
  • Support high-level AI agent abstraction -- ChatClient.
  • Support various Model types like Chat, Text to Image, Audio Transcription, Text to Speech.
  • Both synchronous and stream API options are supported.
  • Mapping of AI Model output to POJOs.
  • Portable API across Vector Store providers.
  • Function calling.
  • Spring Boot Auto Configuration and Starters.
  • RAG (Retrieval-Augmented Generation) support: DocumentReader, Splitter, Embedding, VectorStore, and Retriever.
  • Support conversation with ChatMemory

Roadmap

Spring AI Alibaba aims to reduce the complexity of building ai native java applications, from development, evaluation to deployment and observability. In order to achieve that, we provide both open-source framework and ecosystem integrations around it, below are the features that we plan to support in the near future:

  • Prompt Template Management
  • Event Driven AI Application
  • Support of more Vector Databases
  • Function Deployment
  • Observability
  • AI proxy support: prompt filtering, rate limit, multiple Model, etc.
  • Development Tools

ai-native-architecture

References

Contact Us

  • Dingtalk Group (钉钉群), search 64485010179 and join.
  • Wechat Group (微信公众号), scan the QR code below and follow us.