intel-analytics/bigdl-llm-tutorial

Accelerate LLM with low-bit (FP4 / INT4 / FP8 / INT8) optimizations using bigdl-llm

BigDL-LLM Tutorial

English | 中文

BigDL-LLM is a low-bit LLM library on Intel XPU (Xeon/Core/Flex/Arc/PVC). This repository contains tutorials to help you understand what is BigDL-LLM and how to use BigDL-LLM to build LLM applications.

The tutorials are organized as follows:

• Chapter 1 Introduction introduces what is BigDL-LLM and what you can do with it.
• Chapter 2 Environment Setup provides a set of best practices for setting-up your environment.
• Chapter 3 Application Development: Basics introduces the basic usage of BigDL-LLM and how to build a very simple Chat application.
• Chapter 4 Chinese Support shows the usage of some LLMs which suppports Chinese input/output, e.g. ChatGLM2, Baichuan
• Chapter 5 Application Development: Intermediate introduces intermediate-level knowledge for application development using BigDL-LLM, e.g. How to build a more sophisticated Chatbot, Speech recoginition, etc.
• Chapter 6 GPU Acceleration introduces how to use Intel GPU to accelerate LLMs using BigDL-LLM.
• Chapter 7 Finetune introduces how to do Finetune using BigDL-LLM.
• Chapter 8 Application Development: Advanced introduces advanced-level knowledge for application development using BigDL-LLM, e.g. langchain usage.