cheney369

Pinned Repositories

• LLaMA-Factory

  Efficiently Fine-Tune 100+ LLMs in WebUI (ACL 2024)

  Language:Python30.6k1954.8k3.8k

• Llama-Chinese

  Llama中文社区，Llama3在线体验和微调模型已开放，实时汇总最新Llama3学习资料，已将所有代码更新适配Llama3，构建最好的中文Llama大模型，完全开源可商用

  Language:Python13.6k1463321.2k

• TensorRT-LLM

  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

  Language:C++8.1k871.8k897

• lorax

  Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

  Language:Python2.1k34231138

• vllm

  A high-throughput and memory-efficient inference and serving engine for LLMs

  Language:Python26.4k2234.4k3.9k

• Chinese-LLaMA-Alpaca-2

  中文LLaMA-2 & Alpaca-2大模型二期项目 + 64K超长上下文模型 (Chinese LLaMA-2 & Alpaca-2 LLMs with 64K long context models)

  Language:Python7k78388577

• lightltp

  基于 onnxruntime 推理引擎的中文 ltp 词法分析

  Language:Python13233

cheney369's Repositories