xikaluo

Pinned Repositories

• Megatron-LLaMA

  Best practice for training LLaMA models in Megatron-LM

  Language:Python56865849

• Pai-Megatron-Patch

  The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.

  Language:Python53577771

• GaLore

  GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection

  Language:Python1.2k1743131

• Megatron-DeepSpeed

  Ongoing research training transformer language models at scale, including: BERT & GPT-2

  Language:Python1.7k24169329

• TensorRT-LLM

  TensorRT-LLM provides users with an easy-to-use Python API to define Large Language Models (LLMs) and build TensorRT engines that contain state-of-the-art optimizations to perform inference efficiently on NVIDIA GPUs. TensorRT-LLM also contains components to create Python and C++ runtimes that execute those TensorRT engines.

  Language:C++7.3k841.5k794

• nuggets

  Language:Jupyter Notebook55180

• Qwen-TensorRT-LLM

  Language:Python530611448

xikaluo's Repositories