ustcfd

ustcfd's Stars

• BlinkDL/RWKV-LM

  RWKV is an RNN with transformer-level LLM performance. It can be directly trained like a GPT (parallelizable). So it's combining the best of RNN and transformer - great performance, fast inference, saves VRAM, fast training, "infinite" ctx_len, and free sentence embedding.

  Language:Python12.6k134216858

• 01-ai/Yi

  A series of large language models trained from scratch by developers @01-ai

  Language:Jupyter Notebook7.7k106290475

• deepseek-ai/DeepSeek-VL

  DeepSeek-VL: Towards Real-World Vision-Language Understanding

  Language:Python2.1k1946193

• microsoft/DeepSpeed-MII

  MII makes low-latency and high-throughput inference possible, powered by DeepSpeed.

  Language:Python1.9k41304176

• Yuliang-Liu/Monkey

  【CVPR 2024 Highlight】Monkey (LMM): Image Resolution and Text Label Are Important Things for Large Multi-modal Models

  Language:Python1.8k22136128

• ytongbai/LVM

  Language:Python1.8k1202254

• KimMeen/Time-LLM

  [ICLR 2024] Official implementation of " 🦙 Time-LLM: Time Series Forecasting by Reprogramming Large Language Models"

  Language:Python1.4k16150243

• ActiveVisionLab/Awesome-LLM-3D

  Awesome-LLM-3D: a curated list of Multi-modal Large Language Model in 3D world Resources

  1.2k44780

• stanfordnlp/pyreft

  ReFT: Representation Finetuning for Language Models

  Language:Python1.1k1690100

• eric-ai-lab/MiniGPT-5

  Official implementation of paper "MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens"

  Language:Python851124452

• haoliuhl/ringattention

  Transformers with Arbitrarily Large Context

  Language:Python63161750

• google-deepmind/recurrentgemma

  Open weights language model from Google DeepMind, based on Griffin.

  Language:Python60618726

• NVIDIA/NeMo-Aligner

  Scalable toolkit for efficient model alignment

  Language:Python594187671

• sail-sg/lorahub

  [COLM 2024] LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition

  Language:Python583112235

• csuhan/OneLLM

  [CVPR 2024] OneLLM: One Framework to Align All Modalities with Language

  Language:Python579112732

• Leeroo-AI/mergoo

  A library for easily merging multiple LLM experts, and efficiently train the merged LLM.

  Language:Python40041325

• thunlp/LLaVA-UHD

  LLaVA-UHD: an LMM Perceiving Any Aspect Ratio and High-Resolution Images

  Language:Python315142615

• GraphPKU/PiSSA

  PiSSA: Principal Singular Values and Singular Vectors Adaptation of Large Language Models(NeurIPS 2024 Spotlight)

  Language:Jupyter Notebook2604239

• FusionBrainLab/OmniFusion

  OmniFusion — a multimodal model to communicate using text and images

  Language:Python2295423

• yfeng95/PoseGPT

  Language:Python21437813

• LingyvKong/OneChart

  [ACM'MM 2024 Oral] Official code for "OneChart: Purify the Chart Structural Extraction via One Auxiliary Token"

  Language:Python19011915

• YuchenLiu98/COMM

  Pytorch code for paper From CLIP to DINO: Visual Encoders Shout in Multi-modal Large Language Models

  1862055

• zamling/PSALM

  [ECCV2024] This is an official implementation for "PSALM: Pixelwise SegmentAtion with Large Multi-Modal Model"

  Language:Python1867219

• HuggingAGI/HuggingArxiv

  1859123

• taishan1994/Llama3.1-Finetuning

  对llama3进行全参微调、lora微调以及qlora微调。

  Language:Python1433814

• uukuguy/multi_loras

  Load multiple LoRA modules simultaneously and automatically switch the appropriate combination of LoRA modules to generate the best answer based on user queries.

  Language:Python141649

• Ivan-Tang-3D/Any2Point

  [ECCV2024] Any2Point: Empowering Any-modality Large Models for Efficient 3D Understanding

  Language:Python101336

• BAAI-DCAI/DataOptim

  A collection of visual instruction tuning datasets.

  Language:Python76503

• Suikasxt/PMG

  The repository of paper Personalized Multimodal Response Generation with Large Language Models

  Language:Python110

• AdityaNG/DriveLLaVA

  Training LLaVA on the CommaVQ dataset to produce tokenized control signals for driving

  Language:Jupyter Notebook4201