ustcfd

ustcfd's Stars

• kq-chen/VLMEvalKit

  Open-source evaluation toolkit of large vision-language models (LVLMs), support ~100 VLMs, 30+ benchmarks

  1

• BradyFU/Awesome-Multimodal-Large-Language-Models

  :sparkles::sparkles:Latest Advances on Multimodal Large Language Models

  11.4k743

• LLaVA-VL/LLaVA-NeXT

  Language:Python2.2k150

• Pints-AI/1.5-Pints

  A compact LLM pretrained in 9 days by using high quality data

  Language:Python17313

• TUDB-Labs/MixLoRA

  State-of-the-art Parameter-Efficient MoE Fine-tuning Method

  Language:Python467

• VT-NLP/MixLoRA

  Multimodal Instruction Tuning with Conditional Mixture of LoRA (ACL 2024)

  Language:Python5

• OpenGVLab/VisionLLM

  VisionLLM Series

  Language:Python82117

• TinyLLaVA/TinyLLaVA_Factory

  A Framework of Small-scale Large Multimodal Models

  Language:Python54952

• zjysteven/lmms-finetune

  A minimal codebase for finetuning large multimodal models, supporting llava-1.5/1.6, llava-interleave, llava-next-video, qwen-vl, phi3-v etc.

  Language:Python1076

• maxin-cn/Cinemo

  Cinemo: Consistent and Controllable Image Animation with Motion Diffusion Models

  Language:Python20117

• kevin-meng/HuggingfaceDownloadShare

  **如何下载huggingface 模型并共享链接

  Language:Jupyter Notebook506

• AIDC-AI/Ovis

  A novel Multimodal Large Language Model (MLLM) architecture, designed to structurally align visual and textual embeddings.

  Language:Python982

• Outsider565/LoRA-GA

  Language:Python1105

• mst272/simple-lora-plus

  A simple implementation of LoRA+: Efficient Low Rank Adaptation of Large Models

  Language:Python61

• GaiZhenbiao/Phi3V-Finetuning

  Parameter-efficient finetuning script for Phi-3-vision, the strong multimodal language model by Microsoft.

  Language:Python4812

• pjlab-sys4nlp/llama-moe

  ⛷️ LLaMA-MoE: Building Mixture-of-Experts from LLaMA with Continual Pre-training

  Language:Python83344

• om-ai-lab/OmAgent

  A multimodal agent framework for solving complex tasks

  Language:Python30919

• HJYao00/DenseConnector

  Dense Connector for MLLMs

  Language:Python953

• kyegomez/awesome-multi-agent-papers

  A compilation of the best multi-agent papers

  1509

• CircleRadon/TokenPacker

  The code for "TokenPacker: Efficient Visual Projector for Multimodal LLM".

  Language:Python1415

• LprG6WVR0e/MeteoRA

  Code for paper: "MeteoRA: Multiple-tasks Embedded LoRA for Large Language Models"

  Language:Python2

• lxtGH/OMG-Seg

  OMG-LLaVA and OMG-Seg codebase

  Language:Python1.2k47

• Tencent/MimicMotion

  High-Quality Human Motion Video Generation with Confidence-aware Pose Guidance

  Language:Python1.5k115

• TMElyralab/MuseTalk

  MuseTalk: Real-Time High Quality Lip Synchorization with Latent Space Inpainting

  Language:Python2.3k284

• Kedreamix/Linly-Talker

  Digital Avatar Conversational System - Linly-Talker. 😄✨ Linly-Talker is an intelligent AI system that combines large language models (LLMs) with visual models to create a novel human-AI interaction method. 🤝🤖 It integrates various technologies like Whisper, Linly, Microsoft Speech Services, and SadTalker talking head generation system. 🌟🔬

  Language:Python1.7k283

• PhoenixZ810/MG-LLaVA

  Official repository for paper MG-LLaVA: Towards Multi-Granularity Visual Instruction Tuning(https://arxiv.org/abs/2406.17770).

  Language:Python1344

• cambrian-mllm/cambrian

  Cambrian-1 is a family of multimodal LLMs with a vision-centric design.

  Language:Python1.7k106

• PeterH0323/Streamer-Sales

  Streamer-Sales 销冠 —— 卖货主播 LLM 大模型🛒🎁，一个能够根据给定的商品特点从激发用户购买意愿角度出发进行商品解说的卖货主播大模型。🚀⭐内含详细的数据生成流程❗ 📦另外还集成了 LMDeploy 加速推理🚀、RAG检索增强生成 📚、TTS文字转语音🔊、数字人生成 🦸、 Agent 使用网络查询实时信息🌐、ASR 语音转文字🎙️

  Language:Python2.2k322

• pprp/Awesome-LLM-Quantization

  Awesome list for LLM quantization

  Language:Python704

• TencentARC/Open-MAGVIT2

  Open-MAGVIT2: Democratizing Autoregressive Visual Generation

  Language:Python38410