sunxm2357

sunxm2357's Stars

• BradyFU/Awesome-Multimodal-Large-Language-Models

  :sparkles::sparkles:Latest Advances on Multimodal Large Language Models

  13.1k256127835

• OpenBMB/MiniCPM-V

  MiniCPM-V 2.6: A GPT-4V Level MLLM for Single Image, Multi Image and Video on Your Phone

  Language:Python12.9k107603901

• SimplifyJobs/New-Grad-Positions

  A collection of full time roles in SWE, Quant, and PM for new grads.

  11.8k1.4k3031.1k

• LargeWorldModel/LWM

  Large World Model -- Modeling Text and Video with Millions Context

  Language:Python7.2k6671556

• sgl-project/sglang

  SGLang is a fast serving framework for large language models and vision language models.

  Language:Python6.5k59732578

• EvolvingLMMs-Lab/lmms-eval

  Accelerating the development of large multimodal models (LMMs) with one-click evaluation module - lmms-eval.

  Language:Python2.2k3227168

• deepseek-ai/DeepSeek-VL

  DeepSeek-VL: Towards Real-World Vision-Language Understanding

  Language:Python2.1k2048201

• open-compass/VLMEvalKit

  Open-source evaluation toolkit of large vision-language models (LVLMs), support 160+ VLMs, 50+ benchmarks

  Language:Python1.5k11243209

• Computer-Vision-in-the-Wild/CVinW_Readings

  A collection of papers on the topic of ``Computer Vision in the Wild (CVinW)''

  1.2k38658

• yaodongC/awesome-instruction-dataset

  A collection of open-source dataset to train instruction-following LLMs (ChatGPT,LLaMA,Alpaca)

  1.1k16859

• google-research-datasets/wit

  WIT (Wikipedia-based Image Text) Dataset is a large multimodal multilingual dataset comprising 37M+ image-text sets with 11M+ unique images across 100+ languages.

  1k38741

• LAION-AI/CLIP_benchmark

  CLIP-like model evaluation

  Language:Jupyter Notebook631126580

• allenai/unified-io-2

  Language:Python580161627

• vacancy/SceneGraphParser

  A python toolkit for parsing captions (in natural language) into scene graphs (as symbolic representations).

  Language:Python55871956

• Brave-peng/books

  各类闲书分享（equb版本，ipad可直接打开阅读）

  522211288

• ashafaei/pdf2pptx

  Convert your (Beamer) PDF slides to (Powerpoint) PPTX

  Language:Shell377151088

• AILab-CVC/SEED-Bench

  (CVPR2024)A benchmark for evaluating Multimodal LLMs using multiple-choice questions.

  Language:Python32242913

• prismformore/Multi-Task-Transformer

  Code of ICLR2023 paper "TaskPrompter: Spatial-Channel Multi-Task Prompting for Dense Scene Understanding" and ECCV2022 paper "Inverted Pyramid Multi-task Transformer for Dense Scene Understanding"

  Language:Python30473223

• PengtaoJiang/Awesome-Weakly-Supervised-Semantic-Segmentation-Papers

  Recent weakly supervised semantic segmentation paper

  28111423

• SALT-NLP/LLaVAR

  Code/Data for the paper: "LLaVAR: Enhanced Visual Instruction Tuning for Text-Rich Image Understanding"

  Language:Python25952112

• RLHF-V/RLAIF-V

  RLAIF-V: Aligning MLLMs through Open-Source AI Feedback for Super GPT-4V Trustworthiness

  Language:Python25463010

• vis-nlp/Chart-to-text

  Language:OpenEdge ABL10621332

• Mrhuangyi/Ebooks-Shared

  :book: Ebook share

  Language:C++512019

• yuecao0119/MMInstruct

  The official implementation of the paper "MMInstruct: A High-Quality Multi-Modal Instruction Tuning Dataset with Extensive Diversity". The MMInstruct dataset includes 973K instructions from 24 domains and four instruction types.

  Language:Python36522

• opendatalab/image-downloader

  Language:Python27423

• ROCm/xformers

  Hackable and optimized Transformers building blocks, supporting a composable construction.

  Language:Python22596

• sirluk/llm_finetuning

  Language:Jupyter Notebook12204

• sunxm2357/DIME-FM

  Implementation of "DIME-FM: DIstilling Multimodal and Efficient Foundation Models"

  Language:Python12140

• Zhongping-Zhang/MGT_Localization

  Implementation for Machine-Generated Text Localization (ACL 2024 Findings)

  Language:Python10300

• piotr-teterwak/open_clip

  An open source implementation of CLIP.

  Language:Jupyter Notebook1001