Language Technology Lab at Alibaba DAMO Academy

Singapore

Pinned Repositories

CoI-Agent
Official code for paper: Chain of Ideas: Revolutionizing Research via Novel Idea Development with LLM Agents
Language:Python444 4 1228
DAMO-SeaLLMs
[ACL 2024 Demo] SeaLLMs - Large Language Models for Southeast Asia
Language:JavaScript161 14 1216
Inf-CLIP
[CVPR 2025] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A super memory-efficiency CLIP training scheme.
Language:Python237 5 411
LLM-Zoo
LLM Zoo collects information of various open- and close-sourced LLMs
272 9 013
multimodal_textbook
The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"
Language:Python146 6 316
VCD
[CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding
Language:Python255 6 3014
Video-LLaMA
[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
Language:Python3k 33 159270
VideoLLaMA2
VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
Language:Python1.1k 10 14374
VideoLLaMA3
Frontier Multimodal Foundation Models for Image and Video Understanding
Language:Jupyter Notebook656 10 5643
VideoRefer
[CVPR 2025] The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"
Language:Python174 8 58

Language Technology Lab at Alibaba DAMO Academy's Repositories

DAMO-NLP-SG/Video-LLaMA
[EMNLP 2023 Demo] Video-LLaMA: An Instruction-tuned Audio-Visual Language Model for Video Understanding
Language:Python3k 33 159270
DAMO-NLP-SG/VideoLLaMA2
VideoLLaMA 2: Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs
Language:Python1.1k 10 14374
DAMO-NLP-SG/VideoLLaMA3
Frontier Multimodal Foundation Models for Image and Video Understanding
Language:Jupyter Notebook656 10 5643
DAMO-NLP-SG/CoI-Agent
Official code for paper: Chain of Ideas: Revolutionizing Research via Novel Idea Development with LLM Agents
Language:Python444 4 1228
DAMO-NLP-SG/VCD
[CVPR 2024 Highlight] Mitigating Object Hallucinations in Large Vision-Language Models through Visual Contrastive Decoding
Language:Python255 6 3014
DAMO-NLP-SG/WebDesignAgent
WebDesignAgent : Towards Effortless Website Creation
Language:Python249 3 1427
DAMO-NLP-SG/Inf-CLIP
[CVPR 2025] The official CLIP training codebase of Inf-CL: "Breaking the Memory Barrier: Near Infinite Batch Size Scaling for Contrastive Loss". A super memory-efficiency CLIP training scheme.
Language:Python237 5 411
DAMO-NLP-SG/VideoRefer
[CVPR 2025] The code for "VideoRefer Suite: Advancing Spatial-Temporal Object Understanding with Video LLM"
Language:Python174 8 58
DAMO-NLP-SG/DAMO-SeaLLMs
[ACL 2024 Demo] SeaLLMs - Large Language Models for Southeast Asia
Language:JavaScript161 14 1216
DAMO-NLP-SG/multimodal_textbook
The official repository for "2.5 Years in Class: A Multimodal Textbook for Vision-Language Pretraining"
Language:Python146 6 316
DAMO-NLP-SG/CLEX
[ICLR 2024] CLEX: Continuous Length Extrapolation for Large Language Models
Language:Python76 4 1111
DAMO-NLP-SG/multilingual-safety-for-LLMs
[ICLR 2024]Data for "Multilingual Jailbreak Challenges in Large Language Models"
67 7 07
DAMO-NLP-SG/DiGIT
[NeurIPS 2024] Stabilize the Latent Space for Image Autoregressive Modeling: A Unified Perspective
Language:Python64 4 22
DAMO-NLP-SG/chain-of-knowledge
[ICLR2024] Chain-of-Knowledge: Grounding Large Language Models via Dynamic Knowledge Adapting over Heterogeneous Sources
Language:Python63 4 59
DAMO-NLP-SG/CMM
✨✨The Curse of Multi-Modalities (CMM): Evaluating Hallucinations of Large Multimodal Models across Language, Visual, and Audio
Language:Python44 4 12
DAMO-NLP-SG/LLM-R2
Language:Python41 6 88
DAMO-NLP-SG/Auto-Arena-LLMs
Language:Jupyter Notebook37 2 41
DAMO-NLP-SG/LongPO
[ICLR 2025] LongPO: Long Context Self-Evolution of Large Language Models through Short-to-Long Preference Optimization
Language:Python31 3 14
DAMO-NLP-SG/multilingual_analysis
[NeurIPS 2024] How do Large Language Models Handle Multilingualism?
Language:Python29 3 60
DAMO-NLP-SG/SeaLLMs-Audio
Language:HTML294
DAMO-NLP-SG/Multipurpose-Chatbot
A chatbot UI for RAG, multimodal, text completion. (support Transformers, llama.cpp, MLX, vLLM)
Language:Python19 5 04
DAMO-NLP-SG/LLM-argumentation
[ACL2024] Exploring the Potential of Large Language Models in Computational Argumentation
Language:Python16 7 31
DAMO-NLP-SG/AdamergeX
Language:Python11 5 1
DAMO-NLP-SG/reasoning-paths-optimization
[EMNLP 2024] Reasoning Paths Optimization: Learning to Reason and Explore From Diverse Paths
Language:Python10 3 01
DAMO-NLP-SG/HierEncDec
code and data for "A Hierarchical Encoding-Decoding Scheme for Abstractive Multi-document Summarization"
Language:Python9 5 21
DAMO-NLP-SG/LLM_summeval
use gpt-turbo-3.5 to evaluate abstractive summaries
Language:Python7 5 01
DAMO-NLP-SG/SeaExam
SeaExam: Benchmarking LLMs for Southeast Aisa languages with Human Exam Questions
Language:Python6 4 00
DAMO-NLP-SG/FineReason
FineReason: Evaluating and Improving LLMs' Deliberate Reasoning through Reflective Puzzle Solving
Language:Python3
DAMO-NLP-SG/SeaBench
Language:Python2 4 0
DAMO-NLP-SG/MMR1
MMR1: Advancing the Frontiers of Multimodal Reasoning