UMass-Foundation-Model

3D-LLM

Code for 3D-LLM: Injecting the 3D World into Large Language Models

3D-VLA

[ICML 2024] 3D-VLA: A 3D Vision-Language-Action Generative World Model

Co-LLM-Agents

[ICLR 2024] Source codes for the paper "Building Cooperative Embodied Agents Modularly with Large Language Models"

COMBO

Source codes for the paper "COMBO: Compositional World Models for Embodied Multi-Agent Cooperation"

CoVLM

Official implementation for CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding

genome

HAZARD

HAZARD challenge

Mod-Squad

MultiPLY

Code for MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World

RapVerse

Code for paper "RapVerse: Coherent Vocals and Whole-Body Motions Generations from Text"

UMass-Foundation-Model/3D-LLM

Code for 3D-LLM: Injecting the 3D World into Large Language Models

UMass-Foundation-Model/3D-VLA

[ICML 2024] 3D-VLA: A 3D Vision-Language-Action Generative World Model

UMass-Foundation-Model/Co-LLM-Agents

[ICLR 2024] Source codes for the paper "Building Cooperative Embodied Agents Modularly with Large Language Models"

UMass-Foundation-Model/MultiPLY

Code for MultiPLY: A Multisensory Object-Centric Embodied Large Language Model in 3D World

UMass-Foundation-Model/Mod-Squad

UMass-Foundation-Model/CoVLM

Official implementation for CoVLM: Composing Visual Entities and Relationships in Large Language Models Via Communicative Decoding

UMass-Foundation-Model/HAZARD

HAZARD challenge

UMass-Foundation-Model/COMBO

Source codes for the paper "COMBO: Compositional World Models for Embodied Multi-Agent Cooperation"

UMass-Foundation-Model/FlexAttention

UMass-Foundation-Model/genome

UMass-Foundation-Model/RapVerse

Code for paper "RapVerse: Coherent Vocals and Whole-Body Motions Generations from Text"

UMass-Foundation-Model/VisualCoT

Codebase for AAAI 2024 conference paper Visual Chain-of-Thought Prompting for Knowledge-based Visual Reasoning