Situated Language and Embodied Dialogue (SLED) Research Group

SLED Research Group @ University of Michigan

United States of America

Pinned Repositories

chat-with-nerf
Chat with NeRF enables users to interact with a NeRF model by typing in natural language.
Language:Python269 5 1116
CycleNet
Official Code for NeurIPS 2023 Paper: CycleNet: Rethinking Cycle Consistent in Text‑Guided Diffusion for Image Manipulation
Language:Python52 6 103
DANLI
Code for EMNLP 2022 Paper DANLI: Deliberative Agent for Following Natural Language Instructions
Language:Python17 5 22
DOROTHIE
Official Code for DOROTHIE: Spoken Dialogue for Handling Unexpected Situations in Interactive Autonomous Driving Agents (Findings of EMNLP 2022)
Language:Python15 5 14
InfEdit
[CVPR 2024] Official implementation of CVPR 2024 paper: "Inversion-Free Image Editing with Natural Language"
Language:Python212 6 166
MindCraft
Official code for our EMNLP2021 Outstanding Paper MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks
Language:Java18 2 01
navchat
Code for ICRA24 paper "Think, Act, and Ask: Open-World Interactive Personalized Robot Navigation" https://arxiv.org/abs/2310.07968
Language:Python15 5 00
Pragmatic-Rational-Speaker
Official code for ACL 2022 paper "Learning to Mediate Disparities Towards Pragmatic Communication".
Language:Python4 4 00
Verifiable-Coherent-NLU
Shared repository for TRIP dataset for verifiable NLU and coherence measurement for text classifiers.
Language:Jupyter Notebook15 4 012
world-to-words
Official Code for ACL 2023 Outstanding Paper: World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Language Models
Language:Jupyter Notebook17 4 12

Situated Language and Embodied Dialogue (SLED) Research Group's Repositories

sled-group/chat-with-nerf
Chat with NeRF enables users to interact with a NeRF model by typing in natural language.
Language:Python269 5 1116
sled-group/InfEdit
[CVPR 2024] Official implementation of CVPR 2024 paper: "Inversion-Free Image Editing with Natural Language"
Language:Python212 6 166
sled-group/CycleNet
Official Code for NeurIPS 2023 Paper: CycleNet: Rethinking Cycle Consistent in Text‑Guided Diffusion for Image Manipulation
Language:Python52 6 103
sled-group/MindCraft
Official code for our EMNLP2021 Outstanding Paper MindCraft: Theory of Mind Modeling for Situated Dialogue in Collaborative Tasks
Language:Java18 2 01
sled-group/DANLI
Code for EMNLP 2022 Paper DANLI: Deliberative Agent for Following Natural Language Instructions
Language:Python17 5 22
sled-group/world-to-words
Official Code for ACL 2023 Outstanding Paper: World-to-Words: Grounded Open Vocabulary Acquisition through Fast Mapping in Vision-Language Models
Language:Jupyter Notebook17 4 12
sled-group/DOROTHIE
Official Code for DOROTHIE: Spoken Dialogue for Handling Unexpected Situations in Interactive Autonomous Driving Agents (Findings of EMNLP 2022)
Language:Python15 5 14
sled-group/navchat
Code for ICRA24 paper "Think, Act, and Ask: Open-World Interactive Personalized Robot Navigation" https://arxiv.org/abs/2310.07968
Language:Python15 5 00
sled-group/Verifiable-Coherent-NLU
Shared repository for TRIP dataset for verifiable NLU and coherence measurement for text classifiers.
Language:Jupyter Notebook15 4 012
sled-group/Comparative-Learning
Official Code for ACL 2023 Paper: Human Inspired Progressive Alignment and Comparative Learning for Grounded Word Acquisition
Language:Python4 3 03
sled-group/Pragmatic-Rational-Speaker
Official code for ACL 2022 paper "Learning to Mediate Disparities Towards Pragmatic Communication".
Language:Python4 4 00
sled-group/collab-plan-acquisition
Official Code for IJCAI 2023 Paper: Towards Collaborative Plan Acquisition through Theory of Mind Modeling in Situated Dialogue
Language:Python3 3 00
sled-group/compute-guide
Guide to using compute resource at SLED Group
3 5 21
sled-group/Watch-Talk-and-Guide
Language:Python3 3 01
sled-group/great-lakes-guide
Guide to Using Great Lakes
2 3 10
sled-group/Heuristic-Analytic-Reasoning
Repo for the EMNLP 2023 paper "From Heuristic to Analytic: Cognitively-Motivated Reasoning Strategies for Coherent Physical Commonsense in Pre-Trained Language Models."
Language:Python10
sled-group/NLP-Reproducibility-For-Beginners
Repo for the ACL 2023 Paper "NLP Reproducibility For All: Understanding Experiences of Beginners."
Language:Python1 4 00
sled-group/Conversation-Entailment
Official dataset for Towards Conversation Entailment: An Empirical Investigation. Chen Zhang, Joyce Chai. EMNLP, 2010
0 4 00
sled-group/Grounded-Semantic-Role-Labeling
Official dataset for Grounded Semantic Role Labeling. Shaohua Yang, Qiaozi Gao, Changsong Liu, Caiming Xiong, Song-Chun Zhu, Joyce Y. Chai. NAACL HLT, 2016.
0 4 00
sled-group/HiTUT
Official code for the ACL 2021 Findings paper "Yichi Zhang and Joyce Chai. Hierarchical Task Learning from Language Instructions with Unified Transformers and Self-Monitoring"
Language:C0 3 00
sled-group/danli_visualizer
Language:Python4 0
sled-group/driVLMe
[VALDR @ CVPR 2024] Official implementation of paper: DriVLMe: "Enhancing LLM-based Autonomous Driving Agents with Embodied and Social Experience"s
Language:JavaScript
sled-group/lerf
Code for LERF: Language Embedded Radiance Fields
Language:Python0 01
sled-group/lerf_lite
Code for LERF: Language Embedded Radiance Fields
Language:Python0 01
sled-group/nerfstudio_export
Language:Python3 01
sled-group/Nominal-Semantic-Role-Labeling
Official Annotation of our works on Nominal Semantic Role Labeling (NSRL)
4 0
sled-group/PercepSync
Language:C#4 13
sled-group/Physical-Causality-of-Action-Verbs
Official dataset for Physical Causality of Action Verbs in Grounded Language Understanding. Qiaozi Gao, Malcolm Doering, Shaohua Yang, Joyce Chai. ACL, 2016.
4 0
sled-group/Robust-Multimodal-Interpretation-in-Conversation-Systems
Official datasets for our works in Robust Multimodal Interpretation in Conversation Systems
4 0
sled-group/TDW_Environment
Simulated Environment using TDW
Language:Python0 0