/WorldModelPapers

Paper collections of the continuous effort start from World Models.

MIT LicenseMIT

WorldModelPapers

Paper collections of the continuous effort start from World Models.

Papers

  1. World Models.

    David Ha, Jürgen Schmidhuber [pdf], 2018.3

  2. Dream to Control: Learning Behaviors by Latent Imagination.

    Danijar Hafner, Timothy Lillicrap, Jimmy Ba, Mohammad Norouzi [pdf], 2019.12

  3. Mastering Atari with Discrete World Models.

    Danijar Hafner, Timothy Lillicrap, Mohammad Norouzi, Jimmy Ba [pdf], 2020.10

  4. Mastering Atari Games with Limited Data.

    Weirui Ye, Shaohuai Liu, Thanard Kurutach, Pieter Abbeel, Yang Gao [pdf], 2021.11

  5. A Path Towards Autonomous Machine Intelligence.

    Yann LeCun [pdf], 2022.6

  6. DayDreamer: World Models for Physical Robot Learning.

    Philipp Wu, Alejandro Escontrela, Danijar Hafner, Ken Goldberg, Pieter Abbeel [pdf], 2022.6

  7. Model-Based Imitation Learning for Urban Driving.

    Anthony Hu, Gianluca Corrado, Nicolas Griffiths, Zak Murez, Corina Gurau, Hudson Yeo, Alex Kendall, Roberto Cipolla, Jamie Shotton [pdf], 2022.10

  8. Mastering Diverse Domains through World Models.

    Danijar Hafner, Jurgis Pasukonis, Jimmy Ba, Timothy Lillicrap [pdf], 2023.1

  9. Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecture.

    Mahmoud Assran, Quentin Duval, Ishan Misra, Piotr Bojanowski, Pascal Vincent, Michael Rabbat, Yann LeCun, Nicolas Ballas [pdf], 2023.1

  10. Do Embodied Agents Dream of Pixelated Sheep: Embodied Decision Making using Language Guided World Modelling.

    Kolby Nottingham, Prithviraj Ammanabrolu, Alane Suhr, Yejin Choi, Hannaneh Hajishirzi, Sameer Singh, Roy Fox [pdf], 2023.1

  11. Learning Universal Policies via Text-Guided Video Generation.

    Yilun Du, Mengjiao Yang, Bo Dai, Hanjun Dai, Ofir Nachum, Joshua B. Tenenbaum, Dale Schuurmans, Pieter Abbeel [pdf], 2023.2

  12. Language Models Meet World Models: Embodied Experiences Enhance Language Models

    Jiannan Xiang and Tianhua Tao and Yi Gu and Tianmin Shu and Zirui Wang and Zichao Yang and Zhiting Hu [pdf], 2023.5

  13. Reasoning with Language Model is Planning with World Model

    Shibo Hao, Yi Gu, Haodi Ma, Joshua Jiahua Hong, Zhen Wang, Daisy Zhe Wang, Zhiting Hu [pdf], 2023.5

  14. From Word Models to World Models: Translating from Natural Language to the Probabilistic Language of Thought

    Lionel Wong, Gabriel Grand, Alexander K Lew, Noah D Goodman, Vikash K Mansinghka, Jacob Andreas, Joshua B Tenenbaum [pdf], 2023.6

  15. Learning to Model the World with Language

    Jessy Lin, Yuqing Du, Olivia Watkins, Danijar Hafner, Pieter Abbeel, Dan Klein, Anca Dragan [pdf], 2023.7

  16. GAIA-1: A Generative World Model for Autonomous Driving.

    Anthony Hu, Lloyd Russell, Hudson Yeo, Zak Murez, George Fedoseev, Alex Kendall, Jamie Shotton, Gianluca Corrado [pdf], 2023.9

  17. DriveDreamer: Towards Real-world-driven World Models for Autonomous Driving.

    Xiaofeng Wang, Zheng Zhu, Guan Huang, Xinze Chen, Jiwen Lu [pdf], 2023.9

  18. Video Language Planning.

    Yilun Du, Mengjiao Yang, Pete Florence, Fei Xia, Ayzaan Wahid, Brian Ichter, Pierre Sermanet, Tianhe Yu, Pieter Abbeel, Joshua B. Tenenbaum, Leslie Kaelbling, Andy Zeng, Jonathan Tompson [pdf], 2023.10

  19. Finetuning Offline World Models in the Real World

    Yunhai Feng, Nicklas Hansen, Ziyan Xiong, Chandramouli Rajagopalan, Xiaolong Wang [pdf], 2023.10

  20. Learning Unsupervised World Models for Autonomous Driving via Discrete Diffusion

    Lunjun Zhang, Yuwen Xiong, Ze Yang, Sergio Casas, Rui Hu, Raquel Urtasun [pdf], 2023.11

  21. Gradient-based Planning with World Models

    Jyothir S V, Siddhartha Jalagam, Yann LeCun, Vlad Sobal [pdf], 2023.12

Tutorial

  1. Language Models meet World Models @ NeurIPS 2023

    Zhiting Hu, Tianmin Shu [site], [pdf], 2023.12

Previous collections

Here are some paper collections I made (or mainly contributed to) previously and the timestamps for your interests:

Have fun!