Jiannan Xiang

I am a second-year PhD student at University of California, San Diego, under the supervision of Prof. Zhiting Hu. Previously, I got my Master's degree from Machine Learning Department at Carnegie Mellon University. My research interests lie in building general world models and leveraging them to advance reasoning and planning in real-world tasks.

Email: jixiang[at]ucsd.edu

Github   /   Google Scholar   /   Twitter   /   LinkedIn     

DreamGen: Unlocking Generalization in Robot Learning through Neural Trajectories
Joel Jang*, Seonghyeon Ye*, Zongyu Lin*, Jiannan Xiang*, Johan Bjorck, Yu Fang, Fengyuan Hu, Spencer Huang, Kaushil Kundalia, Yen-Chen Lin, Loic Magne, Ajay Mandlekar, Avnish Narayan, You Liang Tan, Guanzhi Wang, Jing Wang, Qi Wang, Yinzhen Xu, Xiaohui Zeng, Kaiyuan Zheng, Ruijie Zheng, Ming-Yu Liu, Luke Zettlemoyer, Dieter Fox, Jan Kautz, Scott Reed, Yuke Zhu, Linxi Fan
Preprint  
paper  /  blog  

Do Vision-Language Models Have Internal World Models? Towards an Atomic Evaluation
Qiyue Gao, Xinyu Pi, Kevin Liu, Junrong Chen, Ruolan Yang, Xinqi Huang, Xinyu Fang, Lu Sun, Gautham Kishore, Bo Ai, Stone Tao, Mengyang Liu, Jiaxi Yang, Chao-Jung Lai, Chuanyang Jin, Jiannan Xiang, Benhao Huang, David Danks, Hao Su, Tianmin Shu, Ziqiao Ma, Lianhui Qin, Zhiting Hu
ACL 2025, Findings  
paper  

GR00T N1: An Open Foundation Model for Generalist Humanoid Robots
NVIDIA (Core Contributor) 
Whitepaper  
paper  /  blog  /  code  

Pandora: Towards General World Model with Natural Language Actions and Video States
Jiannan Xiang, Guangyi Liu, Yi Gu, Qiyue Gao, Yuting Ning, Yuheng Zha, Zeyu Feng, Tianhua Tao, Shibo Hao, Yemin Shi, Zhengzhong Liu, Eric P. Xing, Zhiting Hu
Technical Report  
paper  /  website  /  code  

MMToM-QA: Multimodal Theory of Mind Question Answering
Chuanyang Jin, Yutong Wu, Jing Cao, Jiannan Xiang, Yen-Ling Kuo, Zhiting Hu, Tomer Ullman, Antonio Torralba, Joshua B Tenenbaum, Tianmin Shu
ACL 2024 (Outstanding Paper Award)  
paper  /  code  

Language Models Meet World Models: Embodied Experiences Enhance Language Models
Jiannan Xiang*, Tianhua Tao*, Yi Gu, Tianmin Shu, Zirui Wang, Zichao Yang, Zhiting Hu
NeurIPS 2023  
paper  /  code