Jiannan Xiang

I am a second-year PhD student at University of California, San Diego, under the supervision of Prof. Zhiting Hu. Previously, I got my Master's degree from Machine Learning Department at Carnegie Mellon University, and my Bachelor's degree in Electronic Information Engineering from University of Science and Technology of China.

Email: jixiang[at]ucsd.edu

Github   /   Google Scholar   /   Twitter   /   LinkedIn     

Pandora: Towards General World Model with Natural Language Actions and Video States
Jiannan Xiang*,  Guangyi Liu*,  Yi Gu*,  Qiyue Gao,  Yuting Ning,  Yuheng Zha,  Zeyu Feng,  Tianhua Tao,  Shibo Hao,  Yemin Shi,  Zhengzhong Liu,  Eric P. Xing,  Zhiting Hu 
Technical Report  
paper  /  website  /  code  

MMToM-QA: Multimodal Theory of Mind Question Answering
Chuanyang Jin,  Yutong Wu,  Jing Cao,  Jiannan Xiang,  Yen-Ling Kuo,  Zhiting Hu,  Tomer Ullman,  Antonio Torralba,  Joshua B. Tenenbaum,  Tianmin Shu 
ACL 2024  
paper  /  code  

Language Models Meet World Models: Embodied Experiences Enhance Language Models
Jiannan Xiang*,  Tianhua Tao*,  Yi Gu,  Tianmin Shu,  Zirui Wang,  Zichao Yang,  Zhiting Hu
NeurIPS 2023  
paper  /  code  

ASDOT: Any-Shot Data-to-Text Generation with Pretrained Language Models
Jiannan Xiang,  Zhengzhong Liu,  Yucheng Zhou,  Eric P. Xing,  Zhiting Hu 
EMNLP 2022, Findings  
paper  /  code  

Investigating Data Variance in Evaluations of Automatic Machine Translation Metrics
Jiannan Xiang,  Huayang Li,  Yahui Liu,  Lemao Liu,  Guoping Huang,  Defu Lian,  Shuming Shi 
ACL 2022, Findings  
paper  

Visualizing the Relationship Between Encoded Linguistic Information and Task Performance
Jiannan Xiang*,  Huayang Li*,  Defu Lian,  Guoping Huang,  Taro Watanabe,  Lemao Liu 
ACL 2022, Findings  
paper  

Assessing Dialogue Systems with Distribution Distances
Jiannan Xiang*,  Yahui Liu*,  Deng Cai,  Huayang Li,  Defu Lian,  Lemao Liu 
ACL 2021, Findings  
paper  /  code  

Learning to stop: A Simple yet Effective Approach to Urban Vision-Language Navigation
Jiannan Xiang,  Xin Eric Wang,  William Yang Wang 
EMNLP 2020, Findings  
paper  

Not All Actions Are Equal: Learning to Stop in Language-Grounded Urban Navigation
Jiannan Xiang,  Xin Eric Wang,  William Yang Wang 
NeurIPS 2019, ViGIL workshop  
paper