๐ Hi, I am Xingyu Fu, an incoming Postdoctral Researcher at Princeton Language and Intelligence. I'm currently a fifth-year PhD student in Computer Science at the University of Pennsylvania advised by Prof. Dan Roth. During my PhD, I have interned at Microsoft and AWS AI Labs. I received my B.S. in Computer Science from UIUC in 2020, where I was very fortunate to be advised by Prof. Jiawei Han.
My research primarily focuses on generative multimodal models at the intersection between vision and natural language (e.g., multimodal LLMs, text-to-image/video generation, omni models). I aim to improve the perception and reasoning capabilities of multimodal models by bridging them together. I have built better evaluations for emergent abilities, and used synthetic data to design models that can better perceive and reason about the multimodal world.
I'm always open to collaborations. Send me an email if you're interested!
Xingyu Fu, Minqian Liu, Zhengyuan Yang, John Corring, Yijuan Lu, Jianwei Yang, Dan Roth, Dinei Florencio, Cha Zhang
ICML 2025
Jialuo Li, Wenhao Chai, Xingyu Fu, Haiyang Xu, Saining Xie
CVPR 2025
Fei Wang*, Xingyu Fu*, James Y. Huang, Zekun Li, Qin Liu, Xiaogeng Liu, Mingyu Derek Ma, Nan Xu, Wenxuan Zhou, Kai Zhang, Tianyi Lorena Yan, Wenjie Jacky Mo, Hsiang-Hui Liu, Pan Lu, Chunyuan Li, Chaowei Xiao, Kai-Wei Chang, Dan Roth, Sheng Zhang, Hoifung Poon, Muhao Chen
ICLR 2025
Yushi Hu*, Weijia Shi*, Xingyu Fu, Dan Roth, Mari Ostendorf, Luke Zettlemoyer, Noah A Smith, Ranjay Krishna
NeurIPS 2024
Xingyu Fu, Muyu He, Yujie Lu, William Yang Wang, Dan Roth
COLM 2024
Xingyu Fu*, Yushi Hu*, Bangzheng Li, Yu Feng, Haoyu Wang, Xudong Lin, Dan Roth, Noah A. Smith, Wei-Chiu Maโ , Ranjay Krishnaโ
ECCV 2024, Spotlight of cVinW@CVPR 2024, 36K total downloads.
[paper]
[website]
[code]
[dataset]
[eval]
[twitter]
[ Paper of the day]
Bangzheng Li, Ben Zhou, Fei Wang, Xingyu Fu, Dan Roth, Muhao Chen
NAACL. 2024.
Max Ku, Tianle Li, Kai Zhang, Yujie Lu, Xingyu Fu, Wenwen Zhuang, Wenhu Chen
ICLR. 2024.
Xingyu Fu, Sheng Zhang, Gukyeong Kwon, Pramuditha Perera, Henghui Zhu, Yuhao Zhang, Alexander Hanbo Li, William Yang Wang, Zhiguo Wang, Vittorio Castelli, Patrick Ng, Dan Roth, Bing Xiang
ACL findings. 2023.
Xingyu Fu, Ben Zhou, Sihao Chen, Mark Yatskar, Dan Roth
Arxiv. 2023.
Xingyu Fu, Ben Zhou, Ishaan Chandratreya, Carl Vondrick, Dan Roth
ACL (Oral). 2022.
Xingyu Fu*, Weijia Shi*, Xiaodong Yu, Zian Zhao, Dan Roth
EMNLP. 2020.
Ahmed El-Kishky*, Xingyu Fu*, Aseel Addawood, Nahil Sobh, Clare Voss, Jiawei Han
WANLP @ ACL. 2019.