๐ Hi, I am Xingyu Fu, a fourth-year PhD student in Computer Science at the University of Pennsylvania advised by Prof. Dan Roth. I have interned at Microsoft and AWS AI Labs.
My research primarily focuses on generative multimodal models at the intersection between vision and natural language (e.g., multimodal LLMs, text-to-image/video generation). My research interest includes building better evaluations for emergent abilities in generative multimodal models, and using them to design models that can perceive the world, reason, and react to the environment better as humans would do, grounded in the multimodal world.
I received my Bachelor's Degree from the University of Illinois at Urbana-Champaign, where I was very fortunate to be advised by Prof. Jiawei Han.
My hometown is Suzhou (่ๅท).
I'm looking for motivated students to work with! Send me an email if you're interested.
Fei Wang*, Xingyu Fu*, James Y. Huang, Zekun Li, Qin Liu, Xiaogeng Liu, Mingyu Derek Ma, Nan Xu, Wenxuan Zhou, Kai Zhang, Tianyi Lorena Yan, Wenjie Jacky Mo, Hsiang-Hui Liu, Pan Lu, Chunyuan Li, Chaowei Xiao, Kai-Wei Chang, Dan Roth, Sheng Zhang, Hoifung Poon, Muhao Chen
Arxiv 2024 June
Yushi Hu*, Weijia Shi*, Xingyu Fu, Dan Roth, Mari Ostendorf, Luke Zettlemoyer, Noah A Smith, Ranjay Krishna
NeurIPS 2024
Xingyu Fu, Muyu He, Yujie Lu, William Yang Wang, Dan Roth
COLM 2024
Xingyu Fu*, Yushi Hu*, Bangzheng Li, Yu Feng, Haoyu Wang, Xudong Lin, Dan Roth, Noah A. Smith, Wei-Chiu Maโ , Ranjay Krishnaโ
ECCV 2024
[paper] [website] [code] [dataset] [eval] [twitter] [ Paper of the day]
Bangzheng Li, Ben Zhou, Fei Wang, Xingyu Fu, Dan Roth, Muhao Chen
NAACL. 2024.
Max Ku, Tianle Li, Kai Zhang, Yujie Lu, Xingyu Fu, Wenwen Zhuang, Wenhu Chen
ICLR. 2024.
Xingyu Fu, Sheng Zhang, Gukyeong Kwon, Pramuditha Perera, Henghui Zhu, Yuhao Zhang, Alexander Hanbo Li, William Yang Wang, Zhiguo Wang, Vittorio Castelli, Patrick Ng, Dan Roth, Bing Xiang
ACL findings. 2023.
Xingyu Fu, Ben Zhou, Sihao Chen, Mark Yatskar, Dan Roth
Arxiv. 2023.
Xingyu Fu, Ben Zhou, Ishaan Chandratreya, Carl Vondrick, Dan Roth
ACL (Oral). 2022.
Xingyu Fu*, Weijia Shi*, Xiaodong Yu, Zian Zhao, Dan Roth
EMNLP. 2020.
Ahmed El-Kishky*, Xingyu Fu*, Aseel Addawood, Nahil Sobh, Clare Voss, Jiawei Han
WANLP @ ACL. 2019.