👨‍🎓 About Me

I am a fourth-year Ph.D. student at Peking University, advised by Prof. Xuejun Yang and Prof. Wenjing Yang. I earned my B.E. degree at China University of Geosciences in 2023. Prior to that, I served for two years (2017-2019) in the People’s Liberation Army as an assault rifleman and a sniper.

My primary research interest lies in Foundation Models for Multimodal Learning, with broader interests in Causal Inference and Reinforcement Learning. My overarching goal is to build reliable and generalizable multimodal intelligence. As we move toward the next stage of AGI, I believe language models will remain a central engine of intelligence, providing a general interface for reasoning, planning, and decision-making, while increasingly interacting with specialized capabilities for perception, generation, and action. Rather than internalizing every capability within a monolithic model, I am particularly interested in how such intelligence can reason about, compose, and use external capabilities as tools.

Motivated by this perspective, I am currently exploring Code2Video, which rethinks video generation from a standalone prompt-to-video model into a programmable and compositional tool for intelligence. Specifically, I am interested in how language models can reason about generation tasks, translate intentions into executable structures, orchestrate specialized generative capabilities, and iteratively verify and refine their outputs—exploring code as an executable interface between reasoning and generation. In parallel, I am working on Efficient Pre-training of Multimodal Large Language Models to make multimodal intelligence more scalable and computationally efficient.

I am always open to research discussions and collaborations, so feel free to reach out (frankyang1517@gmail.com)! I am also looking for research interns to join us at the Kling Team. We are highly open to research directions and encourage curiosity-driven exploration—if you have exciting ideas and want to explore something interesting together, I would be happy to hear from you! 😄

✨ News

  • [2026.09]  🎉 One paper is accepted by NeurIPS 2026.
  • [2026.08]  🎉 One paper is accepted by EMNLP 2026.
  • [2026.08]  🎉 One paper is accepted by IEEE TPAMI.
  • [2026.07]  🎉 Two papers are accepted by ACM MM 2026.
  • [2026.06]  🎉 Two papers are accepted by ECCV 2026.
  • [2026.05]  🎉 Six papers are accepted by ICML 2026.
  • [2026.04]  🎉 One paper is accepted by ACL 2026.
  • [2026.02]  🎉 Four papers are accepted by CVPR 2026, including one Highlight.
  • [2026.01]  🎉 Six papers are accepted by ICLR 2026.
  • [2025.11]  🎉 One paper is accepted by AAAI 2026.
  • [2025.09]  🎉 One paper is accepted by NeurIPS 2025.
  • [2025.07]  🎉 Two papers are accepted by ACM MM 2025.
  • [2025.05]  🎉 One paper is accepted by ICML 2025.
  • [2025.02]  🚀 I join the Kling Team at Kuaishou Technology as a research intern.

📝 Publications

* Equal Contribution, † Corresponding Author, ‡ Project Lead, # Core Contributor

🤖 Models & Training

💡 Theory & Generalization

📊 Benchmarks & Evaluation

🗃️ Datasets & Open Source

📚 Surveys & Technical Report

👨‍💻 Work Experience

  • Research Intern at Kling AI, Kuaishou Technology, 2025.02 - Present
  • Visiting Student at THUNLP, Tsinghua University, 2023.11 - 2025.02
  • Visiting Student at Intelligent Game and Decision Lab, Academy of Military Sciences, 2023.09 - Present
  • Visiting Student at State Key Laboratory of High Performance Computing, National University of Defense Technology, 2023.09 - Present

📖 Education

  • Ph.D. School of Computer Science, Peking University, 2023 - Present
  • B.E. School of Computer Science, China University of Geosciences, 2019 - 2023

🎖 Honors and Awards

  • China National Scholarship, Peking University, 2026
  • Merit Student, Peking University, 2026
  • Outstanding Graduate, China University of Geosciences, 2023
  • Yingcai Scholarship, China University of Geosciences, 2022
  • Ruiming Alumni Scholarship, China University of Geosciences, 2021
  • China National Scholarship, China University of Geosciences, 2020
  • Outstanding Soldier Award, People’s Liberation Army, 2019
  • Outstanding Soldier Award, People’s Liberation Army, 2018