Portrait of Lun Huang
World Modeling & Generative AI

Lun Huang

Research Scientist, Generative AI @ ByteDance
San Jose, CA  ·  Ph.D., Duke University

About

I am a Research Scientist at ByteDance in San Jose, working on world modeling and generative AI.

I received my Ph.D. in Electrical and Computer Engineering from Duke University in 2026, advised by Prof. Guillermo Sapiro, and spent the last two years of my Ph.D. as a visiting student at Princeton University. Before that, I received my M.S. from Peking University and my B.E. from Huazhong University of Science and Technology.

My work spans video generation and editing, visual autoregressive modeling, and representation learning, with papers at ICCV (Oral), NeurIPS, ICLR, and CVPR workshops. Along the way I have worked at ByteDance, Microsoft Research Asia, and Tencent AI Lab.

News

Research

Under Review

* Equal contribution. The full list is on Google Scholar.

Experience

ByteDance Now

Research Scientist, Generative AI
World modeling.
Apr 2026 – PresentSan Jose, CA

ByteDance

Research Intern, Generative AI
Built Plan-X, a framework that separates high-level semantic planning from low-level video synthesis, for long-horizon video generation that follows instructions.
May 2025 – Mar 2026San Jose, CA

Princeton University

Visiting Research Assistant, Electrical and Computer Engineering · Advisor: Guillermo Sapiro
Research on generative AI and representation learning: SSOLE (ICLR 2025), a self-supervised framework built on orthogonal low-rank embedding, and the survey of autoregressive models in vision (TMLR 2025).
Aug 2024 – Mar 2026Princeton, NJ

Duke University

Graduate Research Assistant, Electrical and Computer Engineering · Advisor: Guillermo Sapiro
Research on generative modeling and representation learning: PQ-VAE (CVPR Workshops 2024), hierarchical discrete representations via progressive quantization; and privacy-first, attribute-preserving face anonymization via ID-augmented contrastive learning.
Aug 2020 – Mar 2026Durham, NC

Microsoft Research Asia

Research Assistant (StarBridge Program), Multimodal Learning
Built GODIVA, an autoregressive open-domain text-to-video model that uses 3D sparse attention for efficient large-scale video generation.
Jun 2020 – May 2021Beijing, China

Tencent AI Lab

Research Intern, Reinforcement Learning & AutoML
Used reinforcement learning to optimize agent populations, focusing on automated reward shaping and behavior optimization.
Apr 2019 – Sep 2019Shenzhen, China

Education

Duke University

Ph.D., Electrical and Computer Engineering
Advisor: Guillermo Sapiro · Generative AI, video generation, representation learning
Aug 2020 – Mar 2026Durham, NC

Princeton University

Visiting Ph.D. Student, Electrical and Computer Engineering
Advisor: Guillermo Sapiro · Generative AI, representation learning
Aug 2024 – Mar 2026Princeton, NJ

Peking University

M.S., Computer Applied Technology
Thesis: Towards Accurate Attention Mechanisms for Image Captioning · Multimodal systems, reinforcement learning
Sep 2017 – Jul 2020Beijing, China

Huazhong University of Science and Technology

B.E., Electronic and Information Engineering
National Key Class (top students in CS/EE) · GPA 3.7/4.0
Sep 2013 – Jun 2017Wuhan, China

Honors & Awards

  • National ScholarshipMinistry of Education of China · 2019
  • Exceptional Award for Academic InnovationPeking University · 2019
  • Outstanding GraduateBeijing & PKU 2020 · HUST 2017

Academic Service

  • Reviewer
CVPRECCVNeurIPSICLRICMLAISTATSAAAIIEEE TMM

Teaching

  • TA, Image and Video ProcessingDuke University · Fall 2022 & 2023
  • TA, Artificial IntelligencePeking University · Spring 2018