Weijie Lyu

I am a final-year EECS Ph.D. candidate at the University of California, Merced, advised by Prof. Ming-Hsuan Yang.

I have had the privilege of working closely with Dr. Lu Jiang at Apple, Dr. Zhixin Shu at Adobe Research, Dr. Yujing Wang and Dr. Xiangtai Li at ByteDance, Dr. Xueting Li and Dr. Yi-Hsuan Tsai.

Previously, I received my M.S. in Computer Science from the University of Illinois at Urbana-Champaign, advised by Prof. Derek Hoiem, and my B.E. from ShanghaiTech University.

Email / CV / Google Scholar / Semantic Scholar / GitHub / LinkedIn

I am looking for full-time industry positions starting in Spring or Summer 2027. If you think I might be a good fit, or would simply like to connect, please feel free to reach out at wlyu3@ucmerced.edu. Thanks!

News

[Oct. 2026] Check out AudioLift, our method for audio-driven full-head Gaussian avatars from a single portrait!

[Sept. 2026] VGC is accepted by NeurIPS 2026.

[Jul. 2026] Edit3r is accepted by ECCV 2026 as an Oral presentation.

[May 2026] Started my research internship at Apple.

[May 2026] Gaga is (finally) accepted by TMLR.

[Feb. 2026] FaceCam is accepted by CVPR 2026. See you in Denver!

[Feb. 2026] Started my research internship at ByteDance.

[Nov. 2025] Successfully passed my qualifying exam and am now a Ph.D. candidate!

[Sept. 2025] Two papers, InstaInpaint and HoliGS, are accepted by NeurIPS 2025.

[Jun. 2025] FaceLift is accepted by ICCV 2025.

Education

University of California, Merced
Ph.D. in EECS
Aug. 2023 – Present

University of Illinois, Urbana-Champaign
M.S. in Computer Science
Aug. 2021 – May 2023

University of California, Berkeley
Undergrad Researcher
Jan. 2020 – Aug. 2020

ShanghaiTech University
B.E. in Computer Science
Sept. 2017 – Jul. 2021

Work Experience

Apple
Research Scientist Intern
May 2026 – Aug. 2026

ByteDance
Research Scientist Intern
Feb. 2026 – May 2026

Adobe Research
Research Scientist Intern
May 2024 – Jan. 2026

Publications and Preprints

	Learning to Correct Geometry in Generated Videos Weijie Lyu, Tiancheng Shen, Xiangtai Li, Yujing Wang, Xiaoyuan Wang, Haobo Yuan, Yizhou Zhao, Ming-Hsuan Yang NeurIPS 2026 Project Page / arXiv / GitHub
	AudioLift: Audio-Driven Single Image to Full-Head Gaussian Avatar via Multi-view Video Generation Zhuoyuan Jiang, Weijie Lyu, Xiaoyuan Wang, Tiancheng Shen, Ming-Hsuan Yang Preprint Project Page / GitHub
	COMPASS: Contextual Moment Prior Alignment for Generalizable AIGI Detection Zhan Yang, Tiancheng Shen, Weijie Lyu, Shuo Chen, Bernard Ghanem, Yibo Yang, Ming-Hsuan Yang Preprint arXiv
	Edit3r: Instant 3D Scene Editing from Sparse Unposed Images Jiageng Liu, Weijie Lyu, Xueting Li, Yejie Guo, Ming-Hsuan Yang ECCV 2026 Oral Project Page / arXiv / GitHub
	FaceCam: Portrait Video Camera Control via Scale-Aware Conditioning Weijie Lyu, Ming-Hsuan Yang, Zhixin Shu CVPR 2026 Project Page / arXiv / GitHub
	Gaga: Group Any Gaussians via 3D-aware Memory Bank Weijie Lyu, Xueting Li, Abhijit Kundu, Yi-Hsuan Tsai, Ming-Hsuan Yang TMLR 2026 Project Page / arXiv / GitHub
	InstaInpaint: Instant 3D-Scene Inpainting with Masked Large Reconstruction Model Junqi You, Chieh Hubert Lin, Weijie Lyu, Zhengbo Zhang, Ming-Hsuan Yang NeurIPS 2025 Project Page / arXiv / GitHub
	HoliGS: Holistic Gaussian Splatting for Embodied View Synthesis Xiaoyuan Wang, Yizhou Zhao, Botao Ye, Xiaojun Shan, Weijie Lyu, Lu Qi, Kelvin C.K. Chan, Yinxiao Li, Ming-Hsuan Yang NeurIPS 2025 arXiv
	FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Heads Weijie Lyu, Yi Zhou, Ming-Hsuan Yang, Zhixin Shu ICCV 2025 Project Page / arXiv / Demo / GitHub
	PTT: Point-Trajectory Transformer for Efficient Temporal 3D Object Detection Kuan-Chih Huang, Weijie Lyu, Ming-Hsuan Yang, Yi-Hsuan Tsai CVPR 2024 arXiv / GitHub
	Continual Learning in Open-vocabulary Classification with Complementary Memory Systems Zhen Zhu, Weijie Lyu, Yao Xiao, Derek Hoiem TMLR 2024 arXiv / GitHub
	Consistent Multimodal Generation via A Unified GAN Framework Zhen Zhu, Yijun Li, Weijie Lyu, Krishna Kumar Singh, Zhixin Shu, Sören Pirk, Derek Hoiem WACV 2024 arXiv
	SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehicles Chejian Xu, Wenhao Ding, Weijie Lyu, Zuxin Liu, Shuai Wang, Yihan He, Hanjiang Hu, Ding Zhao, Bo Li NeurIPS 2022 Project Page / arXiv / GitHub

Visiting Student Collaborators

I have been fortunate to work with and mentor these talented students.

Zhuoyuan Jiang: Yale (Paper: AudioLift)
Jiageng Liu: UMass Amherst, now a Ph.D. student at UCLA (Paper: Edit3r)
Junqi You: SJTU, now a Ph.D. student at Princeton (Paper: InstaInpaint)
Xiaoyuan Wang: CMU, now a Member of Technical Staff at Moonlake AI (Papers: HoliGS, AudioLift, VGC)

Academic Service

Conference Reviewer: CVPR, ICCV, ECCV, ICLR, NeurIPS, SIGGRAPH, etc.

Journal Reviewer: TPAMI, TMLR, etc.

Misc.

This is my cat Holly.

Updated Oct. 2026. Template from Jon Barron