Weijie Lyu

I am a third year EECS Ph.D. candidate at University of California, Merced, advised by Prof. Ming-Hsuan Yang.

I am currently a research intern at ByteDance, advised by Dr. Yujing Wang. I have had the privilege of working closely with Dr. Zhixin Shu at Adobe Research, Dr. Xueting Li, Dr. Yi-Hsuan Tsai, and Dr. Abhijit Kundu.

I obtained my Master of Science in Computer Science degree from University of Illinois at Urbana-Champaign, advised by Prof. Derek Hoiem.

I obtained my Bachelor of Engineering degree from ShanghaiTech University, majoring in Computer Science and Technology. I spent my junior year as a visiting student and undergraduate researcher at University of California, Berkeley.

Email  /  CV  /  Google Scholar  /  Semantic Scholar  /  GitHub  /  LinkedIn

profile photo

Actively looking for 2026 summer intern opportunities. Please let me know if you are interested!

News

[Feb. 2026] FaceCam is accepted by CVPR 2026. See you in Denver!

[Feb. 2026] Start my research internship at ByteDance.

[Dec. 2025] Check out Edit3r, our method for instant 3D scene reconstruction and editing.

[Nov. 2025] Successfully passed my qualifying exam and am now a PhD candidate!

[Sept. 2025] Two papers InstaInpaint and HoliGS are accepted by NeurIPS 2025.

[June 2025] FaceLift is accepted by ICCV 2025.

Education
UC Merced

University of California, Merced
Ph.D. in EECS
Aug. 2023 – Present

UIUC

University of Illinois, Urbana-Champaign
M.S. in Computer Science
Aug. 2021 – May 2023

UC Berkeley

University of California, Berkeley
Undergrad Researcher
Jan. 2020 – Aug. 2020

ShanghaiTech

ShanghaiTech University
B.E. in Computer Science
Sept. 2017 – July 2021

Work Experience
ByteDance

ByteDance
Research Scientist Intern
Feb. 2026 – Present

Adobe Research

Adobe Research
Research Scientist Intern
May 2024 – Jan. 2026

Publications and Preprints
FaceCam: Portrait Video Camera Control via Scale-Aware Conditioning
Weijie Lyu, Ming-Hsuan Yang, Zhixin Shu
CVPR 2026
Project Page / arXiv / GitHub
Edit3r: Instant 3D Scene Editing from Sparse Unposed Images
Jiageng Liu*, Weijie Lyu*, Xueting Li, Yejie Guo, Ming-Hsuan Yang
arXiv 2025
Project Page / arXiv / GitHub
InstaInpaint: Instant 3D-Scene Inpainting with Masked Large Reconstruction Model
Junqi You, Chieh Hubert Lin, Weijie Lyu, Zhengbo Zhang, Ming-Hsuan Yang
NeurIPS 2025
Project Page / arXiv / GitHub GitHub Stars
HoliGS: Holistic Gaussian Splatting for Embodied View Synthesis
Xiaoyuan Wang, Yizhou Zhao, Botao Ye, Xiaojun Shan, Weijie Lyu, Lu Qi, Kelvin C.K. Chan, Yinxiao Li, Ming-Hsuan Yang
NeurIPS 2025
arXiv
FaceLift: Learning Generalizable Single Image 3D Face Reconstruction from Synthetic Heads
Weijie Lyu, Yi Zhou, Ming-Hsuan Yang, Zhixin Shu
ICCV 2025
Project Page / arXiv / Demo / GitHub GitHub Stars
Gaga: Group Any Gaussians via 3D-aware Memory Bank
Weijie Lyu, Xueting Li, Abhijit Kundu, Yi-Hsuan Tsai, Ming-Hsuan Yang
arXiv 2024
Project Page / arXiv / GitHub GitHub Stars
PTT: Point-Trajectory Transformer for Efficient Temporal 3D Object Detection
Kuan-Chih Huang, Weijie Lyu, Ming-Hsuan Yang, Yi-Hsuan Tsai
CVPR 2024
Paper / arXiv / GitHub GitHub Stars
Continual Learning in Open-vocabulary Classification with Complementary Memory Systems
Zhen Zhu*, Weijie Lyu*, Yao Xiao, Derek Hoiem
TMLR 2024
arXiv / GitHub
Consistent Multimodal Generation via A Unified GAN Framework
Zhen Zhu, Yijun Li, Weijie Lyu, Krishna Kumar Singh, Zhixin Shu, SΓΆren Pirk, Derek Hoiem
WACV 2024
Paper / arXiv / GitHub
SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehicles
Chejian Xu*, Wenhao Ding*, Weijie Lyu, Zuxin Liu, Shuai Wang, Yihan He, Hanjiang Hu, Ding Zhao, Bo Li
NeurIPS 2022
Project Page / Paper / arXiv / GitHub GitHub Stars
CircuitBot: Learning to Survive with Robotic Circuit Drawing
Xianglong Tan, Weijie Lyu, Andre Rosendo
PLOS ONE 2022
Paper
Academic Services

Conference Reviewer: CVPR, ICCV, ICLR, NeurIPS, Eurographics, ACCV, etc.

Journal Reviewer: TPAMI, TMLR, etc.

 

Updated Nov. 2025. Template from Jon Barron