About me

I'm a researcher Tencent. My research interest focus on computer graphics, 3D reconstruction / generation and neural rendering. Before joining Tencent, I spent three wonderful years at SenseTime Research and Shanghai AI Lab after my M.Phil study from HKUST working on human motion capture.

Selected Projects

  • DNA-Rendering

    DNA-Rendering

    DNA-Rendering is a large-scale, high-fidelity repository of human performance data for neural actor rendering, which contains large volume of data with diverse attributes and rich annotation. Along with the dataset, a large-scale and quantitative benchmark in full-scale with multiple tasks on human rendering is provided.
    >> Project Page >> OpenXDLab

  • GNR & GeneBody

    GNR & GeneBody

    Generalizable Neural Performer (GNR) learns a generalizable and robust neural body representation over various geometry and appearance with a Geometric Body Embedding strategy which achors body shape priors to implicit field and Screen-Space Occlusion-Aware Appearance Blending to help image blending from source views. A dataset GeneBody is constructed to demonstrate the effectness of the proposed algorithm.
    >> Project Page

  • Renderme-360

    Renderme-360

    RenderMe-360 is a comprehensive 4D human head dataset to drive advance in head avatar research which contains massive data assets with high-fidelity, high deversity and rich annotation attributions. A comprehensive benchmark for head avatar research, with 16 state-of-the-art methods performed on five main tasks which opens the door for future exploration in head avatars.
    >> Project Page >> OpenXDLab

  • MonoHuman

    MonoHuman

    MonoHuman, which robustly renders view-consistent and high-fidelity avatars under arbitrary novel poses from monocular videos. The key insight is to model the deformation field with bi-directional constraints and explicitly leverage the off-the-peg keyframe information to reason the feature correlations for coherent results. Extensive experiments demonstrate the superiority of our proposed MonoHuman over state-of-the-art methods.
    >> Project Page

Resume

Education

  1. M.Phil, Hong Kong University of Science and Technology

    Thesis: Human Reconstruction and Motion Capture using a Single Flying Camera
    pdf, e-print

  2. B.Eng., Huazhong University of Science and Technology

Publications

  1. * denotes equal contribution

  2. Wei Cheng, Ruixiang Chen*, Wanqi Yin*, Siming Fan*, Keyu Chen*, Honglin He, Huiwen Luo, Zhongang Cai, Jingbo Wang, Yang Gao, and others. 2023. DNA-Rendering: A Diverse Neural Actor Repository for High-Fidelity Human-centric Rendering. In ICCV 2023.

    arXiv, project page, video, code

  3. Dongwei Pan, Long Zhuo*, Jingtan* Piao*, Huiwen Luo*, Wei Cheng*, Yuxin Wang*, Siming Fan, Shengqi Liu, Lei Yang, Bo Dai, and others. RenderMe-360: A Large Digital Asset Library and Benchmarks Towards High-fidelity Head Avatars. In NeurIPS 2023 Dataset and Benchmark Track.

    arXiv, project page, video, code

  4. Wei Cheng, Su Xu, Jingtan Piao, Chen Qian, Wayne Wu, Kwan-Yee Lin, and Hongsheng Li. Generalizable neural performer: Learning robust radiance fields for human novel view synthesis. In arXiv preprint 2022.

    arXiv, project page, video, code

  5. Zhengming Yu, Wei Cheng, Xian Liu, Wayne Wu, and Kwan-Yee Lin. MonoHuman: Animatable Human Neural Field from Monocular Video. In CVPR 2023.

    arXiv, project page, video, code

  6. Lan Xu, Wei Cheng, Kaiwen Guo, Lei Han, Yebin Liu, and Lu Fang. Flyfusion: Realtime dynamic scene reconstruction using a flying depth camera. TVCG 2019.

    paper, video

  7. Wei Cheng*, Lan Xu*, Lei Han, Yuanfang Guo, and Lu Fang. 2018. ihuman3d: Intelligent human body 3d reconstruction using a single flying camera. In ACMMM 2018.

    paper, video

  8. Lan Xu, Yebin Liu, Wei Cheng, Kaiwen Guo, Guyue Zhou, Qionghai Dai, and Lu Fang. Flycap: Markerless motion capture using multiple autonomous flying cameras.TVCG 2017

    paper