Research direction:
3D Vision, Motion Capture, Depth Sensing
Education and Experience:
01/2022 – Present, Assistant/Associate Researcher atBNRist, Tsinghua University
12/2019 – 12/2021, Postdoc. at Department of Automation, Tsinghua University
10/2017 – 11/2019, Visiting Graduate Student, Department of Automation, Tsinghua University
06/2017 – 09/2017, Assistant Research Fellow, ICT, University of Southern California
09/2012 – 11/2019, Ph.D. Precision Instrument and Machinery, Beihang University
09/2008 – 07/2012, B.Eng. School of Instrumental Science and Optoelectronic Engineering, Hefei University of Technology
Representative Publications in past 3 years (# co-first author, *corresponding author):
1、Yitong Jin#; Zhiping Qiu#; Yi Shi; Shuangpeng Sun; Chongwu Wang; Donghao Pan; Jiachen Zhao; Zhenghao Liang; Yuan Wang; Xiaobing Li; Feng Yu;Tao Yu*and Qionghai Dai*; Audio Matters Too! Enhancing Markerless Motion Capture with Audio Signals for String Performance Capture, ACM Transaction on Graphics (TOG) & SIGGRAPH 2024.
2、Haoxiang Wang,Tao Yu*, Tianwei Yang, Hui Qiao* and Qionghai Dai; Neural Physical Simulation with Multi-Resolution Hash Grid Encoding. Proceedings of the AAAI Conference on Artificial Intelligence (AAAI 2024 Oral Presentation). 38, 6 (Mar. 2024), 5410-5418.
3、Peng Li; Jiayin Zhao; Jingyao Wu; Chao Deng; Yuqi Han; Haoqian Wang*andTao Yu*; OPAL: Occlusion Pattern Aware Loss for Unsupervised Light Field Disparity Estimation, IEEE Transactions on Pattern Analysis and Machine Intelligence (IEEE-TPAMI), 2023, 46(2): 681-694.
4、 Jiachen Zhao;Tao Yu*; Liang An; Yipeng Huang; Fang Deng; Qionghai Dai*; Triangulation Residual Loss for Data-efficient 3D Pose Estimation, Thirty-seventh Annual Conference on Neural Information Processing Systems (NeurIPS 2023), New Orleans.
5、Tao Yu; Zerong Zheng; Kaiwen Guo; Pengpeng Liu; Qionghai Dai and Yebin Liu; Function4D: Real-time Human Volumetric Capture from Very Sparse Consumer RGBD Sensors, 34th IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR 2021 Oral Presentation), Online Virtual Conference.
Research Focus:
My research area is 3D Vision: the intersection of Computer Vision, Computer Graphics, and Machine Learning. Currently, I’m focusing on Light/Radiance Field Reconstruction, involving the capture of scenes across different scales, from microscopic to macroscopic. Additionally, I explore Motion Capture, covering subjects ranging from humans (for digital content creation and the metaverse) to animals (for computational behavioral research). Notably, research outcomes have been formally licensed to several well-known companies and have been effectively integrated into industrial products.
Honors & Awards:
2022 Second Prize of Wu Wenjun Artificial Intelligence Science and Technology Progress Award