Current Issue Cover
基于图割及动态片结构的3维人脸多视图体重建

朱云峰1,2, 章毓晋1,2, 何永健3,4(1.清华大学清华信息科学与技术国家实验室,北京 100084;2.清华大学电子工程系,北京 100084;3.西安通信学院,西安 710106;4.西安交通大学人工智能与机器人研究所,西安 710049)

摘 要
针对3维人脸重建问题提出了一种新颖的多视图体重建方法,以解决目前3维人脸重建方法只适用于小样本集合,大范围推广时精度难以保证的弱点。该方法创新之处在于将基于特征点匹配的重建方法与立体重建方法结合引入到图割优化框架,并应用于3维人脸重建。本文两个重要改进工作是设计动态片结构描述来进行颜色一致性估计以及设计新的动态图结构以去除半个体素尺寸的重建误差。实验中分别采用8张、16张和30张存在亮度变化的人脸多视角图像验证算法。实验结果逼真,同时避免了传统重建方法结果受限于样本集分布的问题。
关键词
Multi-view stereo reconstruction of volumetric human face via graph-cuts and dynamic patch structure

Zhu Yunfeng1,2, Zhang Yujin1,2, He Yongjian3,4(1.Tsinghua National Laboratory for Information Science and Technology,Tsinghua University,Beijing 100084;2.Department of Electronic Engineering,Tsinghua University,Beijing 100084;3.Xi’an Communication Institute,Xi’an 710106;4.Institute of Artificial Intrlligence and Robotics,Xi’an Jiaotong University,Xi’an 710049)

Abstract
In this paper, a novel approach is proposed to reconstruct human face model from multi-view images with volumetric scene representation. This method focuses on improving the reconstruction results without the limit of the representative ability of 3D facial model samples. Our main contribution is to combine feature points based reconstruction and volumetric based reconstruction into the framework of Graph Cuts when applying facial reconstruction. Two considerations contribute to the improvement of final results. First, a dynamic patch based photo consistency estimation is designed to get the value of the photo-consistency constrain. Second, a dynamic weighted graph is constructed in order to avoid half voxel size error. We evaluate the performance on a real dataset, in which multi-view face images (8, 16, about 30) are captured by moving digital camera under changed illumination. The results indicate our approach have significant improvements.
Keywords

订阅号|日报