Current Issue Cover
基于MPEG-4的人脸表情图像变形研究

戴振龙1, 朱海一1, 张申1, 贾珈1, 蔡莲红1(清华大学计算机系,北京 100084)

摘 要
为了实时地生成自然真实的人脸表情,提出了一种基于MPEG-4人脸动画框架的人脸表情图像变形方法。该方法首先采用face alignment工具提取人脸照片中的88个特征点;接着在此基础上,对标准人脸网格进行校准变形,以进一步生成特定人脸的三角网格;然后根据人脸动画参数(FAP)移动相应的面部关键特征点及其附近的关联特征点,并在移动过程中保证在多个FAP的作用下的人脸三角网格拓扑结构不变;最后对发生形变的所有三角网格区域通过仿射变换进行面部纹理填充,生成了由FAP所定义的人脸表情图像。该方法的输入是一张中性人脸照片和一组人脸动画参数,输出是对应的人脸表情图像。为了实现细微表情动作和虚拟说话人的合成,还设计了一种眼神表情动作和口内细节纹理的生成算法。基于5分制(MOS)的主观评测实验表明,利用该人脸图像变形方法生成的表情脸像自然度得分为3.67。虚拟说话人合成的实验表明,该方法具有很好的实时性,在普通PC机上的平均处理速度为66.67 fps,适用于实时的视频处理和人脸动画的生成。
关键词
MPEG-4 Based Facial Expression Image Morphing

()

Abstract
Human face morphing is the foundation of facial expression synthesis and talking avatar animation. In this paper, an MPEG-4 based method for human face morphing and expression synthesis is proposed. The method uses a picture of neutral human face and a group of face animation parameters (FAP)as input, and the output is a corresponding facial expression image. There are four stages: facial feature point extraction, mesh generation for specific human face, mesh points movement driven by FAPs, and face texture mapping. After these four stages, photos of various facial expressions are created. Novel algorithms are also implemented for eyeball movement and texture mapping inside the mouth. Perceptual evaluation shows that the face morphing method can synthesize realistic and natural facial expressions for various human face models of different genders, ages and races. Meanwhile, this method is real-time, so it can be used in the areas of video processing and facial animation.
Keywords

订阅号|日报