首页 | 本学科首页   官方微博 | 高级检索  
     

面向虚拟化身的人脸表情模拟技术
引用本文:姚世明,李维浩,李蔚清,苏智勇. 面向虚拟化身的人脸表情模拟技术[J]. 图学学报, 2019, 40(3): 525. DOI: 10.11996/JG.j.2095-302X.2019030525
作者姓名:姚世明  李维浩  李蔚清  苏智勇
作者单位:南京理工大学自动化学院,江苏南京,210094;南京理工大学计算机科学与工程学院,江苏南京,210094
基金项目:“十三五”装备预研项目(315100104,41401010203);上海航天科技创新基金项目(SAST2018009)
摘    要:为了实现基于增强现实的电子沙盘环境中的异地可视化交互功能,提出了一种面 向虚拟化身的三维表情模拟技术。首先,使用 RGB 摄像头跟踪异地作业人员的表情,基于约 束局部模型(CLM)提取人脸特征点数据后传输到本地;然后,采用基于径向基函数的插值算法 计算虚拟化身面部网格点的坐标,驱动模型模拟出与异地作业人员相同的表情;最后,为了提 高变形算法的精度和效率,提出一种基于贪心算法与人脸肌群分布的插值控制点选取和分区域 插值方法。实验结果表明,该算法能够满足实际应用对实时性和真实感的需求。

关 键 词:表情模拟  径向基函数  形变模型  肌肉模型

Facial Expression Simulation Technology for Virtual Avatar
YAO Shi-ming,LI Wei-hao,LI Wei-qing,SU Zhi-yong. Facial Expression Simulation Technology for Virtual Avatar[J]. Journal of Graphics, 2019, 40(3): 525. DOI: 10.11996/JG.j.2095-302X.2019030525
Authors:YAO Shi-ming  LI Wei-hao  LI Wei-qing  SU Zhi-yong
Affiliation:(1. School of Automation, Nanjing University of Science and Technology, Nanjing Jiangsu 210094, China;2. School of Computer Science and Engineering, Nanjing University of Science and Technology, Nanjing Jiangsu 210094, China)
Abstract:In order to realize the offsite visualization interaction function in the electronic sand table environment based on Augmented Reality, a 3D expression simulation technology for virtual avatar is proposed. First, the expressions of remote worker is tracked using a RGB camera, the face feature point data is extracted based on constrained local models (CLM) and the data is sent to local. The interpolation algorithm based on Radial Basis Function is used to calculate the coordinates of vertices of the virtual avatar face mesh, the model is driven to simulate the same facial expression with the other offsite worker; Finally, in order to improve the accuracy and efficiency of the deformation algorithm, a selection method of interpolation control points and a sub-region interpolation method based on the distribution of the human muscle group and the greedy algorithm are proposed, The experimental results show that the algorithm can meet the real-time and realistic requirements of applications.
Keywords:expression simulation  radial basis function  deformation model  muscle mode  
本文献已被 万方数据 等数据库收录!
点击此处可从《图学学报》浏览原始摘要信息
点击此处可从《图学学报》下载免费的PDF全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号