| 部位级遮挡感知的人体姿态估计 |
| |
| 引用本文： | 褚真, 米庆, 马伟, 徐士彪, 张晓鹏. 部位级遮挡感知的人体姿态估计[J]. 计算机研究与发展, 2022, 59(12): 2760-2769. DOI: 10.7544/issn1000-1239.20210723 |
| |
| 作者姓名： | 褚真 米庆 马伟 徐士彪 张晓鹏 |
| |
| 作者单位： | 北京工业大学信息学部,北京 100124;北京邮电大学人工智能学院,北京 100876;模式识别国家重点实验室(中国科学院自动化研究所),北京 100190 |
| |
| 基金项目： | 国家自然科学基金项目(61771026，62176010)；北京市教委重点项目(KZ201910005008) |
| |
| 摘 要： | 随着深度学习的快速发展，人体姿态估计技术近年来取得显著进步，但是现有方法仍难以较好地处理普遍存在的遮挡问题.针对此问题，提出一种部位级遮挡感知的人体姿态估计方法.首先，采用基准人体姿态估计网络从含遮挡噪声的图像中获得各人体部位的带噪声特征表达.然后，通过遮挡部位预测模块估计人体被遮挡部位，从而获得可见性向量.遮挡部位预测模块由遮挡部位分类网络和可见性编码器组成，前者预测关节点的遮挡状态，后者利用注意力机制将遮挡状态转换为一组权重.最后，通过通道重加权方式融合可见性向量和带噪声特征，获得部位级遮挡感知的人体部位相关特征，用于计算关节点热图.在MPII和LSP(leeds sports pose)数据集上的实验结果表明，相比基准姿态估计网络，该方法能够在较小的额外计算代价下更好地应对遮挡问题,并且取得了比目前先进方法更佳的结果.
|
| 关 键 词： | 人体姿态估计 人体关节点检测 遮挡推理 通道注意力机制 多任务学习 |
Part-Level Occlusion-Aware Human Pose Estimation |
| |
| Chu Zhen, Mi Qing, Ma Wei, Xu Shibiao, Zhang Xiaopeng. Part-Level Occlusion-Aware Human Pose Estimation[J]. Journal of Computer Research and Development, 2022, 59(12): 2760-2769. DOI: 10.7544/issn1000-1239.20210723 |
| |
| Authors: | Chu Zhen Mi Qing Ma Wei Xu Shibiao Zhang Xiaopeng |
| |
| Affiliation: | 1.1(Faculty of Information Technology, Beijing University of Technology, Beijing 100124);2.2(Artificial Intelligence School, Beijing University of Posts and Telecommunications, Beijing 100876);3.3(National Laboratory of Pattern Recognition (Institute of Automation, Chinese Academy of Sciences), Beijing 100190) |
| |
| Abstract: | With the rapid development of deep learning, human pose estimation technology has made remarkable progress in recent years, but the existing methods are still difficult to deal with the common occlusion problem. To address this problem, a human pose estimation method based on keypoint-level occlusion inference is proposed in this paper. Firstly, a baseline human pose estimation network is used to obtain the noisy representation of each keypoint of human body from images with occlusion noises. Then, the occluded keypoints are estimated through the occlusion part prediction module to obtain the visibility vector. The occlusion part prediction module is proposed in this study, which consists of two submodules: occlusion part classification network and visibility encoder. The occlusion part classification network predicts the occlusion state of each keypoint of the human body. Based on the channel attention mechanism, the visibility encoder converts the predicted occlusion state into a set of weight parameters. Finally, the visibility vector and noise features are fused by channel re-weighting method to obtain the keypoint-level occlusion aware features, which are used to calculate the heatmaps of the keypoints. Experimental results on MPII and LSP(leeds sports pose) datasets show that, compared with the baseline human pose estimation network, the proposed method can better deal with the occlusion problem at a small extra computational cost, and achieve better results than existing state-of-the-art methods. |
| |
| Keywords: | human pose estimation human keypoint detection occlusion inference channel attention mechanism multi-task learning |
| 本文献已被 万方数据 等数据库收录！ |
| 点击此处可从《计算机研究与发展》浏览原始摘要信息 |
|
点击此处可从《计算机研究与发展》下载全文 |
|
