首页 | 本学科首页   官方微博 | 高级检索  
     

结合注意力与局部特征融合的行人重识别算法
引用本文:陈林锋,雷景生,吴宏毅,朱陈思聪,叶仕超.结合注意力与局部特征融合的行人重识别算法[J].计算机工程与应用,2022,58(14):282-290.
作者姓名:陈林锋  雷景生  吴宏毅  朱陈思聪  叶仕超
作者单位:浙江科技学院 信息与电子工程学院,杭州 310000
摘    要:行人重识别是指从一堆候选图片中找到与目标最相似的行人图片,本质上是一个图像检索的子问题。为了进一步增强网络提取关键特征的能力以及抑制噪声的干扰,通过对基于注意力机制和局部特征的行人重识别算法的研究,提出了结合注意力与局部特征融合的行人重识别算法。该算法将ResNeSt-50作为骨干网络,联合软注意力与非局部注意力机制,采用双流结构分别提取行人细粒度全局特征和细粒度局部特征,通过关注不同特征之间共享的空间域信息以及同一特征不同水平区域的潜在语义相关性,创建了空间感知特征融合模块(spatial-aware feature fusion module)以及跨区域特征融合模块(cross-region feature fusion module)。在Market-1501、DukeMTMC-reID以及CUHK03数据集上的实验结果表明该算法极大程度上提升了网络的检索能力,同时与现有算法进行比较,凸显出优越性能。

关 键 词:注意力机制  行人重识别  图像检索  特征融合  神经网络  

Person Re-Identification Algorithm Combining Attention and Local Feature Fusion
CHEN Linfeng,LEI Jingsheng,WU Hongyi,ZHUCHEN Sicong,YE Shichao.Person Re-Identification Algorithm Combining Attention and Local Feature Fusion[J].Computer Engineering and Applications,2022,58(14):282-290.
Authors:CHEN Linfeng  LEI Jingsheng  WU Hongyi  ZHUCHEN Sicong  YE Shichao
Affiliation:School of Information and Electronic Engineering, Zhejiang University of Science and Technology, Hangzhou 310000, China
Abstract:Person re-identification refers to finding the pedestrian image most similar to the target from a bunch of candidate pictures, which is a sub-problem of image retrieval. In order to further enhance feature extraction capabilities and suppress noise interference, through studying the person re-recognition algorithm based on attention mechanism and local features, this paper proposes a person re-recognition network combing attention and local features fusion. The network adopts ResNeSt-50 as the backbone network, and uses a dual-stream structure to extract fine-grained global features and fine-grained local features separately. By focusing on the spatial domain information shared by different features and the feature correlation between different horizontal parts, the spatial-aware feature fusion module and cross-region feature fusion module are proposed. On the Market-1501, DukeMTMC-reID and CUHK03 datasets, experimental results verify that the proposed network significantly improves the retrieval capabilities. And it has a superior performance in comparison with existing algorithms.
Keywords:attention mechanism  person re-identification  image retrieval  feature fusion  neural network  
点击此处可从《计算机工程与应用》浏览原始摘要信息
点击此处可从《计算机工程与应用》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号