基于注意力机制的卷积神经网络可视化方法

相比于传统机器学习算法，卷积神经网络“端到端” 的黑盒特性使其内部工作机制缺乏透明性和可解释性，导致其在某些安全性要求较高的领域受到一定限制。为此，提出一种基于注意力机制的卷积神经网络可视化方法，用于可视化解释卷积神经网络中间层所学特征。该方法首先将注意力机制添加到网络结构中，跟随网络一起训练；然后，获取训练后模型的最高层特征图，并使用双线性插值将其放大到输入图像大小；最后，将处理后的特征图与输入图像叠加形成热力图，用于定位输入图像的关键区域，实现对卷积神经网络所学特征的理解和解释。在ＣＩＦＡＲ１０ 数据集上实验结果表明，相比于直接对特征图进行可视化，基于注意力机制的可视化方法能够更准确地定位目标的关键特征，从而帮助理解卷积神经网络所学特征。

Visualization Method of Convolutional Neural Network Based on Attention Mechanisn

Compared wpth traditional machine learning algorithms, the end-to-end black box natureof convolutional neural networks results in the lack of transparency and interpretability in the internalworking mechanism, leading to restrictions in certain areas with high security requirements. To thisend, this paper proposes a visualization method of convolutional neural network based on attentionchanism, which is used to visually explain the feature representation learned by the middle layerof convolutional neural network. First. this method adds the attention mechanism to the networkstructure and makes it train with the network. Then, the last layer feature map of the trained modelis obtained and the bilinear interpolation is used to enlarge it to the input image size. Finally, theprocessed feature map is superimposed with the input image to form a final heatmap, which is usedto locate the key area of the input image and realize the understanding and interpretation of the fea-tures learned by the convolutional neural network. Experimental results on CIFAR10 dataset showhat, compared to directly visualizing the feature map, the visualization method based on the atten-tion mechanism can accurately locate the key features of the object, thus helping understand thelearned features of the convolutional neural network