Novel interpretable mechanism of neural networks based on network decoupling method |
| |
Authors: | Dongli DUAN Xixi WU Shubin SI |
| |
Affiliation: | 1. School of Information and Control Engineering, Xi’an University of Architecture and Technology, Xi’an 710311, China2. Ministry of Industry and Information Technology Key Laboratory of Industrial Engineering and Intelligent Manufacturing, Northwestern Polytechnical University, Xi’an 710072, China; School of Mechanical Engineering, Northwestern Polytechnical University, Xi’an 710072, China |
| |
Abstract: | The lack of interpretability of the neural network algorithm has become the bottleneck of its wide application. We propose a general mathematical framework, which couples the complex structure of the system with the nonlinear activation function to explore the decoupled dimension reduction method of high-dimensional system and reveal the calculation mechanism of the neural network. We apply our framework to some network models and a real system of the whole neuron map of Caenorhabditis elegans. Result shows that a simple linear mapping relationship exists between network structure and network behavior in the neural network with high-dimensional and nonlinear characteristics. Our simulation and theoretical results fully demonstrate this interesting phenomenon. Our new interpretation mechanism provides not only the potential mathematical calculation principle of neural network but also an effective way to accurately match and predict human brain or animal activities, which can further expand and enrich the interpretable mechanism of artificial neural network in the future. |
| |
Keywords: | neural networks interpretability dynamical behavior network decouple |
本文献已被 万方数据 等数据库收录! |
| 点击此处可从《工程管理前沿(英文版)》浏览原始摘要信息 |
|
点击此处可从《工程管理前沿(英文版)》下载全文 |
|