首页 | 本学科首页   官方微博 | 高级检索  
     

一种耦合深度信念网络的图像识别方法
引用本文:马苗,许西丹,武杰.一种耦合深度信念网络的图像识别方法[J].西安电子科技大学学报,2018,45(5):102-107.
作者姓名:马苗  许西丹  武杰
作者单位:(1. 陕西师范大学 现代教育技术教育部重点实验室,陕西 西安 710119;2. 陕西师范大学 计算机科学学院,陕西 西安 710119)
基金项目:国家自然科学基金资助项目(61501286,61501287,61601274);陕西省自然科学基础研究计划资助项目(2017JM6065);中央高校基本科研业务费专项资金资助项目(GK201603083,GK201702015,GK201703054,GK201703058)
摘    要:针对网络层数增加带来的梯度消失问题,提出了一种耦合深度信念网络的图像识别方法.该方法将“跨层”连接引入到深度信念网络中并应用于图像识别.给出了耦合深度信念网络的结构示意图及其参数更新方法,并在相同数据集和网络层数情况下比较了具有最佳参数的深度信念网络与最佳参数的耦合深度信念网络的识别性能,分析了“跨层”连接中主、次线耦合比例对网络性能的影响,且与几种经典的深度学习方法进行了对比.实验结果显示,耦合深度信念网络在收敛速度与识别精度上均优于深度信念网络.同时,相比于经典的深度网络,文中所提方法获得了良好的识别性能.这说明采用“跨层”耦合方式可有效缓解深度信念网络训练过程中出现的梯度消失问题,提高网络的识别性能.

关 键 词:跨层连接  深度信念网络  深度学习  图像识别  
收稿时间:2017-11-01

Coupled-deep belief network based method for image recognition
MA Miao,XU Xidan,WU Jie.Coupled-deep belief network based method for image recognition[J].Journal of Xidian University,2018,45(5):102-107.
Authors:MA Miao  XU Xidan  WU Jie
Affiliation:(1. Key Lab. of Modern Teaching Technology, Ministry of Education, Shaanxi Normal Univ.,Xi'an 710119, China; 2. School of Computer Science, Shaanxi Normal Univ., Xi'an 710119, China)
Abstract:Aiming at the gradient vanishing problem caused by the increasing number of network layers, an image recognition method based on the Coupled-Deep Belief Network (C-DBN) is proposed, which introduces the cross-layer linkage to the Deep Belief Network (DBN). The structure and the parameter updating method for the C-DBN are given in detail, while the performance of the DBN and that of the C-DBN are compared with respect to their respective best parameters and the same net-depth on two image datasets. Moreover, the impact of the weights used in the coupling between the primary line and the secondary line is analyzed at the cross-layer linkage. Besides, several classic deep learning based methods are compared with the proposed C-DBN. Experimental results show that the C-DBN is superior to the DBN in terms of convergence speed and accuracy. And, a good performance is achieved by the proposed method in comparison with some classical deep learning methods. This means that the usage of cross-layer linkage can alleviate the gradient vanishing problems effectively in the DBN training, which helps to improve the following recognition performance.
Keywords:cross-layer linkage  deep belief network  deep learning  image recognition  
点击此处可从《西安电子科技大学学报》浏览原始摘要信息
点击此处可从《西安电子科技大学学报》下载全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号