首页 | 本学科首页   官方微博 | 高级检索  
     

基于点积自注意力卷积神经网络的歌声检测
引用本文:桂文明,曾岳,臧娴. 基于点积自注意力卷积神经网络的歌声检测[J]. 信号处理, 2021, 37(10): 1899-1906. DOI: 10.16798/j.issn.1003-0530.2021.10.013
作者姓名:桂文明  曾岳  臧娴
作者单位:金陵科技学院软件工程学院
基金项目:国家自然科学基金(61872199); 南京邮电大学宽带无线通信与传感网技术教育部重点实验室开放研究基金资助(201908);江苏省教育厅高校优秀中青年教师和校长境外研修项目(2018191)
摘    要:传统的歌声检测过程往往包含了复杂的特征工程,而基于深度神经网络统一框架的算法则可以利用其强大的学习能力学习到特征,从而忽略特征工程。但是,这些学习到的特征通常得不到重要性区分,在网络中所占权重相同。针对这一问题,提出在卷积神经网络中嵌入点积自注意力模块的算法,该算法通过学习得到各个特征的注意力分布,调整注意力权重,使得卷积神经元在“观察”这些特征时能区分轻重,从而提升网络的整体性能。在实验部分,通过在两个公开数据集下测试,并和基准模型进行对比,证明了该算法对提升歌声检测水平切实有效。 

关 键 词:歌声检测   卷积神经网络   余弦注意力   点积自注意力
收稿时间:2021-08-18

Singing voice detection algorithm based on a scaled dot-product attention embedded convolutional neural network
Affiliation:School of Software Engineering, Jinling Institute of TechnologyKey Lab of Broadband Wireless Communication and Sensor Network Technology (Nanjing University of Posts and Telecommunications), Ministry of Education
Abstract:The complicated feature engineering usually plays a significantly important role in the conventional singing voice detection algorithm, while it could be neglected in those algorithms based on the deep neural network because they can learn the features through their strong learning capability. However, the learned features are treated equally in the network despite their different importance for the result. To address this problem, a scaled dot-product attention embedded convolutional neural network was proposed, in which attention distribution for the feature maps was achieved by learning, and then the weights of the feature maps were adjusted so that the convolutional neurons could distinctively “observe” the features in terms of importance, resulting in the overall performance improvements. In the experimental section, compared to the base line model, with the experiments on the two public datasets, the results proved the effectiveness of this algorithm. 
Keywords:
点击此处可从《信号处理》浏览原始摘要信息
点击此处可从《信号处理》下载免费的PDF全文
设为首页 | 免责声明 | 关于勤云 | 加入收藏

Copyright©北京勤云科技发展有限公司  京ICP备09084417号