多类运动想象脑电信号的两级特征提取方法

共同空间模式（Common spatial pattern,CSP）是运动想象脑机接口（Brain-computer interface,BCI）中常用的特征提取方法,但对多类任务的分类正确率却明显低于两类任务.通过引入堆叠降噪自动编码器（Stacked denoising autoencoders,SDA）,提出了一种多类运动想象脑电信号（Electroencephalogram,EEG）的两级特征提取方法.首先利用一对多CSP（One versus rest CSP,OVR-CSP）将脑电信号变换到使信号方差区别最大的低维空间,然后通过SDA网络提取其中可以更好表达类别属性的高层抽象特征,最后使用Softmax分类器进行分类.在对BCI竞赛IV中Data-sets 2a的4类运动想象任务进行的分类实验中,平均Kappa系数达到0.69,表明了所提出的特征提取方法的有效性和鲁棒性.     

Tibetan Sentiment Classification Method Based on Semi-Supervised Recursive Autoencoders

We apply the semi-supervised recursive autoencoders (RAE) model for the sentiment classification task of Tibetan short text, and we obtain a better classification effect. The input of the semi-supervised RAE model is the word vector. We crawled a large amount of Tibetan text from the Internet, got Tibetan word vectors by using Word2vec, and verified its validity through simple experiments. The values of parameter α and word vector dimension are important to the model effect. The experiment results indicate that when α is 0.3 and the word vector dimension is 60, the model works best. Our experiment also shows the effectiveness of the semi-supervised RAE model for Tibetan sentiment classification task and suggests the validity of the Tibetan word vectors we trained.     

Threaded ensembles of autoencoders for stream learning

Anomaly detection in streaming data is an important problem in numerous application domains. Most existing model‐based approaches to stream learning are based on decision trees due to their fast construction speed. This paper introduces streaming autoencoder (SA), a fast and novel anomaly detection algorithm based on ensembles of neural networks for evolving data streams. It is a one‐class learner, which only requires data from the positive class for training and is accurate even when anomalous training data are rare. It features an ensemble of threaded autoencoders with continuous learning capacity. Furthermore, the SA uses a 2‐step detection mechanism to ensure that real anomalies are detected with low false‐positive rates. The method is highly efficient because it processes data streams in parallel with multithreads and alternating buffers. Our analysis shows that SA has a linear runtime and requires constant memory space. Empirical comparisons to the state‐of‐the‐art methods on multiple benchmark data sets demonstrate that the proposed method detects anomalies efficiently with fewer false alarms.     

A Survey of Autoencoder Algorithms to Pave the Diagnosis of Rare Diseases

Rare diseases (RDs) concern a broad range of disorders and can result from various origins. For a long time, the scientific community was unaware of RDs. Impressive progress has already been made for certain RDs; however, due to the lack of sufficient knowledge, many patients are not diagnosed. Nowadays, the advances in high-throughput sequencing technologies such as whole genome sequencing, single-cell and others, have boosted the understanding of RDs. To extract biological meaning using the data generated by these methods, different analysis techniques have been proposed, including machine learning algorithms. These methods have recently proven to be valuable in the medical field. Among such approaches, unsupervised learning methods via neural networks including autoencoders (AEs) or variational autoencoders (VAEs) have shown promising performances with applications on various type of data and in different contexts, from cancer to healthy patient tissues. In this review, we discuss how AEs and VAEs have been used in biomedical settings. Specifically, we discuss their current applications and the improvements achieved in diagnostic and survival of patients. We focus on the applications in the field of RDs, and we discuss how the employment of AEs and VAEs would enhance RD understanding and diagnosis.     

基于深度学习的视觉SLAM闭环检测方法

针对在摄像机视角、光照、气候、地貌等条件的大 幅度变化或者存在快速移动物体的 复杂场景下,视觉即时定位与地图构建(simultaneous localization and mapping,SLAM)的精确性和鲁棒性较低等问题,闭环检 测作为解决SLAM位姿漂移的重要环节,提出了一种基于神经网络的闭环检测方法。该方 法通过传感器获取视觉图像的数据,不同于传统方法的特征提取,采用改进三重约束损 失函数训练Darknet提取图像特征,构造对应特征向量矩阵。由于Darknet借鉴了残差网络(resnet)的思想,在具有较深网络层数的同时,仍保持较高的准确率,减少了特征提取 误差。经过自编码器方法对数据进行降维处理,通过余弦相似度计算,设定合理阈值,能够 更快的得到闭环检测结果。最后通过在两个公开视觉SLAM闭环检测数据集,New College数 据集和光照及角度变化更明显的City Centre数据集上进行实验,结果表明复杂环境下本文 提出的方法比现有闭环检测方法,能够得到更高准确率和速率,更好满足了视觉SLAM系统对 消除累计误差和实时性的要求。     

基于堆叠降噪自编码器的配电数据清洗方法

准确高效的异常数据识别与缺失数据恢复是电力网络稳定运行的基础。提出了一种配网网络状态监测异常数据清洗方法。首先,利用堆叠降噪自编码器(SDAE)学习正常数据和异常数据特征,去除噪声后获取损失函数曲线。然后,采用Bootstrap方法估计置信区间,设置异常数据识别门限,通过多分类支持向量机完成异常类型识别。最后,针对缺失数据,设计了Pearson相关系数进行插补恢复。实验结果表明,该方法能够有效识别配电网络异常数据类型,且缺失数据恢复性能优于现有方法。     

基于降噪自动编码器的推荐算法

传统的推荐算法一般采用用户项目评分矩阵学习潜在因素,了解用户的个人偏好并作出推荐,但在实际应用中,评分矩阵通常非常稀疏。针对传统推荐算法的不足,提出一种基于降噪自动编码器的推荐模型。首先用2个自动编码器来训练用户和项目的潜在因子矩阵,然后将学习到的隐含特征向量输入一神经网络来进行评分预测,最后根据新的评分矩阵作出推荐。实验结果表明,该算法提高了推荐结果的召回率,同时缩小了重构误差。     

面向云计算应用的用电负荷数据差分隐私保护方法

随着云计算技术的发展,用户可以利用公共计算资源低成本、高效率地完成机器学习等大数据分析业务,但在提升计算效率和经济效益的同时,也面临隐私泄露风险。针对以机器学习即服务为代表的云计算中潜藏的用电负荷数据泄露问题,提出了一种差分隐私保护框架下基于时序生成对抗网络的用电负荷数据脱敏方法,通过使用满足差分隐私的脱敏合成数据替代原始敏感数据,从而有效阻止攻击者根据窃取的训练数据推断真实的敏感信息。引入瑞利差分隐私机制,在保留负荷数据统计学特征的前提下去除个体特征;在此基础上,采用循环神经网络作为生成对抗网络的生成器和判别器,捕获负荷数据的动态时间特性;同时,将自编码器与生成对抗网络相结合,进一步挖掘负荷数据的静态特征。通过理论推导证明了所提方法能够满足差分隐私要求,且可以对总隐私预算进行量化。数值实验结果表明,所提方法能保证隐私保护处理后用电负荷数据的隐私性和可用性。     

一种基于降噪自编码器的人脸表情识别方法

针对传统人脸表情识别算法鲁棒性差,易受到人脸身份信息干扰的问题,本文在基于降噪自编码器的基础上,提出一种人脸表情识别算法。首先,从图片中检测出人脸部分,并进行尺度归一化处理;再构造堆栈式降噪自编码神经网络模型进行预训练;最后为了避免由训练样本不足容易造成的过拟合问题,在深度网络模型的全连接层采用了Dropout技术。实验结果在数据集CK 、JAFFE和Yale上均取得了较高的准确率,说明了该方法具有较强的鲁棒性和抗身份信息干扰的能力。     

基于自编码器及超图学习的多标签特征提取

在实际应用场景中越来越多的数据具有多标签的特性,且特征维度较高,包含大量冗余信息.为提高多标签数据挖掘的效率,多标签特征提取已经成为当前研究的热点.本文采用去噪自编码器获取多标签数据特征空间的鲁棒表达,在此基础上结合超图学习理论,融合多个标签对样本间几何关系的影响以提升特征提取的性能,构建多标签数据样本间几何关系所对应超图的Laplacian矩阵,并通过Laplacian矩阵的特征值分解得到低维投影空间.实验结果证明了本文所提出的算法在分类性能上是有效可行的.