A Framework for Interactive t-SNE Clustering

In this paper, we describe our progress in creating the framework for an interactive application that allows humans to actively participate in a t-SNE clustering process. t-SNE (t-Distributed Stochastic Neighbor Embedding) is a dimensionality reduction technique that maps high dimensional data sets to lower dimensions that can then be visualized for human interpretation. By prompting users to monitor outlying points during the t-SNE clustering process, we hypothesize that users may be able to make clustering faster and more accurate than purely algorithmic methods. Further research would test these hypotheses directly. We would also attempt to decrease the lag time between the various components of our application and develop an intuitive approach for humans to aid in clustering unlabeled data. Research into human assisted clustering can combine the strengths of both humans and computer programs to improve the results of data analysis.     

基于t-SNE降维预处理的网络流量异常检测

网络流量中大多数流量都是正常的,但经常会出现偏离正常范围的异常流量,主要由DDOS攻击、渗透攻击等恶意的网络行为引起,这些异常行为通常会导致网络质量下降,甚至网络直接瘫痪。因此引入网络安全态势的预测,在仅知道正常网络流量的情况下判断网络中的异常。异常检测是一种网络安全态势的预测方法,用来判断网络中是否有异常。现有的异常检测算法由于无法准确提取网络数据包的低维特征导致算法的性能不佳,因此,需要找到网络数据包的准确的低维特征表示,该低维特征表示能够区分网络数据包是正常的还是有攻击的。为此,本文引入基于t-SNE降维的NLOF异常检测算法。该算法采用t-SNE算法自动预处理网络数据包以获得低维的网络数据包特征,之后将得到的低维的网络数据包特征作为NLOF算法的输入进行异常检测。其中,本文的NLOF算法首先采用k-means算法将网络数据包聚类成为K个簇,并将网络数据包数量小于N个的簇标记为异常簇,之后将未被标记为异常簇的网络数据包作为LOF算法的输入进行异常检测。在ISCX2012数据集上的实验结果表明,基于t-SNE降维的LOF算法达到最优性能时,准确率为98.46%,精确度为98.38%,检测率为98.54%,FAR为0.66%。该算法比基于现有最新算法的准确率、检测率和F1分别高3.18个百分点、0.02个百分点和0.01个百分点。基于t-SNE降维的NLOF算法达到最优性能时,准确率为98.53%,精确度为98.86%,检测率为98.86%,FAR为0.32%。该算法比基于现有最新算法的准确率、检测率和F1分别高3.25个百分点、0.34个百分点和0.41个百分点。这是异常检测中首次采用t-SNE算法自动提取低维的网络数据包特征。此外,LOF算法仅能捕获异常点,而本文的NLOF算法能够同时捕获异常点和异常簇。     

Review: Heart Diseases Detection by Machine Learning Classification Algorithms

Most human deaths are caused by heart diseases. Such diseases cannot be efficiently detected for the lack of specialized knowledge and experience. Data science is important in healthcare sector for the role it plays in bulk data processing. Machine learning (ML) also plays a significant part in disease prediction and decision-making in medical care industry. This study reviews and evaluates the ML approaches applied in heart disease detection. The primary goal is to find mathematically effective ML algorithm to predict heart diseases more accurately. Various ML approaches including Logistic Regression, Support Vector Machine (SVM), k-Nearest Neighbor (k-NN), t-Distributed Stochastic Neighbor Embedding (t-SNE), Nave Bayes, and Random Forest were utilized to process heart disease dataset and extract the unknown patterns of heart disease detection. An analysis was conducted on their performance to examine the effecacy and efficiency. The results show that Random Forest out-performed other ML algorithms with an accuracy of 97%.     

A multi-step progressive fault diagnosis method for rolling element bearing based on energy entropy theory and hybrid ensemble auto-encoder

It is meaningful to efficiently identify the health status of bearing and automatically learn the effective features from the original vibration signals. In this paper, a multi-step progressive method based on energy entropy (EE) theory and hybrid ensemble auto-encoder (HEAE), systematically blending the statistical analysis approach with the deep learning technology, is proposed for rolling element bearing (REB) fault diagnosis. Firstly, a preliminary detection about the REB health status is performed by the statistical analysis technique integrated with the EE theory. Secondly, if fault exists in REB, a new HEAE is constructed based on denoising auto-encoder and contractive auto-encoder to strengthen the feature learning ability and automatically extract the deep state features from the raw data. Subsequently, a modified t-distributed stochastic neighbor embedding (M-tSNE) algorithm is developed to achieve the features reduction to further improve the diagnosis efficiency. Finally, the low-dimensional representations after features reduction are as the inputs of softmax classifier to recognize the fault conditions. The proposed method is applied to the fault diagnosis of REB. The results confirm the effectiveness and superiority of the proposed method, and it is more suitable for the actual engineering applications compared with other existing methods.     

改进的加权t-SNE算法及在故障诊断中的应用

对随机邻域嵌入算法(stochastic neighbor embedding, SNE)中的距离进行改进,提出一种基于Manhattan距离的加权t-SNE(Mwt-SNE)算法。使用受空间维数影响较小的Manhattan距离作为度量方式,使用k均值聚类算法将高维空间数据样本点距离分为三类,基于表格法进行权重参数寻优与加权,以加权相对Manhattan距离代替欧式绝对距离计算相似度条件概率,从而增大数据对象之间的区分度,提升降维效果,增强分类显著性。提出基于Mwt-SNE算法的在线故障诊断模型,使用核密度估计(KDE)确定控制限并进行在线监控。TE化工过程实验表明Mwt-SNE算法能有效降低误报率和漏报率,从而提高故障诊断稳定性和准确性。     

Deep Learning and Machine Learning for Early Detection of Stroke and Haemorrhage

Stroke and cerebral haemorrhage are the second leading causes of death in the world after ischaemic heart disease. In this work, a dataset containing medical, physiological and environmental tests for stroke was used to evaluate the efficacy of machine learning, deep learning and a hybrid technique between deep learning and machine learning on the Magnetic Resonance Imaging (MRI) dataset for cerebral haemorrhage. In the first dataset (medical records), two features, namely, diabetes and obesity, were created on the basis of the values of the corresponding features. The t-Distributed Stochastic Neighbour Embedding algorithm was applied to represent the high-dimensional dataset in a low-dimensional data space. Meanwhile,the Recursive Feature Elimination algorithm (RFE) was applied to rank the features according to priority and their correlation to the target feature and to remove the unimportant features. The features are fed into the various classification algorithms, namely, Support Vector Machine (SVM), K Nearest Neighbours (KNN), Decision Tree, Random Forest, and Multilayer Perceptron. All algorithms achieved superior results. The Random Forest algorithm achieved the best performance amongst the algorithms; it reached an overall accuracy of 99%. This algorithm classified stroke cases with Precision, Recall and F1 score of 98%, 100% and 99%, respectively. In the second dataset, the MRI image dataset was evaluated by using the AlexNet model and AlexNet + SVM hybrid technique. The hybrid model AlexNet + SVM performed is better than the AlexNet model; it reached accuracy, sensitivity, specificity and Area Under the Curve (AUC) of 99.9%, 100%, 99.80% and 99.86%, respectively.     

基于t-SNE与CFSFDP算法的多源局部放电脉冲分类技术

为解决在进行多源局部放电脉冲分类时因等效时频特征分布重叠而导致的脉冲无法有效分离的问题,提出一种基于t-SNE与CFSFDP算法的局部放电脉冲分类技术.该技术首先通过一种相位同步装置同时采集放电脉冲信号与其对应的相位信息,以单一放电脉冲的时频谱图作为对象,通过t-SNE算法对频谱数据进行降维,再对降维结果进行CFSFD...     

基于t-SNE降维和BIRCH聚类的单相用户相位及表箱辨识

低压台区单相用户的相位及接入表箱信息的准确性对户变关系纠错和线损治理分析有重要影响。目前,拓扑档案的校验主要依靠电力员工现场排查,人力物力消耗大且排查效率低下。因此,亟需一种效率较高的低压台区拓扑档案校验方法。在此背景下,文中提出了一种基于智能电表电压数据的低压台区单相用户相位及接入表箱辨识方法,可以为低压台区的拓扑辨识及排查提供参考。首先,采用t分布的随机近邻嵌入(t-SNE)技术对原始负荷数据进行降维处理,解决台区用户原始负荷特征维度过高带来的冗余性问题;接着,应用BIRCH方法对降维后的负荷数据进行聚类,实现台区下单相用户所属相位和接入表箱的辨识。最后,以浙江省海宁市某台区为例进行验证,算例分析的结果表明所提模型具有可行性和有效性。     

电力设备运行中监测数据库信息分析方法

针对电力设备运行过程中监测数据库管理分析能力落后、监测数据管理欠妥的问题,本文设计了一种新型的监测数据库管理分析系统,并设计出基于ARM Cortex-M0微处理器的硬件监测电路,通过压电传感器和电流振荡传感器实现系统对电力设备运行状态自动信息采集,构建出t-SNE算法模型。实验结果表明,本研究系统的准确度高达98%,运行耗能相对较低(在5%左右),可视化效果较好,动态监测预警能力较强。     

基于E-t-SNE的混合属性数据降维可视化方法

针对传统的t分布随机近邻嵌入（t-SNE）算法只能处理单一属型数据,不能很好地处理混合属性数据的问题,提出一种扩展的t-SNE降维可视化算法E-t-SNE,用于处理混合属性数据。该方法引入信息熵概念来构建分类属性数据的距离矩阵,采用分类属性数据距离与数值属性数据欧式距离相结合的方式构建混合属性数据距离矩阵,将新的距离矩阵输入t-SNE算法对数据进行降维并在二维空间可视化展示。此外,为验证算法有效性,采用[k]近邻[(kNN)]算法对混合数据降维后的效果进行评价。通过在UCI数据集上的实验表明,该方法在处理混合属性数据方面,不仅具有较好的可视化能力,而且能有效地对不同类别的数据进行降维分簇,提升后续分类器的分类准确率。