A Tradeoff Between Accuracy and Speed for K-Means Seed Determination

With a sharp increase in the information volume, analyzing and retrieving this vast data volume is much more essential than ever. One of the main techniques that would be beneficial in this regard is called the Clustering method. Clustering aims to classify objects so that all objects within a cluster have similar features while other objects in different clusters are as distinct as possible. One of the most widely used clustering algorithms with the well and approved performance in different applications is the k-means algorithm. The main problem of the k-means algorithm is its performance which can be directly affected by the selection in the primary clusters. Lack of attention to this crucial issue has consequences such as creating empty clusters and decreasing the convergence time. Besides, the selection of appropriate initial seeds can reduce the cluster’s inconsistency. In this paper, we present a new method to determine the initial seeds of the k-mean algorithm to improve the accuracy and decrease the number of iterations of the algorithm. For this purpose, a new method is proposed considering the average distance between objects to determine the initial seeds. Our method attempts to provide a proper tradeoff between the accuracy and speed of the clustering algorithm. The experimental results showed that our proposed approach outperforms the Chithra with 1.7% and 2.1% in terms of clustering accuracy for Wine and Abalone detection data, respectively. Furthermore, achieved results indicate that comparing with the Reverse Nearest Neighbor (RNN) search approach, the proposed method has a higher convergence speed.     

基于主动学习的离群点集成挖掘方法研究

离群点检测任务通常缺少可用的标注数据，且离群数据只占整个数据集的很小一部分，相较于其他的数据挖掘任务，离群点检测的难度较大，尚没有单一的算法适合于所有的场景。因此，结合多样性模型集成和主动学习思想，提出了一种基于主动学习的离群点集成检测方法OMAL（Outlier Mining based on Active Learning）。在主动学习框架指导下，根据各种基学习器的对比分析，选择了基于统计的、基于相似性的、基于子空间划分的三个无监督模型作为基学习器。将各基学习器评判的处于离群和正常边界的数据整合后呈现给人类专家进行标注，以最大化人类专家反馈的信息量；从标注的数据集和各基学习器投票产生的数据集中抽样，基于GBM（Gradient BoostingMachine）训练一个有监督二元分类模型，并将该模型应用于全数据集，得出最终的挖掘结果。实验表明，提出方法的AUC有了较为明显的提升，且具有良好的运行效率，具备较好的实用价值。     

丁烷氧化反应器装置数据分析与优化

基于丁烷氧化反应器的实际装置数据，经预处理后，采用主成分分析进行数据挖掘。结果表明，可利用该方法来筛选及判断异常数据点，从而可用于反应器状态的实时诊断和预警，同时对反应器输入和输出参数之间的相关性进行分析，理解和把握参数之间的变化特征，发现丁烷转化率与反应器出口的CO/CO2比值呈负相关，体现主反应和副反应的选择性问题，从而可用于指导反应器操作优化等。     

一种基于异常值检测和群体智能优化神经网络的电价混合预测模型

为了提高短期电价预测精度,本文提出了一种将异常值检测、时间序列分析、神经网络以及群体智能算法相结合的混合算法。作为混合算法的具体实现,文中的异常值检测利用了残差比方法和正态分布方法,群体智能优化算法选取了粒子群(PSO)算法和布谷鸟(CS)算法。作为实例研究,本文将混合模型应用用于澳大利亚新南威尔士州短期电价预测中,结果表明,混合预测方法能在一定程度上提高模型的预测精度。     

曲线光顺在惯导平台自标定中的应用

提出了一种新的惯导平台自标定数据处理方法——曲线光顺法。根据自标定数据特点给出了适于自标定数据的曲线光顺准则。分析了野值对曲线二阶差商的影响规律,提出了一种野值剔除算法。通过将最小二乘与B样条结合得出二阶差商参考值,并使实际差商与参考差商距离达到最小从而得到野值修改值。实验结果表明,该文的算法能很好地解决惯导平台自标定数据的野值剔除问题,可通过调节参数来控制光顺精度,并具有算法简便、易于操作的优点。     

雷达探测数据野值剔除方法

为提升雷达探测精度评估中雷达探测导弹目标数据的质量,提出基于滑窗的均值和中值剔除法,并将其 与基于滑窗的多项式拟合法和模板卷积法进行对比分析。通过以3 倍的均方误差作为门限,设置合适的窗口长度, 选取基于窗口滑动的均值或中值剔除法。测试结果表明：2 种方法均可更有效地剔除雷达探测导弹目标数据中的野 值,为后续弹道还原和数据评估提供了有效支撑。     

Outlier accommodation in moving-horizon state estimation: A risk-averse performance-specified approach

This paper presents a novel state estimation approach for linear dynamic systems when measurements are corrupted by outliers. Since outliers can degrade the performance of state estimation, outlier accommodation is critical. The standard approach combines outlier detection utilizing Neyman-Pearson (NP) type tests with a Kalman filter (KF). This approach ignores all residuals greater than a designer-specified threshold. When measurements with outliers are used (ie, missed detections), both the state estimate and the error covariance matrix become corrupted. This corrupted state and covariance estimate are then the basis for all subsequent outlier decisions. When valid measurements are rejected (ie, false alarms), potentially using the corrupted state estimate and error covariance, measurement information is lost. Either using invalid information or discarding too much valid information can result in divergence of the KF. An alternative approach is moving-horizon (MH) state estimation, which maintains all recent measurement data within a moving window with a time horizon of length L. In MH approaches, the number of measurements available for state estimation is affected by both the number of measurements per time step and the number of time steps L over which measurements are retained. Risk-averse performance-specified (RAPS) state estimation works within an optimization setting to choose a set of measurements that achieves a performance specification with minimum risk of outlier inclusion. This paper derives and formulates the MH-RAPS solution for outlier accommodation. The paper also presents implementation results. The MH-RAPS application uses Global Navigation Satellite Systems measurements to estimate the state of a moving platform using a position, velocity, and acceleration model. In this application, MH-RAPS performance is compared with MH-NP state estimation.     

某金矿样品分析用管理样的制备与应用

通过对管理样的采集、制备、测试、数据处理与分析、定值等几个步骤得到某主要测量Au、Ag、Pb、Zn四个元素的某金矿样品分析用管理样相应Au、Ag、Pb、Zn的准确值。用于含量与成分相似的金矿样品分析过程的质量控制,通过管理样的分析情况以检查整个分析过程的质量。     

基于MCD稳健统计分析的变压器油色谱异常值检测及分布特性

由于人为因素以及现场干扰的影响,变压器油色谱在线监测数据在测量和传输中会不可避免地出现偏误,导致异常数据值,使得经典统计方法的结果出现偏差甚至错误。为了解决上述问题,基于稳健统计理论,根据油色谱监测数据异常值的特点,提出了油色谱H2、CO和总烃3类特征气体异常值的最小协方差行列式MCD稳健多元检测方法。利用迭代和Mahalanobis距离的思想构造一个稳健的协方差估计量,并进行异常值检测,然后再将异常数据和正常数据分类处理。针对H2、CO和总烃这3类特征气体的实例统计分析表明,异常值剔除后可有效减少这3种气体的测量值对经典统计方法的干扰,使得油色谱数据的统计规律更加明显。通过对异常值区间的跟踪评估,还可更加明显地反映变压器运行状态的变化。     

地震事件实时检测中野值的辨识与替代

对地震事件做出快速而准确的判定是地震预警的关键技术,然而背景噪声中的干扰信号可能导致地震事件的误判.结合STA/LTA方法的特点,提出一种基于短时间窗的野值辨识与替代方法.该方法具有野值辨识准确,替代值能够较好保持信号原有的变化趋势的特点.经仿真分析和地震事件波形检验,该方法能有效消除脉冲干扰,对短时连续干扰也有一定弱...