Medical Data Clustering and Classification Using TLBO and Machine Learning Algorithms

This study aims to empirically analyze teaching-learning-based optimization (TLBO) and machine learning algorithms using k-means and fuzzy c-means (FCM) algorithms for their individual performance evaluation in terms of clustering and classification. In the first phase, the clustering (k-means and FCM) algorithms were employed independently and the clustering accuracy was evaluated using different computational measures. During the second phase, the non-clustered data obtained from the first phase were preprocessed with TLBO. TLBO was performed using k-means (TLBO-KM) and FCM (TLBO-FCM) (TLBO-KM/FCM) algorithms. The objective function was determined by considering both minimization and maximization criteria. Non-clustered data obtained from the first phase were further utilized and fed as input for threshold optimization. Five benchmark datasets were considered from the University of California, Irvine (UCI) Machine Learning Repository for comparative study and experimentation. These are breast cancer Wisconsin (BCW), Pima Indians Diabetes, Heart-Statlog, Hepatitis, and Cleveland Heart Disease datasets. The combined average accuracy obtained collectively is approximately 99.4% in case of TLBO-KM and 98.6% in case of TLBO-FCM. This approach is also capable of finding the dominating attributes. The findings indicate that TLBO-KM/FCM, considering different computational measures, perform well on the non-clustered data where k-means and FCM, if employed independently, fail to provide significant results. Evaluating different feature sets, the TLBO-KM/FCM and SVM(GS) clearly outperformed all other classifiers in terms of sensitivity, specificity and accuracy. TLBO-KM/FCM attained the highest average sensitivity (98.7%), highest average specificity (98.4%) and highest average accuracy (99.4%) for 10-fold cross validation with different test data.     

有限元并行计算中网格自动分区的优化

针对集群系统下大规模有限元并行计算的特点,提出了优化多层次谱二分分区法。该方法对传统多层次谱二分分区方法的粗化、分区以及还原阶段的分区策略和算法进行了优化和调整,提出了顶点平衡策略以及平衡Kernighan-Li算法,弥补了传统谱二分法的缺陷,并应用该方法对不同几何类型的有限元模型进行了分区测试。测试结果表明,同传统分区方法相比,该方法的分区效果得到了明显改善。     

OLED显示屏表面缺陷自动检测方法

目的 为了解决OLED显示屏表面周期性纹理背景和缺陷边界模糊、对比度低的特征导致其表面缺陷检测困难的问题,开展OLED显示屏表面缺陷自动检测方法研究.方法 对OLED显示屏图像进行奇异值分解,选择前2个较大的奇异值重构图像纹理背景,对原图像和重构图像进行差分运算,获得残差图像.将残差图像像素随机赋予初始隶属度值,采用模糊C均值聚类法获得像素最终隶属度值.根据隶属度大小,将残差图像像素聚成2类,并从残差图像中准确地分割缺陷.结果 选取较大的2个奇异值可以有效地重构OLED显示屏的周期性纹理背景;模糊C均值聚类法分割缺陷获得的区域灰度一致性(U)平均值为0.9846.结论 基于奇异值分解的背景重构方法可以有效地检测OLED显示屏表面缺陷;与分水岭法和Otsu方法相比,模糊C均值聚类可以准确地分割模糊边界的缺陷区域.     

燃料电池汽车能量管理系统运用复合模糊逻辑控制的研究

合理分配不同动力源的输出功率是燃料电池汽车能量管理的重要环节。针对"燃料电池+蓄电池（FC+B）"混合动力汽车,提出一种用复合模糊逻辑控制的能量管理策略。该策略根据负载需求功率、蓄电池当前荷电状态（state of charge,SOC）以及目标区SOC动态调整功率分配。通过MATLAB/Simulink对所提出的复合模糊逻辑控制进行验证。仿真结果证明,当蓄电池SOC适中时（以H_SOC表示荷电状态值,当H_SOC=60%时）,SOC在复合模糊逻辑控制策略与功率追踪策略下变化基本相同,但前者的氢耗量减少0.54 g;当蓄电池初始SOC较低或较高时（分别以H_SOC=39.8%和H_SOC=80.2%为例）,相较于功率追踪策略,该策略使蓄电池SOC逐渐接近目标区。运用复合模糊逻辑控制可以降低混合动力系统的总能耗,提高系统的效率,控制更加灵活,具有一定的实用价值。     

Generating Type 2 Trapezoidal Fuzzy Membership Function Using Genetic Tuning

Fuzzy inference system (FIS) is a process of fuzzy logic reasoning to produce the output based on fuzzified inputs. The system starts with identifying input from data, applying the fuzziness to input using membership functions (MF), generating fuzzy rules for the fuzzy sets and obtaining the output. There are several types of input MFs which can be introduced in FIS, commonly chosen based on the type of real data, sensitivity of certain rule implied and computational limits. This paper focuses on the construction of interval type 2 (IT2) trapezoidal shape MF from fuzzy C Means (FCM) that is used for fuzzification process of mamdani FIS. In the process, upper MF (UMF) and lower MF (LMF) of the MF need to be identified to get the range of the footprint of uncertainty (FOU). This paper proposes Genetic tuning process, which is a part of genetic algorithm (GA), to adjust parameters in order to improve the behavior of existing system, especially to enhance the accuracy of the system model. This novel process is a hybrid approach which produces Genetic Fuzzy System (GFS) that helps to enhance fuzzy classification problems and performance. The approach provides a new method for the construction and tuning process of the IT2 MF, based on the FCM outcomes. The result is compared to Gaussian shape IT2 MF and trapezoid IT2 MF generated by the classic GA method. It is shown that the proposed approach is able to outperform the mentioned benchmarked approaches. The work implies a wider range of IT2 MF types, constructed based on FCM outcomes, and an optimum generation of the FOU so that it can be implemented in practical applications such as prediction, analytics and rule-based solutions.     

Classifier-ensemble incremental-learning procedure for nuclear transient identification at different operational conditions

An important requirement for the practical implementation of empirical diagnostic systems is the capability of classifying transients in all plant operational conditions. The present paper proposes an approach based on an ensemble of classifiers for incrementally learning transients under different operational conditions. New classifiers are added to the ensemble where transients occurring in new operational conditions are not satisfactorily classified. The construction of the ensemble is made by bagging; the base classifier is a supervised Fuzzy C Means (FCM) classifier whose outcomes are combined by majority voting. The incremental learning procedure is applied to the identification of simulated transients in the feedwater system of a Boiling Water Reactor (BWR) under different reactor power levels.     

Performance analysis of classifiers for colon cancer detection from dimensionality reduced microarray gene data

Cancer disease is accountable for many deaths that are over 9.6 million in 2018 and roughly one out of six deaths occur because of cancer worldwide. The colon cancer is the second prominent source of death of around 1.8 million cases. This research is inclined to detect the colon cancer from microarray dataset. It will aids the experts to distinguish the cancer cells from normal cells for appropriate determination and treatment of cancer at earlier stages that leads to increase the survival rate of the patients. The high dimensionality in microarray dataset with less samples and more attributes creates lag in the detection capability of the classifier. Hence there is a need for dimensionality reduction techniques to preserve the significant genes that are prominent in the disease classification. In this article, at first ANOVA method used to select the best genes and then principal component analysis (PCA) and fuzzy C-means clustering (FCM) techniques are further employed to choose relevant genes. The PCA and FCM features are classified using model, discriminant, regression, hybrid, and heuristic-based classifiers. The attained results show that the heuristic classifier with PCA features is encapsulated an average classification accuracy of 97.92% for classifying both the colon cancer and normal samples. Also, for FCM features, the Heuristic classifier is maintained at an average classification accuracy of 99.48% and 97.92% for classifying the colon cancer and normal samples, respectively. The Heuristic classifier outperforms with high accuracy than all other classifiers in the classification of colon cancer.     

基于粒子群优化聚类的汽轮机组振动故障诊断

针对模糊C-均值聚类算法(FCM)容易陷入局部极值和对初始值敏感的不足,提出了一种新的模糊聚类算法(PFCM),新算法利用粒子群优化算法(PSO)全局寻优、快速收敛的特点,代替了FCM算法的基于梯度下降的迭代过程,使算法具有很强的全局搜索能力,很大程度上避免了FCM算法易陷入局部极值的缺陷,同时也降低了FCM算法对初始值的敏感度。将该算法应用于汽轮机组振动故障诊断中,与电厂运行实际故障状态对照,仿真结果表明该算法提高了故障诊断的正确率。为汽轮机振动故障诊断方法的研究提供了一种新的思路。     

Cloud manufacturing resources fuzzy classification based on genetic simulated annealing algorithm

To solve the problem of fuzzy classification of manufacturing resources in a cloud manufacturing environment, a hybrid algorithm based on genetic algorithm (GA), simulated annealing (SA) and fuzzy C-means clustering algorithm (FCM) is proposed. In this hybrid algorithm, classification is based on the processing feature and attributes of the manufacturing resource; the inner and outer layers of the nested loops are solving it, GA obtains the best classification number in the outer layer; the fitness function is constructed by fuzzy clustering algorithm (FCM), carrying out the selection, crossover and mutation operation and SA cooling operation. The final classification results are obtained in the inner layer. Using the hybrid algorithm to solve 45 kinds of manufacturing resources, the optimal classification number is 9 and the corresponding classification results are obtained, proving that the algorithm is effective.     

Soft fault detection and isolation in analog circuits: some resultsand a comparison between a fuzzy approach and radial basis functionnetworks

This paper provides a comparison between two techniques for soft fault diagnosis in analog electronic circuits. Both techniques are based on the simulation before test approach: a "fault dictionary" is a priori generated by collecting, signatures of different fault conditions. Classifiers, trained by the examples contained in the fault dictionary, are then configured to classify the measured circuit responses. The suggested classifiers have similar structures. The first is based on a fuzzy system, obtained by processing fault dictionary data for automatic generation of IF-THEN rules, and the second classifier is based on a radial basis function neural network. The two classifiers are used to detect and isolate faults both at the subsystem and component levels. The experimental results point out that both classifiers provide low classification errors in the presence of noise and nonfaulty components tolerance effects. The fuzzy approach provides better results due to an efficient generation method for the IF-THEN rules that allows adding IF parts in the input space regions where ambiguity occurs     

Neural Network and Fuzzy Control Based 11-Level Cascaded Inverter Operation

This paper presents a combined control and modulation technique to enhance the power quality (PQ) and power reliability (PR) of a hybrid energy system (HES) through a single-phase 11-level cascaded H-bridge inverter (11-CHBI). The controller and inverter specifically regulate the HES and meet the load demand. To track optimum power, a Modified Perturb and Observe (MP&O) technique is used for HES. Ultra-capacitor (UCAP) based energy storage device and a novel current control strategy are proposed to provide additional active power support during both voltage sag and swell conditions. For an improved PQ and PR, a two-way current control strategy such as the main controller (MC) and auxiliary controller (AC) is suggested for the 11-CHBI operation. MC is used to regulate the active current component through the fuzzy controller (FC), and AC is used to regulate the dc-link voltage of CHBI through a neural network-based PI controller (ANN-PI). By tracking the reference signals from MC and AC, a novel hybrid pulse width modulation (HPWM) technique is proposed for the 11-CHBI operation. To justify and analyze the MATLAB/Simulink software-based designed model, the robust controller performance is tested through numerous steady-state and dynamic state case studies.     

A novel brain image segmentation using intuitionistic fuzzy C means algorithm

A process of splitting the image into pixel bands is the image segmentation. As medical imaging contain uncertainties, there are difficulties in classification of images into homogeneous regions. There is a need for segmentation algorithm for removing the noise from the medical image segmentation. The very popular algorithm is Fuzzy C‐Means (FCM) algorithm used for image segmentation. Fuzzy sets, rough sets, and the combination of fuzzy and rough sets play a prominent role in formalizing uncertainty, vagueness, and incompleteness in diagnosis. But it will use intensity values only which will be highly sensitive to noise. In this article, an Intuitionistic FCM (IFCM) algorithm is presented for clustering. Intuitionistic fuzzy (IF) sets are generalized sets and their elements are characterized by a membership value as well as nonmembership value. This IFCM has an uncertainty parameter which is called hesitation degree and a new objective function is integrated in the standard FCM based on IF entropy. The IFCM will provide better performance than FCM for image segmentation.     

Hybrid solution of the averaged Navier-Stokes equations for turbulent flow

The Generalized Integral Transform Technique (GITT) is utilized in the hybrid numerical-analytical solution of the Reynolds averaged Navier-Stokes equations, for developing turbulent flow inside a parallel-plates channel. An algebraic turbulence model is employed in modelling the turbulent diffusivity. The automatic global error control feature inherent to this approach, permits the determination of fully converged reference results for the validation of purely numerical methods. Therefore, numerical results for different values of Reynolds number are obtained, both for illustrating the convergence characteristics of the integral transform approach, and for critical comparisons with previously reported results through different models and numerical schemes.     

Constructing a new fuzzy classifier based on hierarchical fuzzy entropy

Abstract

In an earlier work, Lee et al. (Lee et al., 2001) presented a simple and fast fuzzy classifier that employed fuzzy entropy to evaluate pattern distribution information in a pattern space. In this paper, we extend his work to propose a new fuzzy classifier based on hierarchical fuzzy entropy (FC‐HFE). We retained the main parts of the original structure and modified some methods (e.g., methods for deciding the number of intervals in each dimension and for assigning class labels). In addition, the hierarchical fuzzy entropy is proposed for partitioning the decision region. The proposed FC‐HFE improves classification accuracy and overcomes some of the drawbacks in the Lee et al method (Lee et al., 2001). The simulation results show that the classification rate of the proposed FC‐HFE is better than earlier methods.     

Fuzzy rules extraction using a hybrid of base‐n‐number‐coded GA and SVD‐QR

Abstract

A hybrid of a base‐n‐number‐coded genetic algorithm (base‐n‐number‐coded GA) and an SVD‐QR is proposed to construct a fuzzy system directly from some gathered input‐output data of the identified system. Each individual in the base‐n‐number‐coded GA is applied to determine the fuzzy sets in each input variable. However, the grid‐type fuzzy partition by the fuzzy sets associated with each input variable may generate some redundant fuzzy subspaces. Therefore, an SVD‐QR method is applied to remove the redundant fuzzy subspaces to efficiently describe the behavior of the identified system so that the premise part of the fuzzy system is determined. Then, the recursive least‐squares method is used to determine the consequent part of the fuzzy system. Subsequently, a fitness function is defined such that it can guide the search procedure to select an appropriate fuzzy system that not only maintains a good performance but also has relevant fuzzy rules. Finally, two nonlinear system identification problems are used to illustrate the efficiency of the proposed method.     

A Development of Fuzzy Encoding and Decoding Through Fuzzy Clustering

Fuzzy clustering has emerged as a fundamental technique of information granulation. In this study, we introduce and discuss multivariable encoding and decoding mechanisms (referred altogether as a reconstruction problem) expressed in the language of fuzzy sets and fuzzy relations. The underlying performance index associated with the problem helps quantify a reconstruction error that arises when transforming a numeric datum through fuzzy sets (relations) and then reconstructing it into an original numeric format. The clustering platform considered in this study concerns the well-known algorithm of Fuzzy C-Means (FCM). The main design aspects deal with the relationships between the number of clusters versus the reconstruction properties and the resulting reconstruction error. The impact of the fuzzification coefficient on the reconstruction quality is investigated. This finding is of interest, given the fact that predominantly all applications involving FCM use the value of the fuzzification coefficient equal to 2. In light of the completed experiments, we demonstrate that this selection may not be experimentally legitimate. We also carry out a comparative analysis of the reconstruction properties of the Boolean decoding that is induced by the fuzzy partition. Experimental investigations involve selected machine learning data.     

Development of machine learning‐based real time scheduling systems: using ensemble based on wrapper feature selection approach

There are two items that significantly enhance the generalisation ability (i.e. classification accuracy) of machine learning‐based classifiers: feature selection (including parameter optimisation) and an ensemble of the classifiers. Accordingly, the objective in this study is to develop an ensemble of classifiers based on a genetic algorithm (GA) wrapper feature selection approach for real time scheduling (RTS). The proposed approach can better enhance the generalisation ability of the RTS knowledge base (i.e. classifier) in comparison with three classical machine learning‐based classifier RTS systems, including the GA‐based wrapper feature selection mechanism, in terms of the prediction accuracy of 10‐fold cross validation as measured according to all the performance criteria. The proposed ensemble classifier RTS also provides better system performance than the three machine learning‐based RTS systems, including the GA‐based wrapper feature selection mechanism and heuristic dispatching rules, under all the performance criteria, over a long period in a flexible manufacturing system (FMS) case study.     

Real-coded genetic algorithm and fuzzy logic approach for real-time tuning of proportional-integral?derivative controller in automatic voltage regulator system

Optimal tuning of proportional?integral?derivative (PID) controller parameters is necessary for the satisfactory operation of automatic voltage regulator (AVR) system. This study presents a combined genetic algorithm (GA) and fuzzy logic approach to determine the optimal PID controller parameters in AVR system. The problem of obtaining the optimal PID controller parameters is formulated as an optimisation problem and a real-coded genetic algorithm (RGA) is applied to solve the optimisation problem. In the proposed RGA, the optimisation variables are represented as floating point numbers in the genetic population. Further, for effective genetic operation, the crossover and mutation operators which can deal directly with the floating point numbers are used. The proposed approach has resulted in PID controller with good transient response. The optimal PID gains obtained by the proposed GA for various operating conditions are used to develop the rule base of the Sugeno fuzzy system. The developed fuzzy system can give the PID parameters on-line for different operating conditions. The suitability of the proposed approach for PID controller tuning has been demonstrated through computer simulations in an AVR system.     

Classification of multicolor fluorescence in situ hybridization (M-FISH) images with sparse representation

There has been a considerable interest in sparse representation and compressive sensing in applied mathematics and signal processing in recent years but with limited success to medical image processing. In this paper we developed a sparse representation-based classification (SRC) algorithm based on L1-norm minimization for classifying chromosomes from multicolor fluorescence in situ hybridization (M-FISH) images. The algorithm has been tested on a comprehensive M-FISH database that we established, demonstrating improved performance in classification. When compared with other pixel-wise M-FISH image classifiers such as fuzzy c-means (FCM) clustering algorithms and adaptive fuzzy c-means (AFCM) clustering algorithms that we proposed earlier the current method gave the lowest classification error. In order to evaluate the performance of different SRC for M-FISH imaging analysis, three different sparse representation methods, namely, Homotopy method, Orthogonal Matching Pursuit (OMP), and Least Angle Regression (LARS), were tested and compared. Results from our statistical analysis have shown that Homotopy based method is significantly better than the other two methods. Our work indicates that sparse representations based classifiers with proper models can outperform many existing classifiers for M-FISH classification including those that we proposed before, which can significantly improve the multicolor imaging system for chromosome analysis in cancer and genetic disease diagnosis.     

一种基于FCM的图像分割方法

提出一种新的图像分割方法 FWFCM(fast walvet fuzzy C-means method),该方法对图像像素点的灰度进行模糊隶属度的分析,将需要聚类的像素空间投影到灰度直方图空间,从而减少了经典FCM算法的迭代计算量,提高了算法的收敛速度;并且利用小波变换的多分辨率的分析,抑制噪声点对图像分割的影响,提高了图像分割的精度.