Implementing automated diagnostic systems for breast cancer detection

This paper intends to an integrated view of implementing automated diagnostic systems for breast cancer detection. The major objective of the paper is to be a guide for the readers, who want to develop an automated decision support system for detection of breast cancer. Because of the importance of making the right decision, better classification procedures for breast cancer have been searched. The classification accuracies of different classifiers, namely multilayer perceptron neural network (MLPNN), combined neural network (CNN), probabilistic neural network (PNN), recurrent neural network (RNN) and support vector machine (SVM), which were trained on the attributes of each record in the Wisconsin breast cancer database, were compared. The purpose was to determine an optimum classification scheme with high diagnostic accuracy for this problem. This research demonstrated that the SVM achieved diagnostic accuracies which were higher than that of the other automated diagnostic systems.     

Comparison of different classification algorithms in clinical decision-making

Abstract: This paper gives an integrated view of implementing automated diagnostic systems for clinical decision-making. Because of the importance of making the right decision, better classification procedures are necessary for clinical decisions. The major objective of the paper is to be a guide for readers who want to develop an automated decision support system for clinical practice. The purpose was to determine an optimum classification scheme with high diagnostic accuracy for this problem. Several different classification algorithms were tested and benchmarked for their performance. The performance of the classification algorithms is illustrated on two data sets: the Pima Indians diabetes and the Wisconsin breast cancer. The present research demonstrates that the support vector machines achieved diagnostic accuracies which were higher than those of other automated diagnostic systems.     

Integrating radiologist feedback with computer aided diagnostic systems for breast cancer risk prediction in ultrasonic images: An experimental investigation in machine learning paradigm

With advancements in machine learning algorithms and computer aided diagnostic (CAD) systems, the performance of automated analysis of radiological images has improved substantially in recent times. However, the lack of integration between the radiologist and CAD systems restrains the rate of progress as well as the reach of such advancements in clinical use. This article aims to improve the clinical efficiency of ultrasound based CAD systems for classification of breast lesions by integrating back-propagation artificial neural network (BPANN), support vector machine (SVM) and radiologist feedback. The acquired breast ultrasound images were subjected to wavelet based filtering in order to reduce speckle noise followed by feature extraction, feature selection and classification. Experiments on a database of 178 ultrasound images of breast anomalies (88 benign and 90 malignant) show that the proposed methodology achieves classification accuracy of 98.621% and 98.276%, respectively, when all 457 and 19 most relevant features selected by multi-criteria feature selection method were used for classification. The accuracy achieved is significantly higher than that using conventional classifiers based on BPANN and SVM. Further, it is found that integrating expert opinion in CAD systems improves its overall performance. The quantitative results obtained are discussed in light of some recently reported studies.     

An adaptive resource-allocating network for automated detection, segmentation, and classification of breast cancer nuclei topic area: image processing and recognition

This paper presents a unified image analysis approach for automated detection, segmentation, and classification of breast cancer nuclei using a neural network, which learns to cluster shapes and to classify nuclei. The proposed neural network is incrementally grown by creating a new cluster whenever a previously unseen shape is presented. Each hidden node represents a cluster used as a template to provide faster and more accurate nuclei detection and segmentation. Online learning gives the system improved performance with continued use. The effectiveness of the resulting system is demonstrated on a task of cytological image analysis, with classification of individual nuclei used to diagnose the sample. This demonstrates the potential effectiveness of such a system on diagnostic tasks that require the classification of individual cells.     

Breast cancer classification using deep belief networks

Over the last decade, the ever increasing world-wide demand for early detection of breast cancer at many screening sites and hospitals has resulted in the need of new research avenues. According to the World Health Organization (WHO), an early detection of cancer greatly increases the chances of taking the right decision on a successful treatment plan. The Computer-Aided Diagnosis (CAD) systems are applied widely in the detection and differential diagnosis of many different kinds of abnormalities. Therefore, improving the accuracy of a CAD system has become one of the major research areas. In this paper, a CAD scheme for detection of breast cancer has been developed using deep belief network unsupervised path followed by back propagation supervised path. The construction is back-propagation neural network with Liebenberg Marquardt learning function while weights are initialized from the deep belief network path (DBN-NN). Our technique was tested on the Wisconsin Breast Cancer Dataset (WBCD). The classifier complex gives an accuracy of 99.68% indicating promising results over previously-published studies. The proposed system provides an effective classification model for breast cancer. In addition, we examined the architecture at several train-test partitions.     

基于SVM-MLP的乳腺癌预测

乳腺癌一直是影响女性健康最重要的问题之一,已经成为全球女性发病率最高的恶性肿瘤.近年来,利用机器学习和深度学习方法来诊断癌症已经成为发展较快的一个分支.通过使用逻辑回归模型(LR)、高斯核函数支持向量机(SVM)、前馈神经网络(MLP)对同一数据集进行预测,得出其中SVM迭代时间最短,前馈神经网络预测准确率最高.为了减...     

Comparison of support vector machine,artificial neural network,and spectral angle mapper algorithms for crop classification using LISS IV data

The Resourcesat-2 is a highly suitable satellite for crop classification studies with its improved features and capabilities. Data from one of its sensors, the linear imaging and self-scanning (LISS IV), which has a spatial resolution of 5.8 m, was used to compare the relative accuracies achieved by support vector machine (SVM), artificial neural network (ANN), and spectral angle mapper (SAM) algorithms for the classification of various crops and non-crop covering a part of Varanasi district, Uttar Pradesh, India. The separability analysis was performed using a transformed divergence (TD) method between categories to assess the quality of training samples. The outcome of the present study indicates better performance of SVM and ANN algorithms in comparison to SAM for the classification using LISS IV sensor data. The overall accuracies obtained by SVM and ANN were 93.45% and 92.32%, respectively, whereas the lower accuracy of 74.99% was achieved using the SAM algorithm through error matrix analysis. Results derived from SVM, ANN, and SAM classification algorithms were validated with the ground truth information acquired by the field visit on the same day of satellite data acquisition.     

基于Logistic回归、ANN、SVM的乳腺癌复发影响因素研究

为找出乳腺癌复发的影响因素,并比较人工神经网络（ANN）型、支持向量机型（SVM）和logistic回归型在乳腺癌复发中的预测效能.本文结合南斯拉夫卢布尔雅那大学医疗中心乳腺癌肿瘤研究所的277例数据,对乳腺癌复发的影响因素进行研究.分别采用了logistic回归、人工神经网络和支持向量机方法来建立乳腺癌复发的预测模型,并对这三种分析方法进行了理论方法和预测效能的比较.结果发现,肿瘤大小、有无结节冒、肿瘤恶性程度（P<0.05）是乳腺癌术后复发的主要影响因素,而在不同的预测方法中相对于logistic回归模型,支持向量机和人工神经网络具有更好的预测效能,其中支持向量机的预测效能最好.     

A systematic approach to embedded biomedical decision making

An embedded decision making is a key feature for many biomedical systems. In most cases human life directly depends on correct decisions made by these systems, therefore they have to work reliably. This paper describes how we applied systems engineering principles to design a high performance embedded classification system in a systematic and well structured way. We introduce the structured design approach by discussing requirements capturing, specifications refinement, implementation and testing. Thereby, we follow systems engineering principles and execute each of these processes as formal as possible. The requirements, which motivate the system design, describe an automated decision making system for diagnostic support. These requirements are refined into the implementation of a support vector machine (SVM) algorithm which enables us to integrate automated decision making in embedded systems. With a formal model we establish functionality, stability and reliability of the system. Furthermore, we investigated different parallel processing configurations of this computationally complex algorithm. We found that, by adding SVM processes, an almost linear speedup is possible. Once we established these system properties, we translated the formal model into an implementation. The resulting implementation was tested using XMOS processors with both normal and failure cases, to build up trust in the implementation. Finally, we demonstrated that our parallel implementation achieves the speedup, predicted by the formal model.     

A one-layer recurrent neural network for support vector machine learning.

This paper presents a one-layer recurrent neural network for support vector machine (SVM) learning in pattern classification and regression. The SVM learning problem is first converted into an equivalent formulation, and then a one-layer recurrent neural network for SVM learning is proposed. The proposed neural network is guaranteed to obtain the optimal solution of support vector classification and regression. Compared with the existing two-layer neural network for the SVM classification, the proposed neural network has a low complexity for implementation. Moreover, the proposed neural network can converge exponentially to the optimal solution of SVM learning. The rate of the exponential convergence can be made arbitrarily high by simply turning up a scaling parameter. Simulation examples based on benchmark problems are discussed to show the good performance of the proposed neural network for SVM learning.     

Higher order spectra analysis of breast thermograms for the automated identification of breast cancer

Breast cancer is a leading cancer affecting women worldwide. Mammography is a scanning procedure involvingX‐rays of the breast. It causes discomfort and may cause high incidence of false negatives. Breast thermography is a new screening method of breast that helps in the early detection of cancer. It is a non‐invasive imaging procedure that captures the infrared heat radiating off from the breast surface using an infrared camera. The main objective of this work is to evaluate the use of higher order spectral features extracted from thermograms in classifying normal and abnormal thermograms. For this purpose, we extracted five higher order spectral features and used them in a feed‐forward artificial neural network (ANN) classifier and a support vector machine (SVM). Fifty thermograms (25 each of normal and abnormal) were used for analysis.SVM presented a good sensitivity of 76% and specificity of 84%, and theANN classifier demonstrated higher values of sensitivity (92%) and specificity (88%). The proposed system, therefore, shows great promise in automatic classification of normal and abnormal breast thermograms without the need for subjective interpretation.     

Automated breast cancer detection by thermography : performance goal and diagnostic feature identification

This paper presents the methodology used for establishing a performance goal and identifying the diagnostic features in a program to develop an automated system for breast cancer detection based on thermographic principles. The receiver operating characteristic (ROC) curve approach is used to evaluate both observer classification and classification rules based on an observer's evaluation of diagnostic features. The multivariate logistic function is applied to two sets of observer evaluated feature sets using 623 normal and 122 breast cancer diagnosed subjects. It is shown that the observer outperforms the multivariate logistic function classifier based on the diagnostic features.     

Empirical analysis of support vector machine ensemble classifiers

Ensemble classification – combining the results of a set of base learners – has received much attention in the machine learning community and has demonstrated promising capabilities in improving classification accuracy. Compared with neural network or decision tree ensembles, there is no comprehensive empirical research in support vector machine (SVM) ensembles. To fill this void, this paper analyses and compares SVM ensembles with four different ensemble constructing techniques, namely bagging, AdaBoost, Arc-X4 and a modified AdaBoost. Twenty real-world data sets from the UCI repository are used as benchmarks to evaluate and compare the performance of these SVM ensemble classifiers by their classification accuracy. Different kernel functions and different numbers of base SVM learners are tested in the ensembles. The experimental results show that although SVM ensembles are not always better than a single SVM, the SVM bagged ensemble performs as well or better than other methods with a relatively higher generality, particularly SVMs with a polynomial kernel function. Finally, an industrial case study of gear defect detection is conducted to validate the empirical analysis results.     

Decision tree classifiers for automated medical diagnosis

Decision support systems help physicians and also play an important role in medical decision-making. They are based on different models, and the best of them are providing an explanation together with an accurate, reliable and quick response. This paper presents a decision support tool for the detection of breast cancer based on three types of decision tree classifiers. They are single decision tree (SDT), boosted decision tree (BDT) and decision tree forest (DTF). Decision tree classification provides a rapid and effective method of categorizing data sets. Decision-making is performed in two stages: training the classifiers with features from Wisconsin breast cancer data set, and then testing. The performance of the proposed structure is evaluated in terms of accuracy, sensitivity, specificity, confusion matrix and receiver operating characteristic (ROC) curves. The results showed that the overall accuracies of SDT and BDT in the training phase achieved 97.07 % with 429 correct classifications and 98.83 % with 437 correct classifications, respectively. BDT performed better than SDT for all performance indices than SDT. Value of ROC and Matthews correlation coefficient (MCC) for BDT in the training phase achieved 0.99971 and 0.9746, respectively, which was superior to SDT classifier. During validation phase, DTF achieved 97.51 %, which was superior to SDT (95.75 %) and BDT (97.07 %) classifiers. Value of ROC and MCC for DTF achieved 0.99382 and 0.9462, respectively. BDT showed the best performance in terms of sensitivity, and SDT was the best only considering speed.     

A hybrid approach to medical decision support systems: combining feature selection, fuzzy weighted pre-processing and AIRS

This paper presents a hybrid approach based on feature selection, fuzzy weighted pre-processing and artificial immune recognition system (AIRS) to medical decision support systems. We have used the heart disease and hepatitis disease datasets taken from UCI machine learning database as medical dataset. Artificial immune recognition system has shown an effective performance on several problems such as machine learning benchmark problems and medical classification problems like breast cancer, diabetes, and liver disorders classification. The proposed approach consists of three stages. In the first stage, the dimensions of heart disease and hepatitis disease datasets are reduced to 9 from 13 and 19 in the feature selection (FS) sub-program by means of C4.5 decision tree algorithm (CBA program), respectively. In the second stage, heart disease and hepatitis disease datasets are normalized in the range of [0,1] and are weighted via fuzzy weighted pre-processing. In the third stage, weighted input values obtained from fuzzy weighted pre-processing are classified using AIRS classifier system. The obtained classification accuracies of our system are 92.59% and 81.82% using 50-50% training-test split for heart disease and hepatitis disease datasets, respectively. With these results, the proposed method can be used in medical decision support systems.     

Performance analysis of support vector machines classifiers in breast cancer mammography recognition

Support vector machine (SVM) is a supervised machine learning approach that was recognized as a statistical learning apotheosis for the small-sample database. SVM has shown its excellent learning and generalization ability and has been extensively employed in many areas. This paper presents a performance analysis of six types of SVMs for the diagnosis of the classical Wisconsin breast cancer problem from a statistical point of view. The classification performance of standard SVM (St-SVM) is analyzed and compared with those of the other modified classifiers such as proximal support vector machine (PSVM) classifiers, Lagrangian support vector machines (LSVM), finite Newton method for Lagrangian support vector machine (NSVM), Linear programming support vector machines (LPSVM), and smooth support vector machine (SSVM). The experimental results reveal that these SVM classifiers achieve very fast, simple, and efficient breast cancer diagnosis. The training results indicated that LSVM has the lowest accuracy of 95.6107 %, while St-SVM performed better than other methods for all performance indices (accuracy = 97.71 %) and is closely followed by LPSVM (accuracy = 97.3282). However, in the validation phase, the overall accuracies of LPSVM achieved 97.1429 %, which was superior to LSVM (95.4286 %), SSVM (96.5714 %), PSVM (96 %), NSVM (96.5714 %), and St-SVM (94.86 %). Value of ROC and MCC for LPSVM achieved 0.9938 and 0.9369, respectively, which outperformed other classifiers. The results strongly suggest that LPSVM can aid in the diagnosis of breast cancer.     

基于卷积神经网络及改进支持向量机的行人检测

针对自动驾驶实际道路场景复杂导致行人误检率高的问题,提出一种基于卷积神经网络及改进支持向量机的行人检测方法。利用聚合通道特征快速获取图像候选区域,将归一化后的候选区域图像输入卷积神经网络对其进行深度特征提取;利用主成分分析法将卷积神经网络末端所得到的特征向量进行降维处理,减少其冗余特征信息以获得精确的行人特征描述;将行人特征送至优化后的支持向量机完成分类。考虑支持向量机在分类过程中存在核函数参数选择困难的问题,利用改进后的蚁群算法对其进行优化选择,获得最优支持向量机参数以提高分类精度。实验结果表明,不同场景下的行人平均检测精确度达到92%,误检率大幅下降且具有较好的实时性。     

Drug design by machine learning: support vector machines for pharmaceutical data analysis.

We show that the support vector machine (SVM) classification algorithm, a recent development from the machine learning community, proves its potential for structure-activity relationship analysis. In a benchmark test, the SVM is compared to several machine learning techniques currently used in the field. The classification task involves predicting the inhibition of dihydrofolate reductase by pyrimidines, using data obtained from the UCI machine learning repository. Three artificial neural networks, a radial basis function network, and a C5.0 decision tree are all outperformed by the SVM. The SVM is significantly better than all of these, bar a manually capacity-controlled neural network, which takes considerably longer to train.