Breast Cancer Detection in Saudi Arabian Women Using Hybrid Machine Learning on Mammographic Images

Breast cancer (BC) is the most common cause of women’s deaths worldwide. The mammography technique is the most important modality for the detection of BC. To detect abnormalities in mammographic images, the Breast Imaging Reporting and Data System (BI-RADs) is used as a baseline. The correct allocation of BI-RADs categories for mammographic images is always an interesting task, even for specialists. In this work, to detect and classify the mammogram images in BI-RADs, a novel hybrid model is presented using a convolutional neural network (CNN) with the integration of a support vector machine (SVM). The dataset used in this research was collected from different hospitals in the Qassim health cluster of Saudi Arabia. The collection of all categories of BI-RADs is one of the major contributions of this paper. Another significant contribution is the development of a hybrid approach through the integration of CNN and SVM. The proposed hybrid approach uses three CNN models to obtain ensemble CNN model results. This ensemble model saves the values to integrate them with SVM. The proposed system achieved a classification accuracy, sensitivity, specificity, precision, and F1-score of 93.6%, 94.8%, 96.9%, 96.6%, and 95.7%, respectively. The proposed model achieved better performance compared to previously available methods.     

Detection and classification of large bowel obstruction from X-ray images using machine learning algorithms

Large bowel obstruction (LBO) occurs when there is a blockage or twisting in the large bowel that prevents wastes and gas from passing through. If left untreated, the blockage cuts off blood supply to the colon, causing sections of it to die which results in high rates of morbidity and fatality. The examination of clinical symptoms of LBO involves careful inspection of the cecum and colon. Radiologists use X-rays to inspect the clinical signs. Some research has been done to automate the detection of related abdominal and intestinal diseases. However, all these studies concentrate only on detecting Crohn's, ulcerative colitis, Acute Appendicitis, colorectal cancer, celiac diseases, liver diseases, and chronic kidney diseases. Automatic detection and classification of LBO has not been given due attention so far to the best of the authors knowledge. To address this challenge, we have designed a model for the detection and classification of LBO. The models development comprises of stages such as preprocessing, detection, segmentation, feature extraction, and classification. We used YOLOv3 for detection and used a gray scale level co-occurrence matrix (GLCM), and a convolutional neural network for feature extraction, while support vector machine (SVM) and softmax were used for classification. The proposed model achieved a diagnostic accuracy of 89% when feature extraction methods such as CNN and median filter with softmax classifier were used. CNN and Gaussian filter with soft max classifier achieved 91%, while CNN and anisotropic filter with soft max classifier achieved 92%. GLCM with threshold segmentation and Gaussian filter with SVM classifier achieved 87%, while CNN with watershed segmentation and Gaussian filter with SVM classifier achieved 97% and CNN-GLCM with watershed segmentation and anisotropic diffusion filter with SVM classifier achieved 98% for detection and classification of LBO. Finally, this paper presented a performance analysis of various machine learning approaches for detection and classification of LBO. Hence, our model is designed to assist human experts (Radiologists) in diagnosing LBO.     

A New Multi-Agent Feature Wrapper Machine Learning Approach for Heart Disease Diagnosis

Heart disease (HD) is a serious widespread life-threatening disease. The heart of patients with HD fails to pump sufficient amounts of blood to the entire body. Diagnosing the occurrence of HD early and efficiently may prevent the manifestation of the debilitating effects of this disease and aid in its effective treatment. Classical methods for diagnosing HD are sometimes unreliable and insufficient in analyzing the related symptoms. As an alternative, noninvasive medical procedures based on machine learning (ML) methods provide reliable HD diagnosis and efficient prediction of HD conditions. However, the existing models of automated ML-based HD diagnostic methods cannot satisfy clinical evaluation criteria because of their inability to recognize anomalies in extracted symptoms represented as classification features from patients with HD. In this study, we propose an automated heart disease diagnosis (AHDD) system that integrates a binary convolutional neural network (CNN) with a new multi-agent feature wrapper (MAFW) model. The MAFW model consists of four software agents that operate a genetic algorithm (GA), a support vector machine (SVM), and Naïve Bayes (NB). The agents instruct the GA to perform a global search on HD features and adjust the weights of SVM and BN during initial classification. A final tuning to CNN is then performed to ensure that the best set of features are included in HD identification. The CNN consists of five layers that categorize patients as healthy or with HD according to the analysis of optimized HD features. We evaluate the classification performance of the proposed AHDD system via 12 common ML techniques and conventional CNN models by using a cross-validation technique and by assessing six evaluation criteria. The AHDD system achieves the highest accuracy of 90.1%, whereas the other ML and conventional CNN models attain only 72.3%–83.8% accuracy on average. Therefore, the AHDD system proposed herein has the highest capability to identify patients with HD. This system can be used by medical practitioners to diagnose HD efficiently.     

Differential diagnosis of Interstitial Lung Diseases using Deep Learning networks

ABSTRACT

An architecture for automatic lung tissue classification method based on the Deep Learning techniques is designed in this paper. Recent works on Deep Learning techniques achieved impressive results in the field of medical image classification. So, we designed a Convolution Neural Network (CNN) for the classification of five categories of Interstitial Lung Diseases (ILD) patterns in High-Resolution Computed Tomography (HRCT) images. The CNN consists of 3 Convolution layers, Leaky ReLU activation followed by Maximum pooling layer and dense layer. The last Fully Connected (FC) layer has 5 outputs equivalent to the classes considered such as Normal, Ground Glass (GG), Emphysema, Micro Nodules, and Fibrosis. The proposed CNN is trained and evaluated on the publicly available ILD database provided by the University Hospitals of Geneva (HUG). Experimental results are compared with the state-of-art, which shows an outstanding performance of the proposed CNN model giving 94.67% accuracy and 94.65% F_avg .     

Plant Disease Diagnosis and Image Classification Using Deep Learning

Indian agriculture is striving to achieve sustainable intensification, the system aiming to increase agricultural yield per unit area without harming natural resources and the ecosystem. Modern farming employs technology to improve productivity. Early and accurate analysis and diagnosis of plant disease is very helpful in reducing plant diseases and improving plant health and food crop productivity. Plant disease experts are not available in remote areas thus there is a requirement of automatic low-cost, approachable and reliable solutions to identify the plant diseases without the laboratory inspection and expert's opinion. Deep learning-based computer vision techniques like Convolutional Neural Network (CNN) and traditional machine learning-based image classification approaches are being applied to identify plant diseases. In this paper, the CNN model is proposed for the classification of rice and potato plant leaf diseases. Rice leaves are diagnosed with bacterial blight, blast, brown spot and tungro diseases. Potato leaf images are classified into three classes: healthy leaves, early blight and late blight diseases. Rice leaf dataset with 5932 images and 1500 potato leaf images are used in the study. The proposed CNN model was able to learn hidden patterns from the raw images and classify rice images with 99.58% accuracy and potato leaves with 97.66% accuracy. The results demonstrate that the proposed CNN model performed better when compared with other machine learning image classifiers such as Support Vector Machine (SVM), K-Nearest Neighbors (KNN), Decision Tree and Random Forest.     

Developing a Recognition System for Classifying COVID-19 Using a Convolutional Neural Network Algorithm

The COVID-19 pandemic poses an additional serious public health threat due to little or no pre-existing human immunity, and developing a system to identify COVID-19 in its early stages will save millions of lives. This study applied support vector machine (SVM), k-nearest neighbor (K-NN) and deep learning convolutional neural network (CNN) algorithms to classify and detect COVID-19 using chest X-ray radiographs. To test the proposed system, chest X-ray radiographs and CT images were collected from different standard databases, which contained 95 normal images, 140 COVID-19 images and 10 SARS images. Two scenarios were considered to develop a system for predicting COVID-19. In the first scenario, the Gaussian filter was applied to remove noise from the chest X-ray radiograph images, and then the adaptive region growing technique was used to segment the region of interest from the chest X-ray radiographs. After segmentation, a hybrid feature extraction composed of 2D-DWT and gray level co-occurrence matrix was utilized to extract the features significant for detecting COVID-19. These features were processed using SVM and K-NN. In the second scenario, a CNN transfer model (ResNet 50) was used to detect COVID-19. The system was examined and evaluated through multiclass statistical analysis, and the empirical results of the analysis found significant values of 97.14%, 99.34%, 99.26%, 99.26% and 99.40% for accuracy, specificity, sensitivity, recall and AUC, respectively. Thus, the CNN model showed significant success; it achieved optimal accuracy, effectiveness and robustness for detecting COVID-19.     

Magnetic resonance brain image classification based on weighted‐type fractional Fourier transform and nonparallel support vector machine

To classify brain images into pathological or healthy is a key pre‐clinical state for patients. Manual classification is tiresome, expensive, time‐consuming, and irreproducible. In this study, we aimed to present an automatic computer‐aided system for brain‐image classification. We used 90 T2‐weighted images obtained by magnetic resonance images. First, we used weighted‐type fractional Fourier transform (WFRFT) to extract spectrums from each magnetic resonance image. Second, we used principal component analysis (PCA) to reduce spectrum features to only 26. Third, those reduced spectral features of different samples were combined and were fed into support vector machine (SVM) and its two variants: generalized eigenvalue proximal SVM and twin SVM. A 5 × 5‐fold cross‐validation results showed that this proposed “WFRFT + PCA + generalized eigenvalue proximal SVM” yielded sensitivity of 99.53%, specificity of 92.00%, precision of 99.53%, and accuracy of 99.11%, which are comparable with the proposed “WFRFT + PCA + twin SVM” and better than the proposed “WFRFT + PCA + SVM.” Besides, all three proposed methods were superior to eight state‐of‐the‐art algorithms. Thus, WFRFT is effective, and the proposed methods can be used in practical. © 2015 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 25, 317–327, 2015     

Deep transfer learning based hepatitis B virus diagnosis using spectroscopic images

Accurate identification of Hepatitis B virus (HBV) disease by analyzing the Raman spectroscopic images is a challenge for pathologists. To save precious human lives, an efficient technique is required with higher diagnostic accuracy at early‐stage of HBV. We proposed a novel method of HBV diagnosis using deep neural networks with the concept of transfer learning and Raman spectroscopic images. The proposed approach developed by utilizing pretrained convolutional neural networks ResNet101 by employing transfer learning on a real dataset of HBV‐infected blood plasma samples. Dataset consists of 1000 Raman images in which 600 are HBV‐infected blood plasma samples, and 400 are healthy ones. The developed model is capable to detect minute variation between infected and healthy samples and achieved enhanced performance. The proposed approach has been assessed and attained high classification accuracy, sensitivity, specificity, and AUC of 99.7%, 100%, 99.25%, and 98.7%, respectively. The proposed TL‐ResNet101 model outperformed the conventional approaches such as PCA‐SVM and PCA‐LDA and demonstrated improved accuracy more than 7%. High performance indicates that the developed TL‐ResNet101 model has potential to use for HBV diagnosis. Moreover, the developed automated approach can be extended for other disease.     

A mass classification and image retrieval model for mammograms

In this paper, a breast tissue density classification and image retrieval model is studied and a model for the data reduction is presented. This model is based on two-directional two-dimensional principal component analysis ((2D)²PCA) technique, and a support vector machine (SVM) with the radial basis function (RBF) for mammographic images classification and retrieval. The model is formed based on breast density, according to the categories defined by the breast imaging-reporting and data system (BIRADS) which is a standard on the assessment of mammographic images and is tested on the Mammographic Image Analysis Society (MIAS) database. The five-fold cross-validation has been used for the parameters selection in SVM to avoid the over-fitting error in the data classification. The average precision rates of the model are in the range from 87·34% to 99·12%.     

Cancers classification based on deep neural networks and emotional learning approach

In the present era, enormous factors contribute to causing cancer. So cancer classification cannot rely only on doctor''s thoughts. As a result, intelligent algorithms concerning doctor''s help are inevitable. Therefore, the authors are motivated to suggest a novel algorithm to classify three cancer datasets; colon, ALL‐AML, and leukaemia cancers. Their proposed algorithm is based on the deep neural network and emotional learning process. First of all, by applying the principal component analysis, they had a feature reduction. Then, they used deep neural as a feature extraction. Then, they implemented different classifiers; multi‐layer perceptron, support vector machine (SVM), decision tree, and Gaussian mixture model. In the end, because in the real world, especially when working on systems biology, unpredictable events, and uncertainties are undeniable, the robustness of their model against uncertainties is important. So they added Gaussian noise to the input features of the first encoder in each dataset, then, they applied the stacked denoising method. Experimental results disclosed that, generally, using emotional learning increased the accuracy. In addition, the highest accuracy was gained by SVM, 91.66, 92.27, and 96.56% for colon, ALL‐AML, and leukaemia, respectively. However, GMM led to the lowest accuracy. The best accuracy gained by GMM was 60%.Inspec keywords: cancer, learning (artificial intelligence), principal component analysis, multilayer perceptrons, feature extraction, support vector machines, pattern classification, Gaussian processes, decision trees, Gaussian noise, medical computingOther keywords: colon cancer, Gaussian noise, stacked denoising method, SVM, support vector machine, emotional learning process, cancer datasets, intelligent algorithms, cancer classification, ALL‐AML, input features, Gaussian mixture model, decision tree, multilayer perceptron, feature extraction, feature reduction, principal component analysis, deep neural network, leukaemia cancers     

基于支持向量机的印品缺陷分类方法

目的研究印品图像的各类形状缺陷,建立基于支持向量机(Support vector machine,SVM)的印品形状缺陷分类模型。方法对印品进行符合人眼视觉特性的缺陷识别,并对提取缺陷进行特征分析。将特征数据导入支持向量机进行训练学习,SVM分类器对缺陷图像进行测试。结果分类器对点缺陷和面缺陷的识别率为100%,对线缺陷的分类准确率达93.94%。结论基于SVM的缺陷分类方法能较好地满足印品质量检测的需求。     

Deep Transfer Learning Based Detection and Classification of Citrus Plant Diseases

Citrus fruit crops are among the world’s most important agricultural products, but pests and diseases impact their cultivation, resulting in yield and quality losses. Computer vision and machine learning have been widely used to detect and classify plant diseases over the last decade, allowing for early disease detection and improving agricultural production. This paper presented an automatic system for the early detection and classification of citrus plant diseases based on a deep learning (DL) model, which improved accuracy while decreasing computational complexity. The most recent transfer learning-based models were applied to the Citrus Plant Dataset to improve classification accuracy. Using transfer learning, this study successfully proposed a Convolutional Neural Network (CNN)-based pre-trained model (EfficientNetB3, ResNet50, MobiNetV2, and InceptionV3) for the identification and categorization of citrus plant diseases. To evaluate the architecture’s performance, this study discovered that transferring an EfficientNetb3 model resulted in the highest training, validating, and testing accuracies, which were 99.43%, 99.48%, and 99.58%, respectively. In identifying and categorizing citrus plant diseases, the proposed CNN model outperforms other cutting-edge CNN model architectures developed previously in the literature.     

改进MDSMOTE与PSO-SVM在汽车组合仪表分类预测中的应用

汽车组合仪表生产过程中质检项目多且检测时间长,这在一定程度上制约了其生产效率的进一步提升。为此,提出一种基于改进最远点合成少数类过采样技术（max distance synthetic minority over-sampling technique,MDSMOTE）的支持向量机（support vector machine, SVM）分类预测方法。首先,结合专家经验对汽车组合仪表的原始生产数据进行特征筛选,并在MDSMOTE中引入类不平衡率I_R,以对所筛选的特征数据进行扩充;然后,利用粒子群优化（particle swarm optimization, PSO）算法对SVM的误差惩罚因子C和核函数参数γ进行优化;最后,建立优化的SVM分类预测模型,并对汽车组合仪表进行分类。通过与其他分类预测模型在不同数据集上的预测结果进行对比可知,基于改进MDSMOTE的SVM分类预测模型的准确率、F值和几何平均值等评价指标均优于其他模型。所提出方法在汽车仪表产品分类上表现出较强的泛化能力和稳定性,可为仪表制造企业生产效率的提升提供有效参考。     

基于融合特征的短语音汉语声调自动识别方法

提出一种基于韵律特征(基频、时长)和梅尔倒谱系数(Mel-Frequency Cepstral Coefficient,MFCC)特征的融合特征进行短语音汉语声调识别的方法,旨在利用两种特征的优势提高短语音汉语声调识别率。该融合特征包括7个根据不同模型得到的韵律特征和统计参数以及4个从每个音段的梅尔倒谱系数计算得来的对数化后验概率,使用高斯混合模型表示4个声调的倒谱特征的分布。实验分两步:第一步,将基于韵律特征和倒谱特征的分类器在决策阶段混合起来进行声调分类,分别赋予两个分类器权重,计算倒谱特征和韵律特征在声调分类任务中的权重;第二步,将基于字的韵律特征和基于帧的倒谱特征结合起来生成融合特征的超向量,使用融合特征进行汉语声调识别,根据准确率、未加权平均召回率(Unweigted Average Recall,UAR)和科恩卡帕(Cohen’s Kappa)系数3个指标,比较并评估5种分类器(两种设置的高斯混合模型,后向传播神经网络,支持向量机和卷积神经网络(Convolutional Neural Network,CNN))在不平衡数据集上的分类效果。实验结果表明:(1)倒谱特征方法能够提高汉语声调的识别率,该特征在总体分类任务中的权重为0.11;(2)基于融合特征的深度学习(CNN)方法对声调的识别率最高,为87.6%,与高斯混合模型的基线系统相比,提高了5.87%。该研究证明了倒谱特征法能够提供与韵律特征法互补的信息,从而提高短语音汉语声调识别率;同时,该方法可以运用到韵律检测和副语言信息检测等相关研究中。     

Human Gait Recognition: A Deep Learning and Best Feature Selection Framework

Background—Human Gait Recognition (HGR) is an approach based on biometric and is being widely used for surveillance. HGR is adopted by researchers for the past several decades. Several factors are there that affect the system performance such as the walking variation due to clothes, a person carrying some luggage, variations in the view angle. Proposed—In this work, a new method is introduced to overcome different problems of HGR. A hybrid method is proposed or efficient HGR using deep learning and selection of best features. Four major steps are involved in this work-preprocessing of the video frames, manipulation of the pre-trained CNN model VGG-16 for the computation of the features, removing redundant features extracted from the CNN model, and classification. In the reduction of irrelevant features Principal Score and Kurtosis based approach is proposed named PSbK. After that, the features of PSbK are fused in one materix. Finally, this fused vector is fed to the One against All Multi Support Vector Machine (OAMSVM) classifier for the final results. Results—The system is evaluated by utilizing the CASIA B database and six angles 00°, 18°, 36°, 54°, 72°, and 90° are used and attained the accuracy of 95.80%, 96.0%, 95.90%, 96.20%, 95.60%, and 95.50%, respectively. Conclusion—The comparison with recent methods show the proposed method work better.     

Output characteristics of a fibre Raman laser with a composite GeO2 and P2O5-doped silica fibre

Abstract

A new type of fibre Raman laser composed of a GeO₂- and P₂O₅-doped silica fibre was investigated experimentally and theoretically. The output of the laser displays two difference characteristics depending on the type of fibre being used as the input end. Using the P₂O₅-doped fibre as the input end, the Raman Stokes line of 1320cm^?1 shift was enhanced by the latter GeO₂-doped fibre. While the GeO₂-doped fibre used as the input end, a wideband continuous spectrum was obtained. A model including effects of bandwidth of the Raman gain, four-wave mixing and the mutual influence of the GeO₂- and P₂O₅-doped silica fibre was constructed to illustrate the experimental observation.     

Classification of motor imagery electroencephalography signals using continuous small convolutional neural network

As an important part of brain-computer interface (BCI), the electroencephalography (EEG) technology of motor imagery (MI) has been gradually recognized for its great theoretical value and practical application. In this study, in view of the different MI tasks corresponding to active region of the EEG signals, we adopt a two-dimensional form including time, frequency, and electrode location information, then we design a classification method containing continuous small convolutional neural network (CSCNN). This method is mainly used for feature extraction through continuous small convolutional kernels and one rectangle convolutional kernel, and the softmax classifier for classification. In the experiment, classification accuracy and kappa value are used as evaluation criteria to verify the effectiveness of the method proposed in this study. For classification accuracy, BCI competition IV data set 2b is used to compare with the other five classification methods (CNN, CNN-SAE, stacked autoencoder [SAE], support vector machine [SVM], and one-dimensional convolution combined with gated recurrent unit [1DCGRU]). The results demonstrate that the overall accuracy of CSCNN is higher than other methods, and CSCNN obtains an average accuracy of 82.8%. For kappa value, BCI competition IV data set 2b is used to compare with the other three methods (filter bank common spatial pattern [FBCSP], Twin SVM, and CNN-SAE). The performance of CSCNN is better with an average value of 0.663. Overall, the results show that CSCNN maintains a small number of parameters and improves the classification accuracy.     

Epileptic Seizures Diagnosis Using Amalgamated Extremely Focused EEG Signals and Brain MRI

There exists various neurological disorder based diseases like tumor, sleep disorder, headache, dementia and Epilepsy. Among these, epilepsy is the most common neurological illness in humans, comparable to stroke. Epilepsy is a severe chronic neurological illness that can be discovered through analysis of the signals generated by brain neurons and brain Magnetic resonance imaging (MRI). Neurons are intricately coupled in order to communicate and generate signals from human organs. Due to the complex nature of electroencephalogram (EEG) signals and MRI’s the epileptic seizures detection and brain related problems diagnosis becomes a challenging task. Computer based techniques and machine learning models are continuously giving their contributions to diagnose all such diseases in a better way than the normal process of diagnosis. Their performance may sometime degrade due to missing information, selection of poor classification model and unavailability of quality data that are used to train the models for better prediction. This research work is an attempt to epileptic seizures detection by using a multi focus dataset based on EEG signals and brain MRI. The key steps of this work are: feature extraction having two different streams i.e., EEG using wavelet transformation along with SVD-Entropy, and MRI using convolutional neural network (CNN), after extracting features from both streams, feature fusion is applied to generate feature vector used by support vector machine (SVM) to diagnose the epileptic seizures. From the experimental evaluation and results comparison with the current state-of-the-art techniques, it has been concluded that the performance of the proposed scheme is better than the existing models.

     

Application research on semi-definite programming optimized support vector machines

The kernel function optimization is the key issues to address when using the support vector machine (SVM) algorithm. To solve the parameter selection for the SVM, a semi-definite programming optimized SVM (SDP-SVM) algorithm is proposed in this paper. The steps of the algorithm are described, and the optimization of the kernel function is shown using an SDP method. The SDP method is used to find the best parameter of SVM. The heart_scale data in the University of California Irvine database are then simulated using the SDP-SVM model. The experimental results shows that the generalization capability and the classification accuracy of the SDP-SVM algorithm have been greatly improved. A variety of strip-steel surface defect images from actual production are classified using the SDP-SVM algorithm, and the results show that the classification method of the SDP-SVM algorithm has high classification accuracy, strong practicability, and a wide variety of application prospects.     

A hybrid SVM and supervised learning approach to fuzzy min‐max hyperbox classifiers

Abstract

In this paper, a fuzzy min‐max hyperbox classifier is designed to solve M‐class classification problems using a hybrid SVM and supervised learning approach. In order to solve a classification problem, a set of training patterns is gathered from a considered classification problem. However, the training set may include several noisy patterns. In order to delete the noisy patterns from the training set, the support vector machine is applied to find the noisy patterns so that the remaining training patterns can describe the behavior of the considered classification system well. Subsequently, a supervised learning method is proposed to generate fuzzy min‐max hyperboxes for the remaining training patterns so that the generated fuzzy min‐max hyperbox classifier has good generalization performance. Finally, the Iris data set is considered to demonstrate the good performance of the proposed approach for solving this classification problem.