Breast cancer histopathology image classification using kernelized weighted extreme learning machine

Histopathology is considered as the gold standard for diagnosing breast cancer. Traditional machine learning (ML) algorithm provides a promising performance for cancer diagnosis if the training dataset is balanced. Nevertheless, if the training dataset is imbalanced the performance of the ML model is skewed toward the majority class. It may pose a problem for the pathologist because if the benign sample is misclassified as malignant, then a pathologist could make a misjudgment about the diagnosis. A limited investigation has been done in literature for solving the class imbalance problem in computer‐aided diagnosis (CAD) of breast cancer using histopathology. This work proposes a hybrid ML model to solve the class imbalance problem. The proposed model employs pretrained ResNet50 and the kernelized weighted extreme learning machine for CAD of breast cancer using histopathology. The breast cancer histopathological images are obtained from publicly available BreakHis and BisQue datasets. The proposed method achieved a reasonable performance for the classification of the minority as well as the majority class instances. In comparison, the proposed approach outperforms the state‐of‐the‐art ML models implemented in previous studies using the same training‐testing folds of the publicly accessible BreakHis dataset.     

Residual learning based CNN for breast cancer histopathological image classification

Biopsy is one of the most commonly used modality to identify breast cancer in women, where tissue is removed and studied by the pathologist under the microscope to look for abnormalities in tissue. This technique can be time-consuming, error-prone, and provides variable results depending on the expertise level of the pathologist. An automated and efficient approach not only aids in the diagnosis of breast cancer but also reduces human effort. In this paper, we develop an automated approach for the diagnosis of breast cancer tumors using histopathological images. In the proposed approach, we design a residual learning-based 152-layered convolutional neural network, named as ResHist for breast cancer histopathological image classification. ResHist model learns rich and discriminative features from the histopathological images and classifies histopathological images into benign and malignant classes. In addition, to enhance the performance of the developed model, we design a data augmentation technique, which is based on stain normalization, image patches generation, and affine transformation. The performance of the proposed approach is evaluated on publicly available BreaKHis dataset. The proposed ResHist model achieves an accuracy of 84.34% and an F1-score of 90.49% for the classification of histopathological images. Also, this approach achieves an accuracy of 92.52% and F1-score of 93.45% when data augmentation is employed. The proposed approach outperforms the existing methodologies in the classification of benign and malignant histopathological images. Furthermore, our experimental results demonstrate the superiority of our approach over the pre-trained networks, namely AlexNet, VGG16, VGG19, GoogleNet, Inception-v3, ResNet50, and ResNet152 for the classification of histopathological images.     

Optimal Deep Transfer Learning Model for Histopathological Breast CancerClassification

Earlier recognition of breast cancer is crucial to decrease the severity and optimize the survival rate. One of the commonly utilized imaging modalities for breast cancer is histopathological images. Since manual inspection of histopathological images is a challenging task, automated tools using deep learning (DL) and artificial intelligence (AI) approaches need to be designed. The latest advances of DL models help in accomplishing maximum image classification performance in several application areas. In this view, this study develops a Deep Transfer Learning with Rider Optimization Algorithm for Histopathological Classification of Breast Cancer (DTLRO-HCBC) technique. The proposed DTLRO-HCBC technique aims to categorize the existence of breast cancer using histopathological images. To accomplish this, the DTLRO-HCBC technique undergoes pre-processing and data augmentation to increase quantitative analysis. Then, optimal SqueezeNet model is employed for feature extractor and the hyperparameter tuning process is carried out using the Adadelta optimizer. Finally, rider optimization with deep feed forward neural network (RO-DFFNN) technique was utilized employed for breast cancer classification. The RO algorithm is applied for optimally adjusting the weight and bias values of the DFFNN technique. For demonstrating the greater performance of the DTLRO-HCBC approach, a sequence of simulations were carried out and the outcomes reported its promising performance over the current state of art approaches.     

Deep learning and machine learning-based early survival predictions of glioblastoma patients using pre-operative three-dimensional brain magnetic resonance imaging modalities

To propose and implement an automated machine learning (ML) based methodology to predict the overall survival of glioblastoma multiforme (GBM) patients. In the proposed methodology, we used deep learning (DL) based 3D U-shaped Convolutional Neural Network inspired encoder-decoder architecture to segment the brain tumor. Further, feature extraction was performed on these segmented and raw magnetic resonance imaging (MRI) scans using a pre-trained 2D residual neural network. The dimension-reduced principal components were integrated with clinical data and the handcrafted features of tumor subregions to compare the performance of regression-based automated ML techniques. Through the proposed methodology, we achieved the mean squared error (MSE) of 87 067.328, median squared error of 30 915.66, and a SpearmanR correlation of 0.326 for survival prediction (SP) with the validation set of Multimodal Brain Tumor Segmentation 2020 dataset. These results made the MSE far better than the existing automated techniques for the same patients. Automated SP of GBM patients is a crucial topic with its relevance in clinical use. The results proved that DL-based feature extraction using 2D pre-trained networks is better than many heavily trained 3D and 2D prediction models from scratch. The ensembled approach has produced better results than single models. The most crucial feature affecting GBM patients' survival is the patient's age, as per the feature importance plots presented in this work. The most critical MRI modality for SP of GBM patients is the T2 fluid attenuated inversion recovery, as evident from the feature importance plots.     

Ensembles of Deep Learning Framework for Stomach Abnormalities Classification

Abnormalities of the gastrointestinal tract are widespread worldwide today. Generally, an effective way to diagnose these life-threatening diseases is based on endoscopy, which comprises a vast number of images. However, the main challenge in this area is that the process is time-consuming and fatiguing for a gastroenterologist to examine every image in the set. Thus, this led to the rise of studies on designing AI-based systems to assist physicians in the diagnosis. In several medical imaging tasks, deep learning methods, especially convolutional neural networks (CNNs), have contributed to the state-of-the-art outcomes, where the complicated nonlinear relation between target classes and data can be learned and not limit to hand-crafted features. On the other hand, hyperparameters are commonly set manually, which may take a long time and leave the risk of non-optimal hyperparameters for classification. An effective tool for tuning optimal hyperparameters of deep CNN is Bayesian optimization. However, due to the complexity of the CNN, the network can be regarded as a black-box model where the information stored within it is hard to interpret. Hence, Explainable Artificial Intelligence (XAI) techniques are applied to overcome this issue by interpreting the decisions of the CNNs in such wise the physicians can trust. To play an essential role in real-time medical diagnosis, CNN-based models need to be accurate and interpretable, while the uncertainty must be handled. Therefore, a novel method comprising of three phases is proposed to classify these life-threatening diseases. At first, hyperparameter tuning is performed using Bayesian optimization for two state-of-the-art deep CNNs, and then Darknet53 and InceptionV3 features are extracted from these fine-tunned models. Secondly, XAI techniques are used to interpret which part of the images CNN takes for feature extraction. At last, the features are fused, and uncertainties are handled by selecting entropy-based features. The experimental results show that the proposed method outperforms existing methods by achieving an accuracy of 97% based on a Bayesian optimized Support Vector Machine classifier.

     

On the Detection of COVID-19 from Chest X-Ray Images Using CNN-Based Transfer Learning

Coronavirus disease (COVID-19) is an extremely infectious disease and possibly causes acute respiratory distress or in severe cases may lead to death. There has already been some research in dealing with coronavirus using machine learning algorithms, but few have presented a truly comprehensive view. In this research, we show how convolutional neural network (CNN) can be useful to detect COVID-19 using chest X-ray images. We leverage the CNN-based pre-trained models as feature extractors to substantiate transfer learning and add our own classifier in detecting COVID-19. In this regard, we evaluate performance of five different pre-trained models with fine-tuning the weights from some of the top layers. We also develop an ensemble model where the predictions from all chosen pre-trained models are combined to generate a single output. The models are evaluated through 5-fold cross validation using two publicly available data repositories containing healthy and infected (both COVID-19 and other pneumonia) chest X-ray images. We also leverage two different visualization techniques to observe how efficiently the models extract important features related to the detection of COVID- 19 patients. The models show high degree of accuracy, precision, and sensitivity. We believe that the models will aid medical professionals with improved and faster patient screening and pave a way to further COVID-19 research.     

Mobile application-based computer-aided diagnosis of skin tumours from dermal images

Skin tumour is defined as the enormous growth of cells in the skin. The aim is to design standalone application for diagnosis of skin tumours. The dermal images of three different types obtained from the authorized PH2 database are used to analyse the defined image processing algorithm. In this algorithm, pre-processing was performed to remove hair cells. Contour-based level set is used to segment lesion from which clinical and morphological features are extracted for classification. Significant features are obtained with the feature selection technique, Random subset. Classification is performed with three classifiers. The efficiency of the classifier obtained with different trials of classification is analysed with the ANOVA test. With these results, the Multiclass Support vector machine was configured as a suitable classifier to categorize dermal images. Therefore, an application is developed for the analysis of images acquired through mobile with the help of a magnification set-up. Thus, extracted features, segmented and original images are transferred to a database for storage.     

Optimized Convolutional Neural Network Models for Skin Lesion Classification

Skin cancer is one of the most severe diseases, and medical imaging is among the main tools for cancer diagnosis. The images provide information on the evolutionary stage, size, and location of tumor lesions. This paper focuses on the classification of skin lesion images considering a framework of four experiments to analyze the classification performance of Convolutional Neural Networks (CNNs) in distinguishing different skin lesions. The CNNs are based on transfer learning, taking advantage of ImageNet weights. Accordingly, in each experiment, different workflow stages are tested, including data augmentation and fine-tuning optimization. Three CNN models based on DenseNet-201, Inception-ResNet-V2, and Inception-V3 are proposed and compared using the HAM10000 dataset. The results obtained by the three models demonstrate accuracies of 98%, 97%, and 96%, respectively. Finally, the best model is tested on the ISIC 2019 dataset showing an accuracy of 93%. The proposed methodology using CNN represents a helpful tool to accurately diagnose skin cancer disease.     

An approach for classification of malignant and benign microcalcification clusters

The only reliable and successful treatment of breast cancer is its detection through mammography at initial stage. Clusters of microcalcifications are important signs of breast cancer. Manual interpretation of mammographic images, in which the suspicious regions are indicated as areas of varying intensities, is not error free due to a number of reasons. These errors can be reduced by using computer-aided diagnosis systems that result in reduction of either false positives or true negatives. The purpose of the study in this paper is to develop a methodology for distinguishing malignant microcalcification clusters from benign microcalcification clusters. The proposed approach first enhances the region of interest by using morphological operations. Then, two types of features, cluster shape features and cluster texture features, are extracted. A Support Vector Machine is used for classification. A new set of shape features based on the recursive subsampling method is added to the feature set, which improves the classification accuracy of the system. It has been found that these features are capable of differentiating malignant and benign tissue regions. To investigate the performance of the proposed approach, mammogram images are taken from Digital Database for Screening Mammography database and an accuracy of 94.25% has been achieved. The experiments have shown that the proposed classification system minimizes the classification errors and is more efficient in correct diagnosis.     

基于多元图像特征分析的印刷单元故障诊断方法

目的提出一种基于画面分析的机械故障诊断方法,用于印刷机械中印刷单元的故障模式分类。方法通过印刷特定图像,获取印刷单元在正常与故障状态下的印刷画面,从网点覆盖率、灰度特征和画面纹理特征等3个方面构建表征印刷单元状态的多元图像特征集,并通过SVM构建故障识别网络。结果利用多元统计方法分析了印刷单元6类故障与特征集的映射关系,依靠画面特征实现了故障类别判断;经过实际故障诊断试验验证,所提出方法的准确率可达90%以上。结论图像特征集对于印刷机故障有着很好的分类表征能力,为印刷机维护提供了新的理论和方法。     

Classification of Coronavirus (COVID‐19) from X‐ray and CT images using shrunken features

Necessary screenings must be performed to control the spread of the COVID‐19 in daily life and to make a preliminary diagnosis of suspicious cases. The long duration of pathological laboratory tests and the suspicious test results led the researchers to focus on different fields. Fast and accurate diagnoses are essential for effective interventions for COVID‐19. The information obtained by using X‐ray and Computed Tomography (CT) images is vital in making clinical diagnoses. Therefore it is aimed to develop a machine learning method for the detection of viral epidemics by analyzing X‐ray and CT images. In this study, images belonging to six situations, including coronavirus images, are classified using a two‐stage data enhancement approach. Since the number of images in the dataset is deficient and unbalanced, a shallow image augmentation approach was used in the first phase. It is more convenient to analyze these images with hand‐crafted feature extraction methods because the dataset newly created is still insufficient to train a deep architecture. Therefore, the Synthetic minority over‐sampling technique algorithm is the second data enhancement step of this study. Finally, the feature vector is reduced in size by using a stacked auto‐encoder and principal component analysis methods to remove interconnected features in the feature vector. According to the obtained results, it is seen that the proposed method has leveraging performance, especially to make the diagnosis of COVID‐19 in a short time and effectively. Also, it is thought to be a source of inspiration for future studies for deficient and unbalanced datasets.     

Enhance Egocentric Grasp Recognition Based Flex Sensor Under Low Illumination

Egocentric recognition is exciting computer vision research by acquiring images and video from the first-person overview. However, an image becomes noisy and dark under low illumination conditions, making subsequent hand detection tasks difficult. Thus, image enhancement is necessary to make buried detail more visible. This article addresses the challenge of egocentric hand grasp recognition in low light conditions by utilizing the flex sensor and image enhancement algorithm based on adaptive gamma correction with weighting distribution. Initially, a flex sensor is installed to the thumb for object manipulation. The thumb placement that holds in a different position on the object of each grasp affects the voltage changing of the flex sensor circuit. The average voltages are used to configure the weighting parameter to improve images in the image enhancement stage. Moreover, the contrast and gamma function are used to adjust varies the low light condition. These grasp images are then separated to be training and testing with pre-trained deep neural networks as the feature extractor in YOLOv2 detection network for the grasp recognition system. The proposed of using a flex sensor significantly improves the grasp recognition rate in low light conditions.     

Detection and classification of microcalcification from digital mammograms with firefly algorithm,extreme learning machine and non-linear regression models: A comparison

In this study, abnormalities in medical images are analysed using three classifiers, and the results are compared. Breast cancer remains a major public health problem among women worldwide. Recently, many algorithms have evolved for the investigation of breast cancer diagnosis through medical imaging. A computer-aided microcalcification detection method is proposed to categorise the nature of breast cancer as either benign or malignant from input mammogram images. The standard mammogram image corpus, the Mammogram Image Analysis Society database is utilised, and feature extraction is performed using five different wavelet families at level 4 and level 6 decomposition. The work is accomplished through firefly algorithm (FA), extreme learning machine (ELM) and least-square-based non-linear regression (LSNLR) classifiers. The performance of the classifiers is compared by benchmark metrics, such as total error rate, specificity, sensitivity, area under the receiver operating characteristic curve, precision, F1 score and the Matthews correlation coefficient. As validation of the classifier results, a kappa analysis is included to determine the agreement among classifiers. The LSNLR classifier attains a 3% to 7% improvement in average accuracy compared with the average classification accuracy of the FA (86.75%) and ELM (90.836%) classifiers.     

Face recognition using Krawtchouk moment

Feature extraction is one of the important tasks in face recognition. Moments are widely used feature extractor due to their superior discriminatory power and geometrical invariance. Moments generally capture the global features of the image. This paper proposes Krawtchouk moment for feature extraction in face recognition system, which has the ability to extract local features from any region of interest. Krawtchouk moment is used to extract both local features and global features of the face. The extracted features are fused using summed normalized distance strategy. Nearest neighbour classifier is employed to classify the faces. The proposed method is tested using ORL and Yale databases. Experimental results show that the proposed method is able to recognize images correctly, even if the images are corrupted with noise and possess change in facial expression and tilt.     

A Novel Hybrid Machine Learning Approach for Classification of Brain Tumor Images

Abnormal growth of brain tissues is the real cause of brain tumor. Strategy for the diagnosis of brain tumor at initial stages is one of the key step for saving the life of a patient. The manual segmentation of brain tumor magnetic resonance images (MRIs) takes time and results vary significantly in low-level features. To address this issue, we have proposed a ResNet-50 feature extractor depended on multilevel deep convolutional neural network (CNN) for reliable images segmentation by considering the low-level features of MRI. In this model, we have extracted features through ResNet-50 architecture and fed these feature maps to multi-level CNN model. To handle the classification process, we have collected a total number of 2043 MRI patients of normal, benign, and malignant tumor. Three model CNN, multi-level CNN, and ResNet-50 based multi-level CNN have been used for detection and classification of brain tumors. All the model results are calculated in terms of various numerical values identified as precision (P), recall (R), accuracy (Acc) and f1-score (F1-S). The obtained average results are much better as compared to already existing methods. This modified transfer learning architecture might help the radiologists and doctors as a better significant system for tumor diagnosis.     

Detection of pneumonia in chest X‐ray images by using 2D discrete wavelet feature extraction with random forest

Pneumonia is one of the most common and fatal diseases in the world. Early diagnosis and treatment are important factors in reducing mortality caused by the aforementioned disease. One of the most important and common techniques to diagnose pneumonia disease is the X‐ray images. By evaluating these images, various machine‐learning methods are used for accuracy in diagnosis. The presented study in this article utilizes machine‐learning techniques to evaluate these X‐ray images. The diagnosis of pediatric pneumonia is classified with a proposed machine learning method by using the chest X‐ray images. The proposed system firstly utilizes a two‐dimensional discrete wavelet transform to extract features from images. The features obtained from the wavelet method are labeled as normal and pneumonia and applied to the classifier for classification. Besides, Random Forest algorithm is used for the classification technique of 5856 X‐ray images. A 10‐fold cross‐validation method is used to evaluate the success of the proposed method and to ensure that the system avoided overfitting. By using various machine learning algorithms, simulation results reveal that the Random Forest method is proposed and it gives successful results. Results also show that, at the end of the training and validation process, the proposed method achieves higher success with an accuracy of 97.11%.     

Multiclass Stomach Diseases Classification Using Deep Learning Features Optimization

In the area of medical image processing, stomach cancer is one of the most important cancers which need to be diagnose at the early stage. In this paper, an optimized deep learning method is presented for multiple stomach disease classification. The proposed method work in few important steps—preprocessing using the fusion of filtering images along with Ant Colony Optimization (ACO), deep transfer learning-based features extraction, optimization of deep extracted features using nature-inspired algorithms, and finally fusion of optimal vectors and classification using Multi-Layered Perceptron Neural Network (MLNN). In the feature extraction step, pre-trained Inception V3 is utilized and retrained on selected stomach infection classes using the deep transfer learning step. Later on, the activation function is applied to Global Average Pool (GAP) for feature extraction. However, the extracted features are optimized through two different nature-inspired algorithms—Particle Swarm Optimization (PSO) with dynamic fitness function and Crow Search Algorithm (CSA). Hence, both methods’ output is fused by a maximal value approach and classified the fused feature vector by MLNN. Two datasets are used to evaluate the proposed method—CUI WahStomach Diseases and Combined dataset and achieved an average accuracy of 99.5%. The comparison with existing techniques, it is shown that the proposed method shows significant performance.     

Engagement Detection Based on Analyzing Micro Body Gestures Using 3D CNN

This paper proposes a novel, efficient and affordable approach to detect the students’ engagement levels in an e-learning environment by using webcams. Our method analyzes spatiotemporal features of e-learners’ micro body gestures, which will be mapped to emotions and appropriate engagement states. The proposed engagement detection model uses a three-dimensional convolutional neural network to analyze both temporal and spatial information across video frames. We follow a transfer learning approach by using the C3D model that was trained on the Sports-1M dataset. The adopted C3D model was used based on two different approaches; as a feature extractor with linear classifiers and a classifier after applying fine-tuning to the pre-trained model. Our model was tested and its performance was evaluated and compared to the existing models. It proved its effectiveness and superiority over the other existing methods with an accuracy of 94%. The results of this work will contribute to the development of smart and interactive e-learning systems with adaptive responses based on users’ engagement levels.     

Automatic diagnosis of ureteral stone and degree of hydronephrosis with proposed convolutional neural network,RelieF, and gradient-weighted class activation mapping based deep hybrid model

Urinary system stone disease is a common disease group all over the world. Ureteral stones constitute 20% of all urinary system stones. Ureteral stones are important because they can cause hydronephrosis and related renal parenchymal damage in the kidneys. In the study, a hybrid model was developed to detect hydronephrosis and ureteral stones from kidney images. In the developed model, heat maps of the original images were obtained by using gradient-weighted class activation mapping (Grad-CAM) technology. Then, feature maps were extracted from both the original and heatmap datasets using the Efficientnetb0 architecture. Extracted feature maps were concatenated using a multimodal fusion technique. In this way, different features of an image are obtained. This has a positive effect on the performance of the model. The Relief dimension reduction technique was used to eliminate unnecessary features in the obtained feature map so that the proposed model can work faster and more effectively. Finally, the optimized feature map is classified in the support vector machine (SVM) classifier. To compare the performance of the proposed hybrid model, results were obtained with 8 state-of-the-art models accepted in the literature. Among these models, the highest accuracy value was achieved in the Efficientnetb0 architecture with 67.98%, whereas the accuracy of the proposed hybrid model was 91.1%. This value indicates that the proposed model can be used for HUN diagnosis.