Imprint cytology‐based breast malignancy screening: an efficient nuclei segmentation technique

Imprint cytology (IC) refers to one of the most reliable, rapid and affordable techniques for breast malignancy screening; where shape variation of H&E stained nucleus is examined by the pathologists. This work aims at developing an automated and efficient segmentation algorithm by integrating Lagrange's interpolation and superpixels in order to delineate overlapped nuclei of breast cells (normal and malignant). Subsequently, a computer assisted IC tool has been designed for breast cancer (BC) screening. The proposed methodology consists of mainly three subsections: gamma correction for preprocessing, single nuclei segmentation and segmentation of overlapping nuclei. Single nuclei segmentation combines histogram‐based thresholding and morphological operations; where segmentation of overlapping nuclei includes concave point detection, Lagrange's interpolation for overlapping arc area detection and the fine segmentation of overlapped arc area by superpixels. Total 16 significant features (p < 0.05) quantifying shape and texture of nucleus were extracted, and random forest (RF) classifier was skilled for automated screening. The proposed methodology has been tested on 120 IC images (approximately 12 000 nuclei); where 98% segmentation accuracy and 99% classification accuracy were achieved. Besides, performance evaluation was studied by using Jaccard's index (= 94%), correlation coefficient (= 95%), Dice similarity coefficient (= 97%) and Hausdorff distance (= 43%). The proposed approach could offer benefit to the pathologists for confirmatory BC screening with improved accuracy and could potentially lead to a better shape understanding of malignant nuclei.     

Entropy‐assisted image segmentation for nano‐ and micro‐sized networks

Image analysis is an important tool for characterizing nano/micro network structures. To understand the connection, organization and proper alignment of network structures, the knowledge of the segments that represent the materials inside the image is very necessary. Image segmentation is generally carried out using statistical methods. In this study, we developed a simple and reliable masking method that improves the performance of the indicator kriging method by using entropy. This method selectively chooses important pixels in an image (optical or electron microscopy image) depending on the degree of information required to assist the thresholding step. Reasonable threshold values can be obtained by selectively choosing important pixels in a complex network image composed of extremely large numbers of thin and narrow objects. Thus, the overall image segmentation can be improved as the number of disconnected objects in the network is minimized. Moreover, we also proposed a new method for analyzing high‐pixel resolution images on a large scale and optimized the time‐consuming steps such as covariance estimation of low‐pixel resolution image, which is rescaled by performing the affine transformation on high‐pixel resolution images. Herein, image segmentation is executed in the original high‐pixel resolution image. This entropy‐based masking method of low‐pixel resolution significantly decreases the analysis time without sacrificing accuracy.     

MRF‐ANN: a machine learning approach for automated ER scoring of breast cancer immunohistochemical images

Molecular pathology, especially immunohistochemistry, plays an important role in evaluating hormone receptor status along with diagnosis of breast cancer. Time‐consumption and inter‐/intraobserver variability are major hindrances for evaluating the receptor score. In view of this, the paper proposes an automated Allred Scoring methodology for estrogen receptor (ER). White balancing is used to normalize the colour image taking into consideration colour variation during staining in different labs. Markov random field model with expectation‐maximization optimization is employed to segment the ER cells. The proposed segmentation methodology is found to have F‐measure 0.95. Artificial neural network is subsequently used to obtain intensity‐based score for ER cells, from pixel colour intensity features. Simultaneously, proportion score – percentage of ER positive cells is computed via cell counting. The final ER score is computed by adding intensity and proportion scores – a standard Allred scoring system followed by pathologists. The classification accuracy for classification of cells by classifier in terms of F‐measure is 0.9626. The problem of subjective interobserver ability is addressed by quantifying ER score from two expert pathologist and proposed methodology. The intraclass correlation achieved is greater than 0.90. The study has potential advantage of assisting pathologist in decision making over manual procedure and could evolve as a part of automated decision support system with other receptor scoring/analysis procedure.     

A novel segmentation approach for noisy medical images using Intuitionistic fuzzy divergence with neighbourhood‐based membership function

Medical image segmentation demands higher segmentation accuracy especially when the images are affected by noise. This paper proposes a novel technique to segment medical images efficiently using an intuitionistic fuzzy divergence–based thresholding. A neighbourhood‐based membership function is defined here. The intuitionistic fuzzy divergence–based image thresholding technique using the neighbourhood‐based membership functions yield lesser degradation of segmentation performance in noisy environment. Its ability in handling noisy images has been validated. The algorithm is independent of any parameter selection. Moreover, it provides robustness to both additive and multiplicative noise. The proposed scheme has been applied on three types of medical image datasets in order to establish its novelty and generality. The performance of the proposed algorithm has been compared with other standard algorithms viz. Otsu's method, fuzzy C‐means clustering, and fuzzy divergence–based thresholding with respect to (1) noise‐free images and (2) ground truth images labelled by experts/clinicians. Experiments show that the proposed methodology is effective, more accurate and efficient for segmenting noisy images.     

Structure similarity‐guided image binarization for automatic segmentation of epidermis surface microstructure images

Partitioning epidermis surface microstructure (ESM) images into skin ridge and skin furrow regions is an important preprocessing step before quantitative analyses on ESM images. Binarization segmentation is a potential technique for partitioning ESM images because of its computational simplicity and ease of implementation. However, even for some state‐of‐the‐art binarization methods, it remains a challenge to automatically segment ESM images, because the grey‐level histograms of ESM images have no obvious external features to guide automatic assessment of appropriate thresholds. Inspired by human visual perceptual functions of structural feature extraction and comparison, we propose a structure similarity‐guided image binarization method. The proposed method seeks for the binary image that best approximates the input ESM image in terms of structural features. The proposed method is validated by comparing it with two recently developed automatic binarization techniques as well as a manual binarization method on 20 synthetic noisy images and 30 ESM images. The experimental results show: (1) the proposed method possesses self‐adaption ability to cope with different images with same grey‐level histogram; (2) compared to two automatic binarization techniques, the proposed method significantly improves average accuracy in segmenting ESM images with an acceptable decrease in computational efficiency; (3) and the proposed method is applicable for segmenting practical EMS images. (Matlab code of the proposed method can be obtained by contacting with the corresponding author.)     

基于区域划分的多特征纹理图像分割

由于纹理图像的复杂性和多样性,仅依靠传统的单一特征实现纹理图像分割无法满足其对分割精度的要求。本文提出结合区域划分的多特征纹理图像分割方法。首先,依据像素灰度的空间相关性定义多个纹理特征;然后利用区域划分将图像域划分成不同子区域,待分割同质区域由这些子区域拟合而成;通过分别定义多个特征图像的同质区域之间的异质性势能函数和刻画各子区域邻域关系势能函数来定义全局势能函数,并构建非约束吉布斯概率分布,从而建立纹理分割模型;最后,采用M-H算法采样上述概率分布,从而获得最优图像分割结果。分别对模拟纹理图像、遥感图像、自然纹理图像和SAR海冰图像进行了分割实验,并与利用单一特征得到的分割结果进行对比分析,定性和定量的测试结果验证了算法的有效性。     

Automatic segmentation of fluorescence lifetime microscopy images of cells using multiresolution community detection—a first study

Inspired by a multiresolution community detection based network segmentation method, we suggest an automatic method for segmenting fluorescence lifetime (FLT) imaging microscopy (FLIM) images of cells in a first pilot investigation on two selected images. The image processing problem is framed as identifying segments with respective average FLTs against the background in FLIM images. The proposed method segments a FLIM image for a given resolution of the network defined using image pixels as the nodes and similarity between the FLTs of the pixels as the edges. In the resulting segmentation, low network resolution leads to larger segments, and high network resolution leads to smaller segments. Furthermore, using the proposed method, the mean‐square error in estimating the FLT segments in a FLIM image was found to consistently decrease with increasing resolution of the corresponding network. The multiresolution community detection method appeared to perform better than a popular spectral clustering‐based method in performing FLIM image segmentation. At high resolution, the spectral segmentation method introduced noisy segments in its output, and it was unable to achieve a consistent decrease in mean‐square error with increasing resolution.     

Microscopic melanoma detection and classification: A framework of pixel‐based fusion and multilevel features reduction

The numbers of diagnosed patients by melanoma are drastic and contribute more deaths annually among young peoples. An approximately 192,310 new cases of skin cancer are diagnosed in 2019, which shows the importance of automated systems for the diagnosis process. Accordingly, this article presents an automated method for skin lesions detection and recognition using pixel‐based seed segmented images fusion and multilevel features reduction. The proposed method involves four key steps: (a) mean‐based function is implemented and fed input to top‐hat and bottom‐hat filters which later fused for contrast stretching, (b) seed region growing and graph‐cut method‐based lesion segmentation and fused both segmented lesions through pixel‐based fusion, (c) multilevel features such as histogram oriented gradient (HOG), speeded up robust features (SURF), and color are extracted and simple concatenation is performed, and (d) finally variance precise entropy‐based features reduction and classification through SVM via cubic kernel function. Two different experiments are performed for the evaluation of this method. The segmentation performance is evaluated on PH2, ISBI2016, and ISIC2017 with an accuracy of 95.86, 94.79, and 94.92%, respectively. The classification performance is evaluated on PH2 and ISBI2016 dataset with an accuracy of 98.20 and 95.42%, respectively. The results of the proposed automated systems are outstanding as compared to the current techniques reported in state of art, which demonstrate the validity of the proposed method.     

Automated nuclei segmentation of malignant using level sets

Segmentation of objects from a noisy and complex image is still a challenging task that needs to be addressed. This article proposed a new method to detect and segment nuclei to determine whether they are malignant or not (determination of the region of interest, noise removal, enhance the image, candidate detection is employed on the centroid transform to evaluate the centroid of each object, the level set [LS] is applied to segment the nuclei). The proposed method consists of three main stages: preprocessing, seed detection, and segmentation. Preprocessing stage involves the preparation of the image conditions to ensure that they meet the segmentation requirements. Seed detection detects the seed point to be used in the segmentation stage, which refers to the process of segmenting the nuclei using the LS method. In this research work, 58 H&E breast cancer images from the UCSB Bio‐Segmentation Benchmark dataset are evaluated. The proposed method reveals the high performance and accuracy in comparison to the techniques reported in literature. The experimental results are also harmonized with the ground truth images.     

Semi-automated imaging system to quantitate estrogen and progesterone receptor immunoreactivity in human breast cancer

A semi‐automated imaging system is described to quantitate estrogen and progesterone receptor immunoreactivity in human breast cancer. The system works for any conventional method of image acquisition using microscopic slides that have been processed for immunohistochemical analysis of the estrogen receptor and progesterone receptor. Estrogen receptor and progesterone receptor immunohistochemical staining produce colorimetric differences in nuclear staining that conventionally have been interpreted manually by pathologists and expressed as percentage of positive tumoral nuclei. The estrogen receptor and progesterone receptor status of human breast cancer represent important prognostic and predictive markers of human breast cancer that dictate therapeutic decisions but their subjective interpretation result in interobserver, intraobserver and fatigue variability. Subjective measurements are traditionally limited to a determination of percentage of tumoral nuclei that show positive immunoreactivity. To address these limitations, imaging algorithms utilizing both colorimetric (RGB) as well as intensity (gray scale) determinations were used to analyze pixels of the acquired image. Image acquisition utilized either scanner or microscope with attached digital or analogue camera capable of producing images with a resolution of 20 pixels /10 μ. Areas of each image were screened and the area of interest richest in tumour cells manually selected for image processing. Images were processed initially by JPG conversion of SVS scanned virtual slides or direct JPG photomicrograph capture. Following image acquisition, images were screened for quality, enhanced and processed. The algorithm‐based values for estrogen receptor and progesterone receptor percentage nuclear positivity both strongly correlated with the subjective measurements (intraclass correlation: 0.77; 95% confidence interval: 0.59, 0.95) yet exhibited no interobserver, intraobserver or fatigue variability. In addition the algorithms provided measurements of nuclear estrogen receptor and progesterone receptor staining intensity (mean, mode and median staining intensity of positive staining nuclei), parameters that subjective review could not assess. Other semi‐automated image analysis systems have been used to measure estrogen receptor and progesterone receptor immunoreactivity but these either have required proprietary hardware or have been based on luminosity differences alone. By contrast our algorithms were independent of proprietary hardware and were based on not just luminosity and colour but also many other imaging features including epithelial pattern recognition and nuclear morphology. These features provide a more accurate, versatile and robust imaging analysis platform that can be fully automated in the near future. Because of all these properties, our semi‐automated imaging system ‘adds value’ as a means of measuring these important nuclear biomarkers of human breast cancer.     

Cloud‐based decision support system for the detection and classification of malignant cells in breast cancer using breast cytology images

The advancement of computer‐ and internet‐based technologies has transformed the nature of services in healthcare by using mobile devices in conjunction with cloud computing. The classical phenomenon of patient–doctor diagnostics is extended to a more robust advanced concept of E‐health, where remote online/offline treatment and diagnostics can be performed. In this article, we propose a framework which incorporates a cloud‐based decision support system for the detection and classification of malignant cells in breast cancer, while using breast cytology images. In the proposed approach, shape‐based features are used for the detection of tumor cells. Furthermore, these features are used for the classification of cells into malignant and benign categories using Naive Bayesian and Artificial Neural Network. Moreover, an important phase addressed in the proposed framework is the grading of the affected cells, which could help in grade level necessary medical procedures for patients during the diagnostic process. For demonstrating the e effectiveness of the proposed approach, experiments are performed on real data sets comprising of patients data, which has been collected from the pathology department of Lady Reading Hospital of Pakistan. Moreover, a cross‐validation technique has been performed for the evaluation of the classification accuracy, which shows performance accuracy of 98% as compared to physical methods used by a pathologist for the detection and classification of the malignant cell. Experimental results show that the proposed approach has significantly improved the detection and classification of the malignant cells in breast cytology images.     

Clustered nuclei splitting via curvature information and gray‐scale distance transform

Clusters or clumps of cells or nuclei are frequently observed in two dimensional images of thick tissue sections. Correct and accurate segmentation of overlapping cells and nuclei is important for many biological and biomedical applications. Many existing algorithms split clumps through the binarization of the input images; therefore, the intensity information of the original image is lost during this process. In this paper, we present a curvature information, gray scale distance transform, and shortest path splitting line‐based algorithm which can make full use of the concavity and image intensity information to find out markers, each of which represents an individual object, and detect accurate splitting lines between objects using shortest path and junction adjustment. The proposed algorithm is tested on both synthetic and real nuclei images. Experiment results show that the performance of the proposed method is better than that of marker‐controlled watershed method and ellipse fitting method.     

Automated system for characterization and classification of malaria‐infected stages using light microscopic images of thin blood smears

In this paper, we propose a comprehensive image characterization cum classification framework for malaria‐infected stage detection using microscopic images of thin blood smears. The methodology mainly includes microscopic imaging of Leishman stained blood slides, noise reduction and illumination correction, erythrocyte segmentation, feature selection followed by machine classification. Amongst three‐image segmentation algorithms (namely, rule‐based, Chan–Vese‐based and marker‐controlled watershed methods), marker‐controlled watershed technique provides better boundary detection of erythrocytes specially in overlapping situations. Microscopic features at intensity, texture and morphology levels are extracted to discriminate infected and noninfected erythrocytes. In order to achieve subgroup of potential features, feature selection techniques, namely, F‐statistic and information gain criteria are considered here for ranking. Finally, five different classifiers, namely, Naive Bayes, multilayer perceptron neural network, logistic regression, classification and regression tree (CART), RBF neural network have been trained and tested by 888 erythrocytes (infected and noninfected) for each features’ subset. Performance evaluation of the proposed methodology shows that multilayer perceptron network provides higher accuracy for malaria‐infected erythrocytes recognition and infected stage classification. Results show that top 90 features ranked by F‐statistic (specificity: 98.64%, sensitivity: 100%, PPV: 99.73% and overall accuracy: 96.84%) and top 60 features ranked by information gain provides better results (specificity: 97.29%, sensitivity: 100%, PPV: 99.46% and overall accuracy: 96.73%) for malaria‐infected stage classification.     

Brain tumor detection and classification: A framework of marker‐based watershed algorithm and multilevel priority features selection

Brain tumor identification using magnetic resonance images (MRI) is an important research domain in the field of medical imaging. Use of computerized techniques helps the doctors for the diagnosis and treatment against brain cancer. In this article, an automated system is developed for tumor extraction and classification from MRI. It is based on marker‐based watershed segmentation and features selection. Five primary steps are involved in the proposed system including tumor contrast, tumor extraction, multimodel features extraction, features selection, and classification. A gamma contrast stretching approach is implemented to improve the contrast of a tumor. Then, segmentation is done using marker‐based watershed algorithm. Shape, texture, and point features are extracted in the next step and high ranked 70% features are only selected through chi‐square max conditional priority features approach. In the later step, selected features are fused using a serial‐based concatenation method before classifying using support vector machine. All the experiments are performed on three data sets including Harvard, BRATS 2013, and privately collected MR images data set. Simulation results clearly reveal that the proposed system outperforms existing methods with greater precision and accuracy.     

基于核模糊相似度度量的谱聚类算法

相似性度量的选择是谱聚类算法良好性能实现的关键。通常采用的谱聚类相似性的度量是基于高斯核函数的相似性度量。然而,谱聚类对这种相似度度量中的尺度参数非常敏感,并且确定一个合适的参数也很困难。另外,基于欧几里得的这种高斯核相似度度量无法有效反映复杂分布数据集的分布特点。针对此问题,通过利用基于核模糊C均值聚类算法得到的划分矩阵中隶属度的分布特点,提出了一个新的核模糊相似度度量,并将基于所提出的新的相似度度量的谱聚类算法(KFSC)应用于图像分割中。所提出的KFSC算法不仅克服了谱聚类对尺度参数敏感,而且解决了尺度参数很难确定的问题,获得更好的聚类效果。3个标准数据集、2个合成纹理图像及2个自然图像上的分割实验表明了所提出算法的有效性和鲁棒性。     

Computer‐aided diagnosis software for vulvovaginal candidiasis detection from Pap smear images

Vulvovaginal candidiasis (VVC) is a common gynecologic infection and it occurs when there is overgrowth of the yeast called Candida. VVC diagnosis is usually done by observing a Pap smear sample under a microscope and searching for the conidium and mycelium components of Candida. This manual method is time consuming, subjective and tedious. Any diagnosis tools that detect VVC, semi‐ or full‐automatically, can be very helpful to pathologists. This article presents a computer aided diagnosis (CAD) software to improve human diagnosis of VVC from Pap smear samples. The proposed software is designed based on phenotypic and morphology features of the Candida in Pap smear sample images. This software provide a user‐friendly interface which consists of a set of image processing tools and analytical results that helps to detect Candida and determine severity of illness. The software was evaluated on 200 Pap smear sample images and obtained specificity of 91.04% and sensitivity of 92.48% to detect VVC. As a result, the use of the proposed software reduces diagnostic time and can be employed as a second objective opinion for pathologists.     

基于时空图像频谱的时均流场重建方法

尽管大尺度粒子图像测速技术(LSPIV)在水流测速方面具有优势,但该方法得到的瞬时流场矢量正确率低,导致了时均流场重建误差大。提出了一种基于时空图像频谱的时均流场重建方法。首先利用示踪物在三维时空域中分布的相关性,通过在图像序列中设置的测速线合成时空图像;然后基于傅里叶变换的自配准性质建立时空图像纹理主方向和频谱主方向间的约束关系;最后采用由粗到精的搜索策略检测频谱主方向并估计测速线上一维运动矢量的大小。实验表明:采用此方法检测纹理图像频谱主方向可以达到0.1°的检测精度,对现场成像暗噪声类的干扰模式具有抗噪性,有效提高了时均流场重建的精确性。     

MRI brain lesion image detection based on color-converted K-means clustering segmentation

We present a preliminary design and experimental results of tumor objects tracking method for magnetic resonance imaging (MRI) brain images (some stock images) that utilizes color-converted segmentation algorithm with K-means clustering technique. The method is capable of solving unable exactly contoured lesion objects problem in MRI image by adding the color-based segmentation operation. The key idea of color-converted segmentation algorithm with K-means is to solve the given MRI image by converting the input gray-level image into a color space image and operating the image labeled by cluster index. In this paper we investigate the possibility of employing this approach for image-based-MRI application. The application of the proposed method for tracking tumor is demonstrated to help pathologists distinguish exactly lesion size and region.     

Fusion of GFP and phase contrast images with complex shearlet transform and Haar wavelet‐based energy rule

Image fusion techniques can integrate the information from different imaging modalities to get a composite image which is more suitable for human visual perception and further image processing tasks. Fusing green fluorescent protein (GFP) and phase contrast images is very important for subcellular localization, functional analysis of protein and genome expression. The fusion method of GFP and phase contrast images based on complex shearlet transform (CST) is proposed in this paper. Firstly the GFP image is converted to IHS model and its intensity component is obtained. Secondly the CST is performed on the intensity component and the phase contrast image to acquire the low‐frequency subbands and the high‐frequency subbands. Then the high‐frequency subbands are merged by the absolute‐maximum rule while the low‐frequency subbands are merged by the proposed Haar wavelet‐based energy (HWE) rule. Finally the fused image is obtained by performing the inverse CST on the merged subbands and conducting IHS‐to‐RGB conversion. The proposed fusion method is tested on a number of GFP and phase contrast images and compared with several popular image fusion methods. The experimental results demonstrate that the proposed fusion method can provide better fusion results in terms of subjective quality and objective evaluation.     

Single image super-resolution using self-optimizing mask via fractional-order gradient interpolation and reconstruction

Image super-resolution using self-optimizing mask via fractional-order gradient interpolation and reconstruction aims to recover detailed information from low-resolution images and reconstruct them into high-resolution images. Due to the limited amount of data and information retrieved from low-resolution images, it is difficult to restore clear, artifact-free images, while still preserving enough structure of the image such as the texture. This paper presents a new single image super-resolution method which is based on adaptive fractional-order gradient interpolation and reconstruction. The interpolated image gradient via optimal fractional-order gradient is first constructed according to the image similarity and afterwards the minimum energy function is employed to reconstruct the final high-resolution image. Fractional-order gradient based interpolation methods provide an additional degree of freedom which helps optimize the implementation quality due to the fact that an extra free parameter α-order is being used. The proposed method is able to produce a rich texture detail while still being able to maintain structural similarity even under large zoom conditions. Experimental results show that the proposed method performs better than current single image super-resolution techniques.