Real-Time Surface Discrimination Using an Analog Neural Network Implemented in a Phase-Shift Laser Rangefinder

An analog neural network (NN) was developed for real-time surface recognition by using two photoelectrical signals issued from a phase-shift rangefinder. The NN architecture consists of a multilayer perceptron (MLP) with two inputs, three neurons in the hidden layer, and one output. The NN output is compared with threshold voltages in order to classify the tested surfaces. In this type of application, analog NN implementation has many advantages, especially the small silicon area used, a low-power consumption, and no analog-to-digital conversions. This recognition system has been successfully tested for four types of surfaces (a plastic surface, a glossy paper, a painted wall, and a porous surface), at a remote distance between the rangefinder and the target varying from 0.5 m up to 1.25 m and with a laser beam incidence angle varying between and . This paper presents the NN training and the experimental tests of surface discrimination.     

Memristor‐Based Analog Computation and Neural Network Classification with a Dot Product Engine

Using memristor crossbar arrays to accelerate computations is a promising approach to efficiently implement algorithms in deep neural networks. Early demonstrations, however, are limited to simulations or small‐scale problems primarily due to materials and device challenges that limit the size of the memristor crossbar arrays that can be reliably programmed to stable and analog values, which is the focus of the current work. High‐precision analog tuning and control of memristor cells across a 128 × 64 array is demonstrated, and the resulting vector matrix multiplication (VMM) computing precision is evaluated. Single‐layer neural network inference is performed in these arrays, and the performance compared to a digital approach is assessed. Memristor computing system used here reaches a VMM accuracy equivalent of 6 bits, and an 89.9% recognition accuracy is achieved for the 10k MNIST handwritten digit test set. Forecasts show that with integrated (on chip) and scaled memristors, a computational efficiency greater than 100 trillion operations per second per Watt is possible.     

Convolutional Neural Network for Histopathological Osteosarcoma Image Classification

Osteosarcoma is one of the most widespread causes of bone cancer globally and has a high mortality rate. Early diagnosis may increase the chances of treatment and survival however the process is time-consuming (reliability and complexity involved to extract the hand-crafted features) and largely depends on pathologists’ experience. Convolutional Neural Network (CNN—an end-to-end model) is known to be an alternative to overcome the aforesaid problems. Therefore, this work proposes a compact CNN architecture that has been rigorously explored on a Small Osteosarcoma histology Image Dataaseet (a high-class imbalanced dataset). Though, during training, class-imbalanced data can negatively affect the performance of CNN. Therefore, an oversampling technique has been proposed to overcome the aforesaid issue and improve generalization performance. In this process, a hierarchical CNN model is designed, in which the former model is non-regularized (due to dense architecture) and the later one is regularized, specifically designed for small histopathology images. Moreover, the regularized model is integrated with CNN’s basic architecture to reduce overfitting. Experimental results demonstrate that oversampling might be an effective way to address the imbalanced class problem during training. The training and testing accuracies of the non-regularized CNN model are 98% & 78% with an imbalanced dataset and 96% & 81% with a balanced dataset, respectively. The regularized CNN model training and testing accuracies are 84% & 75% for an imbalanced dataset and 87% & 86% for a balanced dataset.     

基于微分进化神经网络的模拟电路故障诊断

BP神经网络已在模拟电路故障诊断领域得到广泛应用,但BP神经网络存在训练速度慢且容易陷入局部最优的问题.由此,本文提出了一种基于混合变异策略的微分进化改进算法,描述了利用微分进化改进算法进行神经网络权值训练的过程和方法,并将微分进化神经网络用于模拟电路故障诊断,文中还对微分进化神经网络与BP神经网络进行了比较.实验结果表明,微分进化神经网络的训练时间和训练精度均优于BP神经网络,其在模拟电路故障诊断中的准确度比BP神经网络提高了7%.     

Cellular Neural Network Algorithms for Real-Time Image Analysis in Plasma Fusion

In modern tokamaks, visible and infrared video cameras are becoming more and more important in monitoring plasma evolution during fusion experiments. Analyzing these images in real time can provide relevant information for controlling plasma and improving machine safety. The real-time image processing capability of the cellular nonlinear/neural network-based chips that are available nowadays has been applied to several tasks, both at Frascati Tokamak Upgrade (FTU) and at Joint European Torus (JET). The successful applications range from the identification of plasma instabilities, such as multifaceted asymmetric radiations from the edge (MARFEs), to the determination of the strike-point position in the divertor and to the detection of the so-called “hot spots.”      

Optimized Convolutional Neural Network Models for Skin Lesion Classification

Skin cancer is one of the most severe diseases, and medical imaging is among the main tools for cancer diagnosis. The images provide information on the evolutionary stage, size, and location of tumor lesions. This paper focuses on the classification of skin lesion images considering a framework of four experiments to analyze the classification performance of Convolutional Neural Networks (CNNs) in distinguishing different skin lesions. The CNNs are based on transfer learning, taking advantage of ImageNet weights. Accordingly, in each experiment, different workflow stages are tested, including data augmentation and fine-tuning optimization. Three CNN models based on DenseNet-201, Inception-ResNet-V2, and Inception-V3 are proposed and compared using the HAM10000 dataset. The results obtained by the three models demonstrate accuracies of 98%, 97%, and 96%, respectively. Finally, the best model is tested on the ISIC 2019 dataset showing an accuracy of 93%. The proposed methodology using CNN represents a helpful tool to accurately diagnose skin cancer disease.     

Classification of the Surface Technological Defects in Rolled Metal Products with the Help of a Deep Neural Network

Materials Science - We develop and study an automated method for the detection and classification of three types of technological defects in rolled metal products. The method is based on the...     

A Novel Combinational Convolutional Neural Network for Automatic Food-Ingredient Classification

With the development of deep learning and Convolutional Neural Networks (CNNs), the accuracy of automatic food recognition based on visual data have significantly improved. Some research studies have shown that the deeper the model is, the higher the accuracy is. However, very deep neural networks would be affected by the overfitting problem and also consume huge computing resources. In this paper, a new classification scheme is proposed for automatic food-ingredient recognition based on deep learning. We construct an up-to-date combinational convolutional neural network (CBNet) with a subnet merging technique. Firstly, two different neural networks are utilized for learning interested features. Then, a well-designed feature fusion component aggregates the features from subnetworks, further extracting richer and more precise features for image classification. In order to learn more complementary features, the corresponding fusion strategies are also proposed, including auxiliary classifiers and hyperparameters setting. Finally, CBNet based on the well-known VGGNet, ResNet and DenseNet is evaluated on a dataset including 41 major categories of food ingredients and 100 images for each category. Theoretical analysis and experimental results demonstrate that CBNet achieves promising accuracy for multi-class classification and improves the performance of convolutional neural networks.     

卷积神经网络在无纺布缺陷分类检测中的应用

目的针对传统无纺布缺陷分类检测中人工依赖性强、效率低等问题,提出一种能够满足工厂要求的卷积神经网络分类检测方法。方法首先建立包括脏点、褶皱、断裂、缺纱和无缺陷等5种共计7万张无纺布图像样本库,其次构造一个具有不同神经元个数的卷积层和池化层的神经网络,然后采用反向传播算法逐层更新权值,通过梯度下降法最小化损失函数,最后利用Softmax分类器实现无纺布的缺陷分类检测。结果构建了12层的卷积神经网络,通过2万张样本进行测试实验,无缺陷样本准确率可以达到100%,缺陷样本分类准确率均在95%以上,检测时间在35 ms以内。结论该方法能够满足工业生产线中对于无纺布缺陷实时分类检测的要求。     

An Optimized Approach to Vehicle-Type Classification Using a Convolutional Neural Network

Vehicle type classification is considered a central part of an intelligent traffic system. In recent years, deep learning had a vital role in object detection in many computer vision tasks. To learn high-level deep features and semantics, deep learning offers powerful tools to address problems in traditional architectures of handcrafted feature-extraction techniques. Unlike other algorithms using handcrated visual features, convolutional neural network is able to automatically learn good features of vehicle type classification. This study develops an optimized automatic surveillance and auditing system to detect and classify vehicles of different categories. Transfer learning is used to quickly learn the features by recording a small number of training images from vehicle frontal view images. The proposed system employs extensive data-augmentation techniques for effective training while avoiding the problem of data shortage. In order to capture rich and discriminative information of vehicles, the convolutional neural network is fine-tuned for the classification of vehicle types using the augmented data. The network extracts the feature maps from the entire dataset and generates a label for each object (vehicle) in an image, which can help in vehicle-type detection and classification. Experimental results on a public dataset and our own dataset demonstrated that the proposed method is quite effective in detection and classification of different types of vehicles. The experimental results show that the proposed model achieves 96.04% accuracy on vehicle type classification.     

An Optimized Neural Network with Bat Algorithm for DNA Sequence Classification

Recently, many researchers have used nature inspired metaheuristic algorithms due to their ability to perform optimally on complex problems. To solve problems in a simple way, in the recent era bat algorithm has become famous due to its high tendency towards convergence to the global optimum most of the time. But, still the standard bat with random walk has a problem of getting stuck in local minima. In order to solve this problem, this research proposed bat algorithm with levy flight random walk. Then, the proposed Bat with Levy flight algorithm is further hybridized with three different variants of ANN. The proposed BatLFBP is applied to the problem of insulin DNA sequence classification of healthy homosapien. For classification performance, the proposed models such as Bat levy flight Artificial Neural Network (BatLFANN) and Bat levy Flight Back Propagation (BatLFBP) are compared with the other state-of-the-art algorithms like Bat Artificial Neural Network (BatANN), Bat back propagation (BatBP), Bat Gaussian distribution Artificial Neural Network (BatGDANN). And Bat Gaussian distribution back propagation (BatGDBP), in-terms of means squared error (MSE) and accuracy. From the perspective of simulations results, it is show that the proposed BatLFANN achieved 99.88153% accuracy with MSE of 0.001185, and BatLFBP achieved 99.834185 accuracy with MSE of 0.001658 on WL5. While on WL10 the proposed BatLFANN achieved 99.89899% accuracy with MSE of 0.00101, and BatLFBP achieved 99.84473% accuracy with MSE of 0.004553. Similarly, on WL15 the proposed BatLFANN achieved 99.82853% accuracy with MSE of 0.001715, and BatLFBP achieved 99.3262% accuracy with MSE of 0.006738 which achieve better accuracy as compared to the other hybrid models.

     

A Novel Deep Neural Network for Intracranial Haemorrhage Detection and Classification

Data fusion is one of the challenging issues, the healthcare sector is facing in the recent years. Proper diagnosis from digital imagery and treatment are deemed to be the right solution. Intracerebral Haemorrhage (ICH), a condition characterized by injury of blood vessels in brain tissues, is one of the important reasons for stroke. Images generated by X-rays and Computed Tomography (CT) are widely used for estimating the size and location of hemorrhages. Radiologists use manual planimetry, a time-consuming process for segmenting CT scan images. Deep Learning (DL) is the most preferred method to increase the efficiency of diagnosing ICH. In this paper, the researcher presents a unique multi-modal data fusion-based feature extraction technique with Deep Learning (DL) model, abbreviated as FFE-DL for Intracranial Haemorrhage Detection and Classification, also known as FFEDL-ICH. The proposed FFEDL-ICH model has four stages namely, preprocessing, image segmentation, feature extraction, and classification. The input image is first preprocessed using the Gaussian Filtering (GF) technique to remove noise. Secondly, the Density-based Fuzzy C-Means (DFCM) algorithm is used to segment the images. Furthermore, the Fusion-based Feature Extraction model is implemented with handcrafted feature (Local Binary Patterns) and deep features (Residual Network-152) to extract useful features. Finally, Deep Neural Network (DNN) is implemented as a classification technique to differentiate multiple classes of ICH. The researchers, in the current study, used benchmark Intracranial Haemorrhage dataset and simulated the FFEDL-ICH model to assess its diagnostic performance. The findings of the study revealed that the proposed FFEDL-ICH model has the ability to outperform existing models as there is a significant improvement in its performance. For future researches, the researcher recommends the performance improvement of FFEDL-ICH model using learning rate scheduling techniques for DNN.     

Sentiment Classification Based on Piecewise Pooling Convolutional Neural Network

Recently, the effectiveness of neural networks, especially convolutional neural networks, has been validated in the field of natural language processing, in which, sentiment classification for online reviews is an important and challenging task. Existing convolutional neural networks extract important features of sentences without local features or the feature sequence. Thus, these models do not perform well, especially for transition sentences. To this end, we propose a Piecewise Pooling Convolutional Neural Network (PPCNN) for sentiment classification. Firstly, with a sentence presented by word vectors, convolution operation is introduced to obtain the convolution feature map vectors. Secondly, these vectors are segmented according to the positions of transition words in sentences. Thirdly, the most significant feature of each local segment is extracted using max pooling mechanism, and then the different aspects of features can be extracted. Specifically, the relative sequence of these features is preserved. Finally, after processed by the dropout algorithm, the softmax classifier is trained for sentiment classification. Experimental results show that the proposed method PPCNN is effective and superior to other baseline methods, especially for datasets with transition sentences.     

Analog Real-Time Statistical Analyzer Utilizing CCD's to Implement a Decision Algorithm

A system is presented to realize the function of a linear regression analyzer using analog charge-coupled device (CCD) tapped delay lines to perform fast parallel processing. Such systems are normally implemented using digital computing techniques giving a nonreal-time output. The analog approach discussed in this paper is capable of providing results in real time at the sampling rate of several hundred kilohertz, with the added advantage of reduction in power consumption and physical size. Results obtained from a prototype system are presented to demonstrate the principles of the system operation.     

智能神经网络开发系统的实现技术

对比了智能神经元模型和传统的神经元模型，论述了智能神经网络系统的组成原理，给出了智能神经网络开发系统的基本模型，并具体地阐述了智能神经网络开发系统基本模型中的各个组成部分。利用智能神经网络开发系统，研究人员可以较为容易地开发神经网络应用程序。     

基于脉冲神经网络的钢材表面缺陷识别研究

目的 针对现有钢材缺陷识别算法特征图利用不充分、识别准确率低、参数量大等问题,基于脉冲神经网络,提出一种用于钢材缺陷识别的稠密卷积脉冲神经网络(DCSNN)模型,减少系统消耗和内存占用。方法 首先,采用卷积编码,对输入图片进行特征提取和编码。其次,采用稠密连接算法搭建稠密卷积脉冲神经网络,实现特征重复利用,抑制梯度消失,并通过替代梯度下降算法进行网络训练。最后,在带钢数据集上进行测试,实现带钢缺陷识别。结果 实验结果显示,DCSNN在测试集上的准确率为98.61%,参数量为0.5万,结论 在钢材表面缺陷识别问题上表现出良好效果。     

Deep Scatter Estimation (DSE): Accurate Real-Time Scatter Estimation for X-Ray CT Using a Deep Convolutional Neural Network

X-ray scatter is a major cause of image quality degradation in dimensional CT. Especially, in case of highly attenuating components scatter-to-primary ratios may easily be higher than 1. The corresponding artifacts which appear as cupping or dark streaks in the CT reconstruction may impair a metrological assessment. Therefore, an appropriate scatter correction is crucial. Thereby, the gold standard is to predict the scatter distribution using a Monte Carlo (MC) code and subtract the corresponding scatter estimate from the measured raw data. MC, however, is too slow to be used routinely. To correct for scatter in real-time, we developed the deep scatter estimation (DSE). It uses a deep convolutional neural network which is trained to reproduce the output of MC simulations using only the acquired projection data as input. Once trained, DSE can be applied in real-time. The present study demonstrates the potential of the proposed approach using simulations and measurements. In both cases the DSE yields highly accurate scatter estimates that differ by< 3% from our MC scatter predictions. Further, DSE clearly outperforms kernel-based scatter estimation techniques and hybrid approaches, as they are in use today.     

改进型RBF网络在模拟电路故障隔离中的应用

提出了一种最陡下降增量映射学习算法,对RBF网络的训练方法进行改进,并将之运用于模拟电路故障隔离.该算法通过增量映射学习算法对RBF网络的采样基函数进行迭代优选,简化RBF网络结构;采用最陡下降法改进增量映射学习算法,对神经元激励函数的参数进行调节,控制网络规模,提高网络的逼近能力.故障隔离实例显示了其优越性.改进的算法与传统算法相比,具有更快的收敛速度和更高的隔离精度.本算法为RBF网络的训练提供了一种可行的方法,在故障诊断领域有良好的应用前景.     

Brain Tumor Detection and Classification Using PSO and Convolutional Neural Network

Tumor detection has been an active research topic in recent years due to the high mortality rate. Computer vision (CV) and image processing techniques have recently become popular for detecting tumors in MRI images. The automated detection process is simpler and takes less time than manual processing. In addition, the difference in the expanding shape of brain tumor tissues complicates and complicates tumor detection for clinicians. We proposed a new framework for tumor detection as well as tumor classification into relevant categories in this paper. For tumor segmentation, the proposed framework employs the Particle Swarm Optimization (PSO) algorithm, and for classification, the convolutional neural network (CNN) algorithm. Popular preprocessing techniques such as noise removal, image sharpening, and skull stripping are used at the start of the segmentation process. Then, PSO-based segmentation is applied. In the classification step, two pre-trained CNN models, alexnet and inception-V3, are used and trained using transfer learning. Using a serial approach, features are extracted from both trained models and fused features for final classification. For classification, a variety of machine learning classifiers are used. Average dice values on datasets BRATS-2018 and BRATS-2017 are 98.11 percent and 98.25 percent, respectively, whereas average jaccard values are 96.30 percent and 96.57% (Segmentation Results). The results were extended on the same datasets for classification and achieved 99.0% accuracy, sensitivity of 0.99, specificity of 0.99, and precision of 0.99. Finally, the proposed method is compared to state-of-the-art existing methods and outperforms them.     

基于GRNN-PNN神经网络的印铁缺陷分类方法

目的针对在印铁过程中缺陷检测系统存在不同缺陷类型检测精度不高,对于产品整体质量无法实现智能判断的问题,基于GRNN-PNN神经网络,提出一种适用于印铁在线检测的分类算法。方法对平面印刷铁片进行小波变换提取低频信息,在低频信息中进行缺陷定位并对缺陷区域进行标记和分割。通过缺陷面积、周长等评价指数和缺陷形状构建GRNN神经网络,对缺陷进行分类。通过构建PNN神经网络智能化判别整体产品是否属于合格产品。结果 GRNN-PNN平均耗时0.69s,达到了厂方对于缺陷在线检测的响应时间要求。GRNN-PNN多分类的准确率为86%,能够对印铁过程中产生的主要缺陷进行分类。二分类的灵敏度为96%,可以准确地判断产品整体的合格性。在5%的椒盐噪声干扰下,准确率为63%,具有良好的鲁棒性。结论该设计能够对印铁缺陷进行精确的分类和智能的判断,GRNN-PNN神经网络可以在印铁过程中进一步提高检测精度,GRNN-PNN神经网络可帮助质检员及时判断生产质量。