Parameter estimation using compensatory neural networks

Proposed here is a new neuron model, a basis for Compensatory Neural Network Architecture (CNNA), which not only reduces the total number of interconnections among neurons but also reduces the total computing time for training. The suggested model has properties of the basic neuron model as well as the higher neuron model (multiplicative aggregation function). It can adapt to standard neuron and higher order neuron, as well as a combination of the two. This approach is found to estimate the orbit with accuracy significantly better than Kalman Filter (KF) and Feedforward Multilayer Neural Network (FMNN) (also simply referred to as Artificial Neural Network, ANN) with lambda-gamma learning. The typical simulation runs also bring out the superiority of the proposed scheme over Kalman filter from the standpoint of computation time and the amount of data needed for the desired degree of estimated accuracy for the specific problem of orbit determination.     

A transiently chaotic neural network approach to the design of cellular manufacturing

The design of Cellular Manufacturing Systems (CMS) has attained the significant attention of academicians and practitioners over the last three decades. Minimizing intercellular movements while maximizing utilization of machines are the main objectives of interest in designing CMS and are considered in present research. In this paper, the drawbacks of former neural networks-based approaches to cell formation are discussed. The standard version of cell formation problem is formulated and a 'Transiently Chaotic Neural Network' (TCNN) with supplementary procedures is introduced as a powerful rival. A simplified network is constructed. After developing the related equations the approach is tested using the proposed algorithm with 18 problems selected from literature. The results are compared with various other approaches including ART1, Extended-ART1, Ortho-Synapse Hopfield Neural Network (OSHN), etc. The main advantages of our proposed method are: (1) the ability to avoid the local optima trap, (2) the ability to solve problems of different sizes with the same set of values for parameters, and (3) the less computation time. The results also indicate considerable improvement in grouping efficiency through the proposed approach.     

Numerical approximation of optimal control for distributed diffusion Hopfield neural networks

This work presents a numerical approximation of optimal control problems for non‐linear distributed Hopfield Neural Network equations with diffusion term. For one spatial dimensional case, a semi‐discrete numerical algorithm was constructed to find optimal control variable using finite element discretization, updated conjecture gradient iteration method. Furthermore, experiments demonstration will be implemented to show the effectiveness and stability through 3D graphics simulations. Copyright © 2006 John Wiley & Sons, Ltd.     

基于逻辑回归模型的流量异常检测方法研究

网络流量作为异常检测的基本数据源,其行为特征的准确描述,是网络异常行为实时检测的重要依据.本文针对流量异常检测问题,提出了一种基于逻辑回归模型的网络流量异常检测方法.通过分析源IP、目的 IP等多个网络流量基本特征,构造了网络异常行为和正常行为的训练机,并且在此基础上采用逻辑回归建立起网络异常流量挖掘模型.利用实验室所采集的真实网络流量对所构建的模型进行检测,以验证该模型的有效性.实验结果表明本文所建立的网络模型在异常流量挖掘方面准确度高、实时性好.     

基于Kohonen网络的轴系故障诊断研究

本文试从Kohonen神经网络在船舶铀系故障诊断中应用研究出发，提出了船舶轴系模拟试验台的结构和监测原理，通过数据采集系统和开发的软件系统，获得轴系振动倍号并求得其快速傅里叶变换(FFT)频谱，从频谱图中提取信号能量分布的特征矢量，用Kohonen神经网络对特征矢量进行识别，最终得到正确的故障诊断结果。介绍了Kohonen神经网络的学习和工作算法，并研究了在轴系故障诊断中的具体实施方法。实例验证表明，Kohonen网络是一种很有价值的轴系故障诊断手段。     

基于模糊神经网络的火灾信号处理

根据火灾探测的特点,提出相应的模糊神经网络,论述综合处理多种火灾信号的模糊处理计算模型;针对具体应用,对网络结构进行了改进。由于模糊神经网络的自适应特性和推理过程易于理解的特点,它很适用于高层建筑这样的复杂环境,并可明显提高火灾探测的灵活性和准确性。     

Multi-Zone-Wise Blockchain Based Intrusion Detection and Prevention System for IoT Environment

Blockchain merges technology with the Internet of Things (IoT) for addressing security and privacy-related issues. However, conventional blockchain suffers from scalability issues due to its linear structure, which increases the storage overhead, and Intrusion detection performed was limited with attack severity, leading to performance degradation. To overcome these issues, we proposed MZWB (Multi-Zone-Wise Blockchain) model. Initially, all the authenticated IoT nodes in the network ensure their legitimacy by using the Enhanced Blowfish Algorithm (EBA), considering several metrics. Then, the legitimately considered nodes for network construction for managing the network using Bayesian-Direct Acyclic Graph (B-DAG), which considers several metrics. The intrusion detection is performed based on two tiers. In the first tier, a Deep Convolution Neural Network (DCNN) analyzes the data packets by extracting packet flow features to classify the packets as normal, malicious, and suspicious. In the second tier, the suspicious packets are classified as normal or malicious using the Generative Adversarial Network (GAN). Finally, intrusion scenario performed reconstruction to reduce the severity of attacks in which Improved Monkey Optimization (IMO) is used for attack path discovery by considering several metrics, and the Graph cut utilized algorithm for attack scenario reconstruction (ASR). UNSW-NB15 and BoT-IoT utilized datasets for the MZWB method simulated using a Network simulator (NS-3.26). Compared with previous performance metrics such as energy consumption, storage overhead accuracy, response time, attack detection rate, precision, recall, and F-measure. The simulation result shows that the proposed MZWB method achieves high performance than existing works     

Ensemble Learning Based on GBDT and CNN for Adoptability Prediction

By efficiently and accurately predicting the adoptability of pets, shelters and rescuers can be positively guided on improving attraction of pet profiles, reducing animal suffering and euthanization. Previous prediction methods usually only used a single type of content for training. However, many pets contain not only textual content, but also images. To make full use of textual and visual information, this paper proposed a novel method to process pets that contain multimodal information. We employed several CNN (Convolutional Neural Network) based models and other methods to extract features from images and texts to obtain the initial multimodal representation, then reduce the dimensions and fuse them. Finally, we trained the fused features with two GBDT (Gradient Boosting Decision Tree) based models and a Neural Network (NN) and compare the performance of them and their ensemble. The evaluation result demonstrates that the proposed ensemble learning can improve the accuracy of prediction.     

An Optimized Neural Network with Bat Algorithm for DNA Sequence Classification

Recently, many researchers have used nature inspired metaheuristic algorithms due to their ability to perform optimally on complex problems. To solve problems in a simple way, in the recent era bat algorithm has become famous due to its high tendency towards convergence to the global optimum most of the time. But, still the standard bat with random walk has a problem of getting stuck in local minima. In order to solve this problem, this research proposed bat algorithm with levy flight random walk. Then, the proposed Bat with Levy flight algorithm is further hybridized with three different variants of ANN. The proposed BatLFBP is applied to the problem of insulin DNA sequence classification of healthy homosapien. For classification performance, the proposed models such as Bat levy flight Artificial Neural Network (BatLFANN) and Bat levy Flight Back Propagation (BatLFBP) are compared with the other state-of-the-art algorithms like Bat Artificial Neural Network (BatANN), Bat back propagation (BatBP), Bat Gaussian distribution Artificial Neural Network (BatGDANN). And Bat Gaussian distribution back propagation (BatGDBP), in-terms of means squared error (MSE) and accuracy. From the perspective of simulations results, it is show that the proposed BatLFANN achieved 99.88153% accuracy with MSE of 0.001185, and BatLFBP achieved 99.834185 accuracy with MSE of 0.001658 on WL5. While on WL10 the proposed BatLFANN achieved 99.89899% accuracy with MSE of 0.00101, and BatLFBP achieved 99.84473% accuracy with MSE of 0.004553. Similarly, on WL15 the proposed BatLFANN achieved 99.82853% accuracy with MSE of 0.001715, and BatLFBP achieved 99.3262% accuracy with MSE of 0.006738 which achieve better accuracy as compared to the other hybrid models.

     

Multiclass Stomach Diseases Classification Using Deep Learning Features Optimization

In the area of medical image processing, stomach cancer is one of the most important cancers which need to be diagnose at the early stage. In this paper, an optimized deep learning method is presented for multiple stomach disease classification. The proposed method work in few important steps—preprocessing using the fusion of filtering images along with Ant Colony Optimization (ACO), deep transfer learning-based features extraction, optimization of deep extracted features using nature-inspired algorithms, and finally fusion of optimal vectors and classification using Multi-Layered Perceptron Neural Network (MLNN). In the feature extraction step, pre-trained Inception V3 is utilized and retrained on selected stomach infection classes using the deep transfer learning step. Later on, the activation function is applied to Global Average Pool (GAP) for feature extraction. However, the extracted features are optimized through two different nature-inspired algorithms—Particle Swarm Optimization (PSO) with dynamic fitness function and Crow Search Algorithm (CSA). Hence, both methods’ output is fused by a maximal value approach and classified the fused feature vector by MLNN. Two datasets are used to evaluate the proposed method—CUI WahStomach Diseases and Combined dataset and achieved an average accuracy of 99.5%. The comparison with existing techniques, it is shown that the proposed method shows significant performance.     

An Improved Deep Fusion CNN for Image Recognition

With the development of Deep Convolutional Neural Networks (DCNNs), the extracted features for image recognition tasks have shifted from low-level features to the high-level semantic features of DCNNs. Previous studies have shown that the deeper the network is, the more abstract the features are. However, the recognition ability of deep features would be limited by insufficient training samples. To address this problem, this paper derives an improved Deep Fusion Convolutional Neural Network (DF-Net) which can make full use of the differences and complementarities during network learning and enhance feature expression under the condition of limited datasets. Specifically, DF-Net organizes two identical subnets to extract features from the input image in parallel, and then a well-designed fusion module is introduced to the deep layer of DF-Net to fuse the subnet’s features in multi-scale. Thus, the more complex mappings are created and the more abundant and accurate fusion features can be extracted to improve recognition accuracy. Furthermore, a corresponding training strategy is also proposed to speed up the convergence and reduce the computation overhead of network training. Finally, DF-Nets based on the well-known ResNet, DenseNet and MobileNetV2 are evaluated on CIFAR100, Stanford Dogs, and UECFOOD-100. Theoretical analysis and experimental results strongly demonstrate that DF-Net enhances the performance of DCNNs and increases the accuracy of image recognition.     

An Adaptive Classifier Based Approach for Crowd Anomaly Detection

Crowd Anomaly Detection has become a challenge in intelligent video surveillance system and security. Intelligent video surveillance systems make extensive use of data mining, machine learning and deep learning methods. In this paper a novel approach is proposed to identify abnormal occurrences in crowded situations using deep learning. In this approach, Adaptive GoogleNet Neural Network Classifier with Multi-Objective Whale Optimization Algorithm are applied to predict the abnormal video frames in the crowded scenes. We use multiple instance learning (MIL) to dynamically develop a deep anomalous ranking framework. This technique predicts higher anomalous values for abnormal video frames by treating regular and irregular video bags and video sections. We use the multi-objective whale optimization algorithm to optimize the entire process and get the best results. The performance parameters such as accuracy, precision, recall, and F-score are considered to evaluate the proposed technique using the Python simulation tool. Our simulation results show that the proposed method performs better than the conventional methods on the public live video dataset.     

Fuzzy clustering and Whale-based neural network to food recognition and calorie estimation for daily dietary assessment

The calorie value of the food items taken by the person in everyday life needs to be monitored to reduce the risk of obesity, heart problems, and diabetes, etc. The calorie estimator in the existing models has reduced accuracy since the calorie value of each food varies with mass. This paper introduces a dietary assessment system based on the proposed Cauchy, Generalized T-Student, and Wavelet kernel based Wu-and-Li Index Fuzzy clustering (CSW-WLIFC) based segmentation and the proposed Whale Levenberg Marquardt Neural Network (WLM-NN) classifier. The proposed CSW-WLIFC based segmentation segments the image based on the existing WLI-FC algorithm. A novel CSW based kernel function is utilized in the segmentation process. Feature vectors such as color, shape, and texture are extracted from the segmented image. The Neural Network is trained with the Whale-Levenberg Marquardt (WLM) model to recognize each food item from the tray image. The proposed calorie estimator calculates the calorie value of each food item. From the simulation results, it is evident that the proposed model has the improved performance than the existing models with the values of 0.999, 0.9643, 0.9627, and 0.0184 for the segmentation accuracy, macro average accuracy, standard accuracy, mean square error, respectively.     

Review of Text Classification Methods on Deep Learning

Text classification has always been an increasingly crucial topic in natural language processing. Traditional text classification methods based on machine learning have many disadvantages such as dimension explosion, data sparsity, limited generalization ability and so on. Based on deep learning text classification, this paper presents an extensive study on the text classification models including Convolutional Neural Network-Based (CNN-Based), Recurrent Neural Network-Based (RNN-based), Attention Mechanisms-Based and so on. Many studies have proved that text classification methods based on deep learning outperform the traditional methods when processing large-scale and complex datasets. The main reasons are text classification methods based on deep learning can avoid cumbersome feature extraction process and have higher prediction accuracy for a large set of unstructured data. In this paper, we also summarize the shortcomings of traditional text classification methods and introduce the text classification process based on deep learning including text preprocessing, distributed representation of text, text classification model construction based on deep learning and performance evaluation.     

Discovery of marageing steels:machine learning vs.physical metallurgical modelling

Physical metallurgical (PM) and data-driven approaches can be independently applied to alloy design.Steel technology is a field of physical metallurgy around which some of the most comprehensive under-standing has been developed,with vast models on the relationship between composition,processing,microstructure and properties.They have been applied to the design of new steel alloys in the pursuit of grades of improved properties.With the advent of rapid computing and low-cost data storage,a wealth of data has become available to a suite of modelling techniques referred to as machine learning (ML).ML is being emergingly applied in materials discovery while it requires data mining with its adoption being limited by insufficient high-quality datasets,often leading to unrealistic materials design predictions outside the boundaries of the intended properties.It is therefore required to appraise the strength and weaknesses of PM and ML approach,to assess the real design power of each towards designing novel steel grades.This work incorporates models and datasets from well-established literature on marageing steels.Combining genetic algorithm (GA) with PM models to optimise the parameters adopted for each dataset to maximise the prediction accuracy of PM models,and the results were compared with ML models.The results indicate that PM approaches provide a clearer picture of the overall composition-microstructure-properties relationship but are highly sensitive to the alloy system and hence lack on exploration ability of new domains.ML conversely provides little explicit physical insight whilst yielding a stronger pre-diction accuracy for large-scale data.Hybrid PM/ML approaches provide solutions maximising accuracy,while leading to a clearer physical picture and the desired properties.     

Extracting recurrent scenarios from narrative texts using a Bayesian network: Application to serious occupational accidents with movement disturbance

A probabilistic approach has been developed to extract recurrent serious Occupational Accident with Movement Disturbance (OAMD) scenarios from narrative texts within a prevention framework. Relevant data extracted from 143 accounts was initially coded as logical combinations of generic accident factors. A Bayesian Network (BN)-based model was then built for OAMDs using these data and expert knowledge. A data clustering process was subsequently performed to group the OAMDs into similar classes from generic factor occurrence and pattern standpoints. Finally, the Most Probable Explanation (MPE) was evaluated and identified as the associated recurrent scenario for each class. Using this approach, 8 scenarios were extracted to describe 143 OAMDs in the construction and metallurgy sectors. Their recurrent nature is discussed.     

Optimized Identification with Severity Factors of Gastric Cancer for Internet of Medical Things

The Internet of Medical Things (IoMT) emerges with the vision of the Wireless Body Sensor Network (WBSN) to improve the health monitoring systems and has an enormous impact on the healthcare system for recognizing the levels of risk/severity factors (premature diagnosis, treatment, and supervision of chronic disease i.e., cancer) via wearable/electronic health sensor i.e., wireless endoscopic capsule. However, AI-assisted endoscopy plays a very significant role in the detection of gastric cancer. Convolutional Neural Network (CNN) has been widely used to diagnose gastric cancer based on various feature extraction models, consequently, limiting the identification and categorization performance in terms of cancerous stages and grades associated with each type of gastric cancer. This paper proposed an optimized AI-based approach to diagnose and assess the risk factor of gastric cancer based on its type, stage, and grade in the endoscopic images for smart healthcare applications. The proposed method is categorized into five phases such as image pre-processing, Four-Dimensional (4D) image conversion, image segmentation, K-Nearest Neighbour (K-NN) classification, and multi-grading and staging of image intensities. Moreover, the performance of the proposed method has experimented on two different datasets consisting of color and black and white endoscopic images. The simulation results verified that the proposed approach is capable of perceiving gastric cancer with 88.09% sensitivity, 95.77% specificity, and 96.55% overall accuracy respectively.     

An Efficient Medical Image Deep Fusion Model Based on Convolutional Neural Networks

Medical image fusion is considered the best method for obtaining one image with rich details for efficient medical diagnosis and therapy. Deep learning provides a high performance for several medical image analysis applications. This paper proposes a deep learning model for the medical image fusion process. This model depends on Convolutional Neural Network (CNN). The basic idea of the proposed model is to extract features from both CT and MR images. Then, an additional process is executed on the extracted features. After that, the fused feature map is reconstructed to obtain the resulting fused image. Finally, the quality of the resulting fused image is enhanced by various enhancement techniques such as Histogram Matching (HM), Histogram Equalization (HE), fuzzy technique, fuzzy type Π, and Contrast Limited Histogram Equalization (CLAHE). The performance of the proposed fusion-based CNN model is measured by various metrics of the fusion and enhancement quality. Different realistic datasets of different modalities and diseases are tested and implemented. Also, real datasets are tested in the simulation analysis.     

基于注意力机制的轻量级RGB-D图像语义分割网络

目的针对卷积神经网络在RGB-D(彩色-深度)图像中进行语义分割任务时模型参数量大且分割精度不高的问题,提出一种融合高效通道注意力机制的轻量级语义分割网络。方法文中网络基于RefineNet,利用深度可分离卷积(Depthwiseseparableconvolution)来轻量化网络模型,并在编码网络和解码网络中分别融合高效的通道注意力机制。首先RGB-D图像通过带有通道注意力机制的编码器网络,分别对RGB图像和深度图像进行特征提取;然后经过融合模块将2种特征进行多维度融合;最后融合特征经过轻量化的解码器网络得到分割结果,并与RefineNet等6种网络的分割结果进行对比分析。结果对提出的算法在语义分割网络常用公开数据集上进行了实验,实验结果显示文中网络模型参数为90.41 MB,且平均交并比(mIoU)比RefineNet网络提高了1.7%,达到了45.3%。结论实验结果表明,文中网络在参数量大幅减少的情况下还能提高了语义分割精度。     

开采地面沉陷预测的自适应神经模糊推理方法研究

现行各种开采地面沉陷预测方法均存在着一个共同的缺陷,均不能在集成以往开采地面沉陷工程实 例的基础上对某一地下采矿工程所引起的地面沉陷进行预测,而只能根据某种物理的或力学的方法对其进行预 测。人类在工程实践中所创造的开采地面沉陷方面的经验是非常宝贵的财富,应当在建立开采地面沉陷预测方 法时加以充分利用。以所收集的开采地面沉陷工程实例为基础现行各种开采地面沉陷预测方法均存在着一个共同的缺陷,均不能在集成以往开采地面沉陷工程实 例的基础上对某一地下采矿工程所引起的地面沉陷进行预测,而只能根据某种物理的或力学的