一种基于纹理域神经网络的彩色卫星图像分析方法

描述了一种利用纹理域神经网络,通过监督的学习方法来调整和权重,将预处理后成的彩色卫星图像中的纹理信息块进行分类,从而达到在彩色卫星图像中将有用的色彩块分析出来的目的,给出了纹理域的预处理过程,阐述了对原彩色图像进行颜色映射和量化的目标和方法;讨论了纹理域神经网络的构造方法及算法;最后给出了用以上方法对彩色卫星图像进行分类的实验结果,实验证明该方法对彩色卫星图像有较好的分类作用。     

Learning texture discrimination rules in a multiresolution system

We describe a texture analysis system in which informative discrimination rules are learned from a multiresolution representation of time textured input. The system incorporates unsupervised and supervised learning via statistical machine learning and rule-based neural networks, respectively. The textured input is represented in the frequency-orientation space via a log-Gabor pyramidal decomposition. In the unsupervised learning stage a statistical clustering scheme is used for the quantization of the feature-vector attributes. A supervised stage follows in which labeling of the textured map is achieved using a rule-based network. Simulation results for the texture classification task are given. An application of the system to real-world problems is demonstrated     

联合深度学习和宽度学习的纹理样图自动提取

目的 纹理样图是指一幅用于描述纹理特征的图像,纹理样图多样性在纹理合成任务中是至关重要的,它可以为合成的纹理带来更丰富、多样和逼真的外观,同时为艺术家和设计师提供了更多的创作灵感和自由度。当前,纹理样图的提取主要通过手工剪裁和算法自动提取,从大量的图像中手工剪裁提取出高质量的纹理样图十分耗费精力和时间,并且该方式易受主观驱动且多样性受限。目前先进的纹理样图自动提取算法基于卷积神经网络的Trimmed T-CNN(texture convolutional neural network)模型存在推理速度慢的问题。基于此,本文致力于利用互联网上丰富的图像资源,自动快速地从各种图像中裁剪出理想且多样的纹理样图,让用户有更多的选择。方法 本文提出一个结合深度学习和宽度学习的从原始图像中自动提取纹理样图的方法。为了获取理想的纹理样图,首先通过残差特征金字塔网络提取特征图,有效地从输入图像中识别样图候选者,然后采用区域候选网络快速自动地获取大量的纹理样图候选区域。接下来,利用宽度学习系统对纹理样图的候选区域进行分类。最后,使用评分准则对宽度学习系统的分类结果进行评分,从而筛选出理想的纹理样图。结果...     

基于共生矩阵分析的自适应神经网络图像复原算法

为了保护图像中的细节信息,提出了一种基于共生矩阵聚类分析的自适应Hopfield神经网络图像复原算法．通过计算图像局部区域的共生矩阵提取其纹理特征,对共生矩阵非零元素进行聚类分析．根据聚类数量和各聚类之间的距离,提出了图像局部区域细节强度的定义及其计算方法．细节强度在准确地区分图像的平坦区域和细节区域基础上,通过非线性函数自适应地调整Hopfield网络的权系数矩阵,以使权系数适合图像的纹理特征,而且权系数的生成过程符合人的视觉特性．图像复原的迭代求解过程和神经网络权系数矩阵的更新过程交替进行．该算法能够在图像的平坦区域有效地抑制噪声,在包含细节的区域突出细节．对比实验结果显示,该算法获得的复原图像的信噪比明显提高,视觉效果明显改善．     

改进的概率神经网络的语义区域分类

针对彩色图像信息量大,分割效果自适应性差的问题,对图像语义区域的分割精度进行控制,提取图像的纹理特征值,再通过改进后的概率神经网络模型对测试样本做分类测试,达到提高图像语义提取和分类准确性的目的。实验表明,改进后的概率神经网络对彩色图像语义区域分类的正确性由原先的70%提高到90%,具有较好的分类效果。     

Recognition of coloured and textured images through a multi-scale neural architecture with orientational filtering and chromatic diffusion

The aim of this paper is to outline a multiple scale neural model to recognise colour images of textured scenes. This model combines colour and textural information in order to recognise colour texture images through the operation of two main components: a segmentation component composed of the colour opponent system (COS) and the chromatic segmentation system (CSS); and a recognition component formed by an ARTMAP-based neural network with scale and orientation-invariance properties. Segmentation is achieved by perceptual contour extraction and diffusion processes on the colour opponent channels based on the human psychophysical theory of colour perception. This colour regions enhancement along with their local textural features constitutes the recognition pattern to be sent to the supervised neural classifier. The CSS accomplishes the colour region enhancement through a multiple scale loop of oriented filters and competition–cooperation mechanisms. Afterwards, the neural architecture performs an attentive recognition of the scene using those oriented filters responses and the chromatic diffusions. Some comparative tests with other models are included in order to prove the recognition capabilities of this neural architecture and how the use of colour information encourages the texture classification and the accuracy of the boundary detection.     

Bone age estimation from carpal radiography images using deep learning

Bone age estimation has been used in medicine to verify whether the bone structure development degree of a person corresponds to their chronological age. Such estimate is useful for prognosis about the development of children and adolescents, as well as for the diagnosis of endocrinological diseases. This work proposes a fully automated methodology for bone age estimation from carpal radiography images. The methodology comprises two steps, the preprocessing of the image and the classification using a convolutional neural network. The system accuracy for different types of preprocessing is evaluated. We compare the accuracy achieved using the full radiography image as input for the neural network and using only parts of the image corresponding to the Phalangeal region, the Epiphyseal region, and the concatenation of these parts with a crop around the wrist. Digital image processing techniques are employed to segment these regions. Experiments are performed using radiography images from the California University Database. The impact of using different pre-trained neural networks for transfer learning is evaluated.     

基于三通道分离特征融合与支持向量机的混凝土图像分类研究

混凝土的不同配合比可决定材料的性能,对于多种配比和粒径大小混凝土图像的分类研究,有利于工业废弃混凝土的高效回收利用.为了提升分类效果,提出了一种新的特征提取模块(ITFA-DLF),该模块在图像分离重构出的R,G和B 3个通道上,使用卷积神经网络(CNN)提取3通道图像的颜色特征,通过多块局部二值模式(MB-LBP)提...     

融合深度网络和浅层纹理特征的甲状腺结节癌变超声图像诊断

目的 在甲状腺结节图像中对甲状腺结节进行良恶性分析,对于甲状腺癌的早期诊断有着重要的意义。随着医疗影像学的发展,大部分的早期甲状腺结节可以在超声图像中准确地检测出来,但对于结节的性质仍然缺乏准确的判断。因此,为实现更为准确的早期甲状腺结节良恶性超声图像诊断,避免不必要的针刺或其他病理活检手术、减轻病患生理痛苦和心理压力及其医疗费用,提出一种基于深度网络和浅层纹理特征融合的甲状腺结节良恶性分类新算法。方法 本文提出的甲状腺结节分类算法由4步组成。首先对超声图像进行尺度配准、人工标记以及图像复原去除以增强图像质量。然后,对增强的图像进行数据扩展,并作为训练集对预训练过的GoogLeNet卷积神经网络进行迁移学习以提取图像中的深度特征。同时,提取图像的旋转不变性局部二值模式（LBP）特征作为图像的纹理特征。最后,将深度特征与图像的纹理特征相融合并输入至代价敏感随机森林分类器中对图像进行良恶性分类。结果 本文方法在标准的甲状腺结节癌变数据集上对甲状腺结节图像取得了正确率99.15%,敏感性99.73%,特异性95.85%以及ROC曲线下面积0.997 0的的好成绩,优于现有的甲状腺结节图像分类方法。结论 实验结果表明,图像的深度特征可以描述医疗超声图像中病灶的整体感官特征,而浅层次纹理特征则可以描述超声图像的边缘、灰度分布等特征,将二者统一的融合特征则可以更为全面地描述图像中病灶区域与非病灶区域之间的差异以及不同病灶性质之间的差异。因此,本文方法可以准确地对甲状腺结节进行分类从而避免不必要手术、减轻病患痛苦和压力。     

Isolated word recognition by neural network models withcross-correlation coefficients for speech dynamics

This paper presents an artificial neural network (ANN) for speaker-independent isolated word speech recognition. The network consists of three subnets in concatenation. The static information within one frame of speech signal is processed in the probabilistic mapping subnet that converts an input vector of acoustic features into a probability vector whose components are estimated probabilities of the feature vector belonging to the phonetic classes that constitute the words in the vocabulary. The dynamics capturing subnet computes the first-order cross correlation between the components of the probability vectors to serve as the discriminative feature derived from the interframe temporal information of the speech signal. These dynamic features are passed for decision-making to the classification subnet, which is a multilayer perceptron (MLP). The architecture of these three subnets are described, and the associated adaptive learning algorithms are derived. The recognition results for a subset of the DARPA TIMIT speech database are reported. The correct recognition rate of the proposed ANN system is 95.5%, whereas that of the best of continuous hidden Markov model (HMM)-based systems is only 91.0%     

Texture segmentation using pyramidal Gabor functions and self-organising feature maps

This paper presents texture segmentation realised with image treatment methods and an artificial neural network model. Gabor oriented filters are used to extract frequential texture features and Self-Organising Feature Maps are used to group and interpolate these features. In order to decrease the number of filters, we use a pyramidal multiresolution method of image representation. We intend to build an architecture inspired by the early stages of the visual cortex, while making local frequential analysis of the images, which must be able to segment different textured images.     

一种面向表情识别的ROI区域二级投票机制

针对如何更有效地使用卷积神经网络从训练图像中学习到的分布式特征进行研究,提出了一种面向人脸表情识别的ROI区域二级投票机制。将图像划分成一系列感兴趣区域（ROI）图像输入到卷积神经网络中进行训练;然后将测试图像的ROI图像输入到卷积神经网络中,统计所有ROI图像的判别结果;最后采用二级投票机制确定测试图像的最终类别,得到最终判别结果。针对卷积神经网络不能从人脸图像中学习到旋转等空间位置信息,引入了STN（spatial transformer network）,提高算法在解决复杂情况下的表情识别问题的能力。实验表明,ROI区域二级投票机制能够更有效地使用卷积神经网络从训练图像中学习到的分布式特征,比直接使用ROI图像进行投票的方法准确率提升了1.1%,引入STN能够有效提升卷积神经网络的鲁棒性,比未引入STN的方法准确率提升了1.5%。     

人工神经网络在三维X线头影测量系统中的应用

给出一种三维X线头影测量中图形图像重建的方法;南正侧位两张X线头影片上72个标志点。可以重建出颅颌骨三维透视图;利用人工神经网络LMBP算法。以病人颅颌骨72个标志点的三维坐标集合在某一平面的二维投影为理想输出,以人体颅颌骨标本72个同名标志点在相同平面的二维坐标集合为训练样本,在训练结束后即可建立两者之问的近似线性关系;由于网络具有泛化能力,因此可用该网络对颅颌骨标本上每一像素进行变换。结果表明变换后72个标志点坐标和病人很好吻合,变换图像为病人近似的颅颌骨图像;即满足口腔正畸诊断要求又获得较好图像视觉效果。     

基于残差3DCNN和三维Gabor滤波器的高光谱图像分类

高光谱图像含有数百个波段,包含丰富的光谱信息,因此被广泛应用于地物分类中,但仍存在 着维数灾难的问题。高光谱图像中同时也含有丰富的纹理信息,有效利用纹理信息能够显著提高分类精度。三 维 Gabor 滤波器不仅能够保留图像丰富的光谱信息,还能提取到图像的纹理特征。为了充分利用高光谱图像的 特征,提出一种基于三维 Gabor 和残差三维卷积神经网络(Res-3DCNN)的分类方法。三维卷积神经网络(3DCNN) 能够直接对三维立方体数据进行处理,提取到深层纹理-光谱信息,然而随着网络层的加深会产生网络退化问 题,因此利用残差思想对 3DCNN 模型进行改进。在 PaviaU,Indian Pines 和 Salinas 3 个公共高光谱图像数据 集上进行实验,分别取得 99.17%,97.40%,98.56%的平均分类精度,结果表明该方法能有效提高高光谱图像 的地物分类精度。     

An HVS-Directed Neural-Network-Based Image Resolution Enhancement Scheme for Image Resizing

In this paper, a novel human visual system (HVS)-directed neural-network-based adaptive interpolation scheme for natural image is proposed. A fuzzy decision system built from the characteristics of the HVS is proposed to classify pixels of the input image into human perception nonsensitive class and sensitive class. Bilinear interpolation is used to interpolate the nonsensitive regions and a neural network is proposed to interpolate the sensitive regions along edge directions. High-resolution digital images along with supervised learning algorithms are used to automatically train the proposed neural network. Simulation results demonstrate that the proposed new resolution enhancement algorithm can produce a higher visual quality for the interpolated image than the conventional interpolation methods.     

多尺度融合的立体匹配算法

针对局部立体匹配方法存在的匹配窗口大小选择困难、弱纹理或高光区域立体匹配精度较低等问题,文中结合卷积神经网络(CNN)与图像金字塔方法,提出多尺度融合的立体匹配算法.训练CNN,用于自动学习待匹配图像对的图像特征,完成匹配代价计算.构建图像金字塔,对待匹配图像对进行多尺度表达.构建弱纹理区域模板,将各层待匹配图像划分为弱纹理区域和丰富纹理区域,将弱纹理区域图像变换成小尺度图像进行匹配度计算,降低弱纹理图像的误匹配率.在变换回大尺度图像时与丰富纹理区域匹配结果融合,保持匹配精度.在KITTI 数据集上的实验表明,文中算法具有较好的图像匹配效果.     

Neural classification of SPOT imagery through integration of intensity and fractal information

It is well known that higher dimensional information essentially leads to better accuracy in remotely sensed image classification. This paper is aimed at land cover classification from SPOT-HRV imagery by the integration of multispectral intensity and texture information. In particular, fractal dimensions are extracted using a wavelet transform as image texture. A neural network approach to classification is adopted in this paper. The underlying network is a modified multilayer perceptron trained by a Kalman filtering technique. The main advantages of this network are (1) its non-backpropagation fashion of learning which leads to a fast convergence, (2) a built-in optimization function, and (3) global scale. Saving computer storage space and a fast learning capability are in particular suitable features for remote sensing applications. Correlation analysis was subsequently performed on both the intensity and fractal images. It was found that fractal information significantly improves the discrimination capability of heterogeneous area such as in urban regions, while it slightly degrades accuracy for homogeneous areas, such as open water. The overall classification performance is superior to results obtained using reflectance only. Improvements over heterogeneous areas are demonstrated.     

Texture classification and segmentation using wavelet packet frame and Gaussian mixture model

In this paper, we propose a scheme for texture classification and segmentation. The methodology involves an extraction of texture features using the wavelet packet frame decomposition. This is followed by a Gaussian-mixture-based classifier which assigns each pixel to the class. Each subnet of the classifier is modeled by a Gaussian mixture model and each texture image is assigned to the class to which pixels of the image most belong. This scheme shows high recognition accuracy in the classification of Brodatz texture images. It can also be expanded to an unsupervised texture segmentation using a Kullback-Leibler divergence between two Gaussian mixtures. The proposed method was successfully applied to Brodatz mosaic image segmentation and fabric defect detection.     

Topology constraint free fuzzy gated neural networks for patternrecognition

A novel topology constraint free neural network architecture using a generalized fuzzy gated neuron model is presented for a pattern recognition task. The main feature is that the network does not require weight adaptation at its input and the weights are initialized directly from the training pattern set. The elimination of the need for iterative weight adaptation schemes facilitates quick network set up times which make the fuzzy gated neural networks very attractive. The performance of the proposed network is found to be functionally equivalent to spatio-temporal feature maps under a mild technical condition. The classification performance of the fuzzy gated neural network is demonstrated on a 12-class synthetic three dimensional (3-D) object data set, real-world eight-class texture data set, and real-world 12 class 3-D object data set. The performance results are compared with the classification accuracies obtained from a spatio-temporal feature map, an adaptive subspace self-organizing map, multilayer feedforward neural networks, radial basis function neural networks, and linear discriminant analysis. Despite the network's ability to accurately classify seen data and adequately generalize validation data, its performance is found to be sensitive to noise perturbations due to fine fragmentation of the feature space. This paper also provides partial solutions to the above robustness issue by proposing certain improvements to various modules of the proposed fuzzy gated neural network.