Improving representation-based classification for robust face recognition

The sparse representation classification (SRC) method proposed by Wright et al. is considered as the breakthrough of face recognition because of its good performance. Nevertheless it still cannot perfectly address the face recognition problem. The main reason for this is that variation of poses, facial expressions, and illuminations of the facial image can be rather severe and the number of available facial images are fewer than the dimensions of the facial image, so a certain linear combination of all the training samples is not able to fully represent the test sample. In this study, we proposed a novel framework to improve the representation-based classification (RBC). The framework first ran the sparse representation algorithm and determined the unavoidable deviation between the test sample and optimal linear combination of all the training samples in order to represent it. It then exploited the deviation and all the training samples to resolve the linear combination coefficients. Finally, the classification rule, the training samples, and the renewed linear combination coefficients were used to classify the test sample. Generally, the proposed framework can work for most RBC methods. From the viewpoint of regression analysis, the proposed framework has a solid theoretical soundness. Because it can, to an extent, identify the bias effect of the RBC method, it enables RBC to obtain more robust face recognition results. The experimental results on a variety of face databases demonstrated that the proposed framework can improve the collaborative representation classification, SRC, and improve the nearest neighbor classifier.     

Weighted residual fusion with multi-modality features for high-resolution aerial scene classification

In scene-level classification of remote sensing, fusion of multi-feature can significantly boost the performance. However, most methods directly fuse the features of different modalities without considering the importance of each feature modality. Based on the above considerations, in this work, multi-modality features weighted residual fusion method is proposed. First, the extracted high-level and low-level features of the scene image are encoded into a unified feature representation. Then the reconstruction residuals of each modality of each scene class are calculated based on two representation-based classification, i.e. sparse representation (SR) and collaborative representation (CR). After fusing the weighted reconstruction residuals of these two modalities with SR and CR, the class label is assigned to the category with the smallest residual. We make extensive evaluations on two challenging remote sensing data sets. The comparison with the state-of-the-art methods demonstrates the effectiveness of our proposed method.     

融合2D-PCA及稀疏表示的掌纹识别方法

提出一种基于稀疏表示的掌纹识别方法,该方法借鉴二维主成分分析(PCA)良好的数据压缩属性和较快的特征提取速度,生成掌纹特征图像.二维PCA不仅克服了一维PCA数据维数过大不易计算的缺点,而且保留了原始图像的数据结构,提取的特征能更好的代表原始图像.为了便于稀疏表达,对提取的掌纹特征图像利用一维主成分分析进行二次特征提取,得到训练样本.虽然此处使用了一维PCA,但是由于这是二次特征提取,提取的特征还是保留了原始图像的数据结构,相比单纯的一维PCA,提高了识别率.利用训练样本构造出冗余字典,并采用稀疏表示理论将测试样本表示为字典原子的线性组合,然后根据表示系数的稀疏性与稀疏集中度实现分类识别.由于该方法利用了表达系数的稀疏性,因此减小了算法的时间和空间复杂度.实验表明,针对香港理工大学的MSpalmprints Database,本文方法的识别率较传统方法有明显提高.     

A supervised dimensionality reduction method-based sparse representation for face recognition

The sparse representation-based classification (SRC) method is a powerful tool to present high-dimensionality data and its superiority in many fields, especially in face recognition application has been proved. With sparsity appropriately harnessed, the SRC can solve face classification problems caused by varying expression, illumination as well as occlusion and disguise. However, face images as high-dimensionality data are usually noisy and the dimensionality is always larger than the number of training sample in real-world applications, which bring a disadvantage for the performance of SRC. Therefore, it is beneficial to perform dimensionality reduction (DR) before utilizing the SRC method. But most prevalent DR methods have no direct connection to SRC. In this paper, we proposed a supervised DR algorithm which suits SRC well and improves the discriminating ability in the low-dimensionality space. The proposed method utilizes the fisher discriminant criterion and low-dimensionality reconstructive restriction to extract the discriminating structure of data. The extensive experiments on public face databases verified the effectiveness of the supervised DR with the model of sparse representation.     

基于核竞争学习算法的图像特征提取

利用核函数学习可有效解决图像特征线性不可分的特性,结合稀疏表示算法的优势,提出了一种新的图像特征提取方法。采用基于竞争学习规则的独立分量分析法对图像进行稀疏表示,该算法可提取数据的高维特征,且不需要优化高阶的非线性函数和进行稀疏密度估计,因而有较快的收敛速度。与仅使用基于竞争学习的独立分量分析法相比,在PolyU数据库上的实验结果表明,采用基于核函数学习和稀疏表示相结合的方法所提取的数据特征有利于提高特征分类精度。     

An improved SRC method based on virtual samples for face recognition

The sparse representation classifier (SRC) performs classification by evaluating which class leads to the minimum representation error. However, in real world, the number of available training samples is limited due to noise interference, training samples cannot accurately represent the test sample linearly. Therefore, in this paper, we first produce virtual samples by exploiting original training samples at the aim of increasing the number of training samples. Then, we take the intra-class difference as data representation of partial noise, and utilize the intra-class differences and training samples simultaneously to represent the test sample in a linear way according to the theory of SRC algorithm. Using weighted score level fusion, the respective representation scores of the virtual samples and the original training samples are fused together to obtain the final classification results. The experimental results on multiple face databases show that our proposed method has a very satisfactory classification performance.     

Feature extraction based on sparse representation with application to epileptic EEG classification

Epilepsy seizure detection in electroencephalogram (EEG) is a major issue in the diagnosis of epilepsy, and it can be considered as a classification problem. Considering the particular property of EEG, which is sparse in Garbor dictionary, a feature extraction method based on sparse representation has been applied to epilepsy detection. To improve classification accuracy, in this article, a novel feature vector is developed, which not only can reflect the main structure, but also can give expression to the relation between main structure and residual information. Classification accuracy, efficiency, and robustness to noise of the new feature are explored and analyzed with publicly available data set. It is demonstrated by experiments that the classification accuracy and the efficiency are simultaneously enhanced with this new feature extraction method, and that the novel classification feature proposed in this work greatly improves the classification performance of epilepsy detection. © 2013 Wiley Periodicals, Inc. Int J Imaging Syst Technol, 23, 104–113, 2013     

应用一种多核稀疏表示模型实现掌纹分类

与稀疏表示(SR)模型相比,基于单个核函数的SR(KSR)模型可以有效减少数据维数、降低学习模型的计算复杂度并提高特征分类精度;但这种模型对核函数及其参数的选择通常不能包含恰当的、完整的分类信息。为了满足更高的特征分类精度需求,提出了一种基于多个核函数的SR(M-KSR)模型及其快速稀疏优化方法,并将其应用于掌纹图像的分类。测试结果证明了基于M-KSR模型的掌纹分类方法的有效性和实用性。     

基于核映射稀疏表示分类的轴承故障诊断

针对传统稀疏表示分类算法在低维空间分类精度难以保证问题,论文提出了基于核映射的稀疏表示分类算法。采用核映射方法获得了低维样本在高维空间的坐标,改善了样本间的线性可分度;在此基础上,利用稀疏表示分类算法获得样本在高维空间上的稀疏解。经滚动轴承故障分类实验验证：新算法对核参数具有较高的鲁棒性;可明显提高分类精度。     

基于自相似性与稀疏表示的超分辨率算法

目的为了解决当前稀疏表示的超分辨率算法效果依赖参与训练的数据的问题,结合图像的自相似性,提出一种基于自相似性与稀疏表示相结合的超分辨率算法。方法算法利用图像的多维自相似性,构建多维图像金字塔,采用改进的相似块搜索策略,得到对应的高低分辨率图像块作为训练样本,然后对样本进行字典训练,最后根据稀疏表示得到超分辨率图像。结果实验结果显示,文中算法在峰值信噪比(PSNR)和结构相似度(SSIM)上优于其他算法,对于实验图像而言,PSNR平均提升了0.5 dB。结论提出的超分辨率算法未引入外部数据库,具有较好的效果,能够用于超分辨率重建。     

Multimodal sensor medical image fusion based on mutual‐structure for joint filtering using sparse representation

Multimodal sensor medical image fusion has been widely reported in recent years, but the fused image by the existing methods introduces low contrast information and little detail information. To overcome this problem, the new image fusion method is proposed based on mutual‐structure for joint filtering and sparse representation in this article. First, the source image is decomposed into a series of detail images and coarse images by mutual‐structure for joint filtering. Second, sparse representation is adopted to fuse coarse images and then local contrast is applied for fusing detail images. Finally, the fused image is reconstructed by the addition of the fused coarse images and the fused detail images. By experimental results, the proposed method shows the best performance on preserving detail information and contrast information in the views of subjective and objective evaluations.     

基于字典学习的主动声呐目标分类方法

主动声呐目标分类在军事和民用方面都有重要的应用和价值。文章基于稀疏表示理论,结合K-奇异值分解和正交匹配追踪算法,提出一种基于学习字典的稀疏表示分类方法（Dictionary Learning Sparse Representation Classification,DLSRC）。首先,利用K-奇异值分解算法训练各个类别目标回波信号,得到带有目标特征信息的类别字典,类别字典对信号具有良好表征能力并且带有目标类别信息;然后,利用正交匹配追踪算法和各个类别字典稀疏分解测试信号,得到各个类别字典下的稀疏系数后重构信号;最后,根据各个重构信号与测试信号的匹配度判定类别,得到分类准确率。结果显示,200个测试数据在信噪比分别为-5、-3、6 dB时,DLSRC法的分类准确率分别达到87%、89%、95.5%。不同信噪比下基于学习字典稀疏表示分类方法的准确率均高于已有的支持向量机（Support Vector Machine,SVM）、K-最近邻（K-Nearest Neighbor,KNN）和柔性最大值分类器（SoftMax）等分类方法,具有较好的分类性能。     

Multi-task Joint Sparse Representation Classification Based on Fisher Discrimination Dictionary Learning

Recently, sparse representation classification (SRC) and fisher discrimination dictionary learning (FDDL) methods have emerged as important methods for vehicle classification. In this paper, inspired by recent breakthroughs of discrimination dictionary learning approach and multi-task joint covariate selection, we focus on the problem of vehicle classification in real-world applications by formulating it as a multi-task joint sparse representation model based on fisher discrimination dictionary learning to merge the strength of multiple features among multiple sensors. To improve the classification accuracy in complex scenes, we develop a new method, called multi-task joint sparse representation classification based on fisher discrimination dictionary learning, for vehicle classification. In our proposed method, the acoustic and seismic sensor data sets are captured to measure the same physical event simultaneously by multiple heterogeneous sensors and the multi-dimensional frequency spectrum features of sensors data are extracted using Mel frequency cepstral coefficients (MFCC). Moreover, we extend our model to handle sparse environmental noise. We experimentally demonstrate the benefits of joint information fusion based on fisher discrimination dictionary learning from different sensors in vehicle classification tasks.     

基于可分离字典的稀疏和低秩表示图像去噪

目的 为了有效去除图像中的椒盐噪声，提高图像质量。方法 文中将可分离字典和低秩表示结合，提出基于可分离字典的稀疏和低秩表示算法(SLRR–SD)。首先，使用可分离字典代替传统的过完备字典可分离字典可以对二维图像直接表示。其次，使用Frobenius范数对分离字典进行约束以挖掘字典内部的低秩性。此外，为了挖掘图像内部的稀疏结构，对表示系数使用稀疏约束进一步提升表示的有效性。结果 提出的算法在噪声强度为5%、10%、20%和30%下，PSNR/FSIM的平均值分别为32.736/0.975、29.769/0.957、29.295/0.951和26.768/0.921。结论 文中算法保留了相邻列之间的相关性，并且可分离字典优化过程也降低了计算负担。实验结果表明，该算法在保留原图像信息的同时能更好地完成去噪任务。     

A novel multimodal medical image fusion using sparse representation and modified spatial frequency

Fusion of multimodal imaging data supports medical experts with ample information for better disease diagnosis and further clinical investigations. Recently, sparse representation (SR)‐based fusion algorithms has been gaining importance for their high performance. Building a compact, discriminative dictionary with reduced computational effort is a major challenge to these algorithms. Addressing this key issue, we propose an adaptive dictionary learning approach for fusion of multimodal medical images. The proposed approach consists of three steps. First, zero informative patches of source images are discarded by variance computation. Second, the structural information of remaining image patches is evaluated using modified spatial frequency (MSF). Finally, a selection rule is employed to separate the useful informative patches of source images for dictionary learning. At the fusion step, batch‐OMP algorithm is utilized to estimate the sparse coefficients. A novel fusion rule which measures the activity level in both spatial domain and transform domain is adopted to reconstruct the fused image with the sparse vectors and trained dictionary. Experimental results of various medical image pairs and clinical data sets reveal that the proposed fusion algorithm gives better visual quality and competes with existing methodologies both visually and quantitatively.     

Virtual images inspired consolidate collaborative representation-based classification method for face recognition

Abstract

The collaborative representation-based classification method performs well in the field of classification of high-dimensional images such as face recognition. It utilizes training samples from all classes to represent a test sample and assigns a class label to the test sample using the representation residuals. However, this method still suffers from the problem that limited number of training sample influences the classification accuracy when applied to image classification. In this paper, we propose a modified collaborative representation-based classification method (MCRC), which exploits novel virtual images and can obtain high classification accuracy. The procedure to produce virtual images is very simple but the use of them can bring surprising performance improvement. The virtual images can sufficiently denote the features of original face images in some case. Extensive experimental results doubtlessly demonstrate that the proposed method can effectively improve the classification accuracy. This is mainly attributed to the integration of the collaborative representation and the proposed feature-information dominated virtual images.     

共享空间基-逐类剩余空间基混合稀疏表示人脸识别算法

针对传统训练样本字典学习未利用类共有信息的不足,引入共享空间和与类别相关的剩余空间,提出了共享空间基-逐类剩余空间基混合稀疏表示人脸识别的算法。该算法首先提取训练样本主成分分析(PCA)特征,获取无标记的共享空间基及其重构样本得到类共有信息;然后结合原始样本得到差分训练集合,并引入类间差异信息构建逐类特异性剩余空间基;最后融合共享空间基和剩余空间基,利用残差判别函数完成模式分类。该方法不仅利用混合空间的正交特性,而且发挥剩余空间的鉴别能力和共享信息稀疏逼近的作用,使结构性字典和模式分类紧密结合。该方法的有效性,分别通过用AR、CMU PIE、Extended Yale B人脸数据库进行的实验得到验证。     

Semi-GSGCN: Social Robot Detection Research with Graph Neural Network

Malicious social robots are the disseminators of malicious information on social networks, which seriously affect information security and network environments. Efficient and reliable classification of social robots is crucial for detecting information manipulation in social networks. Supervised classification based on manual feature extraction has been widely used in social robot detection. However, these methods not only involve the privacy of users but also ignore hidden feature information, especially the graph feature, and the label utilization rate of semi-supervised algorithms is low. Aiming at the problems of shallow feature extraction and low label utilization rate in existing social network robot detection methods, in this paper a robot detection scheme based on weighted network topology is proposed, which introduces an improved network representation learning algorithm to extract the local structure features of the network, and combined with the graph convolution network (GCN) algorithm based on the graph filter, to obtain the global structure features of the network. An end-to-end semi-supervised combination model (Semi-GSGCN) is established to detect malicious social robots. Experiments on a social network dataset (cresci-rtbust-2019) show that the proposed method has high versatility and effectiveness in detecting social robots. In addition, this method has a stronger insight into robots in social networks than other methods.     

Novel DDoS Feature Representation Model Combining Deep Belief Network and Canonical Correlation Analysis

Distributed denial of service (DDoS) attacks launch more and more frequently and are more destructive. Feature representation as an important part of DDoS defense technology directly affects the efficiency of defense. Most DDoS feature extraction methods cannot fully utilize the information of the original data, resulting in the extracted features losing useful features. In this paper, a DDoS feature representation method based on deep belief network (DBN) is proposed. We quantify the original data by the size of the network flows, the distribution of IP addresses and ports, and the diversity of packet sizes of different protocols and train the DBN in an unsupervised manner by these quantified values. Two feedforward neural networks (FFNN) are initialized by the trained deep belief network, and one of the feedforward neural networks continues to be trained in a supervised manner. The canonical correlation analysis (CCA) method is used to fuse the features extracted by two feedforward neural networks per layer. Experiments show that compared with other methods, the proposed method can extract better features.     

Sample partition and grouped sparse representation

Recently, conventional representation-based classification (RBC) methods demonstrate promising performance in image recognition. However, conventional RBCs only use a kind of deviations between the test sample and the linear combination of training samples of each class to perform classification. In many cases, a single kind of deviations corresponding to each class cannot effectively reflect the difference between the test sample and reconstructed sample of each class. Moreover, in practical applications, limited training samples are not able to reflect the possible changes of the image sufficiently. In this paper, we propose a novel scheme to tackle the above-mentioned problems. Specifically, we first use the original training samples to generate corresponding mirror samples. Thus, the original sample set and its mirror counterpart are treated as two separate training groups. Secondly, we perform collaborative representation classification on these two groups from which each class leads to two kinds of deviations, respectively. Finally, we fuse two kinds of deviations of each class and their correlation coefficient to classify the test sample. The correlation coefficient is defined for two kinds of deviations of each class. Experimental results on four databases show the proposed scheme can improve the recognition rate in image-based recognition.