Least-squares independent component analysis

Accurately evaluating statistical independence among random variables is a key element of independent component analysis (ICA). In this letter, we employ a squared-loss variant of mutual information as an independence measure and give its estimation method. Our basic idea is to estimate the ratio of probability densities directly without going through density estimation, thereby avoiding the difficult task of density estimation. In this density ratio approach, a natural cross-validation procedure is available for hyperparameter selection. Thus, all tuning parameters such as the kernel width or the regularization parameter can be objectively optimized. This is an advantage over recently developed kernel-based independence measures and is a highly useful property in unsupervised learning problems such as ICA. Based on this novel independence measure, we develop an ICA algorithm, named least-squares independent component analysis.     

Efficient blind dereverberation and echo cancellation based on independent component analysis for actual acoustic signals

This letter presents a new algorithm for blind dereverberation and echo cancellation based on independent component analysis (ICA) for actual acoustic signals. We focus on frequency domain ICA (FD-ICA) because its computational cost and speed of learning convergence are sufficiently reasonable for practical applications such as hands-free speech recognition. In applying conventional FD-ICA as a preprocessing of automatic speech recognition in noisy environments, one of the most critical problems is how to cope with reverberations. To extract a clean signal from the reverberant observation, we model the separation process in the short-time Fourier transform domain and apply the multiple input/output inverse-filtering theorem (MINT) to the FD-ICA separation model. A naive implementation of this method is computationally expensive, because its time complexity is the second order of reverberation time. Therefore, the main issue in dereverberation is to reduce the high computational cost of ICA. In this letter, we reduce the computational complexity to the linear order of the reverberation time by using two techniques: (1) a separation model based on the independence of delayed observed signals with MINT and (2) spatial sphering for preprocessing. Experiments show that the computational cost grows in proportion to the linear order of the reverberation time and that our method improves the word correctness of automatic speech recognition by 10 to 20 points in a RT??= 670 ms reverberant environment.     

On the Assumption of Spherical Symmetry and Sparseness for the Frequency-Domain Speech Model

A new independent component analysis (ICA) formulation called independent vector analysis (IVA) was proposed in order to solve the permutation problem in convolutive blind source separation (BSS). Instead of running ICA in each frequency bin separately and correcting the disorder with an additional algorithmic scheme afterwards, IVA exploited the dependency among the frequency components of a source and dealt with them as a multivariate source by modeling it with sparse and spherically, or radially, symmetric joint probability density functions (pdfs). In this paper, we compare the speech separation performances of IVA by using a group of l^p-norm-invariant sparse pdfs where the value of and the sparseness can be controlled. Also, we derive an IVA algorithm from a nonparametric perspective with the constraint of spherical symmetry and high dimensionality. Simulation results confirm the efficiency of assuming sparseness and spherical symmetry for the speech model in the frequency domain.     

Factor Analyzed Subspace Modeling and Selection

We present a novel subspace modeling and selection approach for noisy speech recognition. In subspace modeling, we develop a factor analysis (FA) representation of noisy speech, which is a generalization of a signal subspace (SS) representation. Using FA, noisy speech is represented by the extracted common factors, factor loading matrix, and specific factors. The observation space of noisy speech is accordingly partitioned into a principal subspace, containing speech and noise, and a minor subspace, containing residual speech and residual noise. We minimize the energies of speech distortion in the principal subspace as well as in the minor subspace so as to estimate clean speech with residual information. Importantly, we explore the optimal subspace selection via solving the hypothesis test problems. We test the equivalence of eigenvalues in the minor subspace to select the subspace dimension. To fulfill the FA spirit, we also examine the hypothesis of uncorrelated specific factors/residual speech. The subspace can be partitioned according to a consistent confidence towards rejecting the null hypothesis. Optimal solutions are realized through the likelihood ratio tests, which arrive at the approximated chi-square distributions as test statistics. In the experiments on the Aurora2 database, the FA model significantly outperforms the SS model for speech enhancement and recognition. Subspace selection via testing the correlation of residual speech achieves higher recognition accuracies than that of testing the equivalent eigenvalues in the minor subspace.     

Modular organization of adaptive colouration in flounder and cuttlefish revealed by independent component analysis

Flounders and cuttlefish have an impressive ability to change colouration, for camouflage and, in the case of cuttlefish, for communication. We pursue the hypothesis that these diverse patterns are created by combining a small number of distinct pattern modules. Independent component analysis (ICA) is a powerful tool for identifying independent sources of variation in linear mixtures of signals. Two versions of ICA are used, one assuming that sources have independence over time, and the other over space. These reveal the modularity of the skin colouration system, and suggest how the pattern modules are combined in specific behavioural contexts. ICA may therefore be a useful tool for studying animal camouflage and communication.     

A new method for fMRI data processing: Neighborhood independent component correlation algorithm and its preliminary application

Independent component analysis (ICA) is a newly developed promising technique in signal processing applications. The effective separation and discrimination of functional Magnetic Resonance Imaging (fMRI) signals is an area of active research and widespread interest. Therefore, the development of an ICA based fMRI data processing method is of obvious value both theoretically and in potential applications. In this paper, analyzed firstly is the drawback of the extant popular ICA-fMRI method where the adopted signal model assumes the independence of spatial distributions of the signals and noise. Then presented is a new fMRI signal model, which assumes the independence of temporal courses of signal and noise in a tiny spatial domain. Consequently we get a novel fMRI data processing method: Neighborhood independent component correlation algorithm. The effectiveness is elucidated through theoretical analysis and simulation tests, and finally a real fMRI data test is presented.     

Independent component analysis using Potts models

We explore the extending application of Potts encoding to the task of independent component analysis, which primarily deals with the problem of minimizing the Kullback-Leibler divergence between the joint distribution and the product of all marginal distributions of output components. The competitive mechanism of Potts neurons is used to encode the overlapping projections from observations to output components. Based on these projections, the marginal distributions and the entropy of output components are made tractable for computation and the adaptation of the de-mixing matrix toward independent output components is obtained. The Potts model for ICA is well formulated by an objective function subject to a set of constraints, which leads to a novel energy function. A hybrid of the mean field annealing and the gradient descent method is applied to the energy function. Our approach to independent component analysis presents a new criterion for ICA. The performance of the Potts model for ICA given by our numerical simulations is encouraging.     

基于MVDR和ICA的语音识别方法研究

本文讨论了最小方差无失真响应建模方法,并与线性预测方法进行了比较,比较发现最小方差无失真响应滤波器能提供一个更好的原始语音包络。然后在研究ICA原理及FastICA快速算法的基础上,将MVDR参数提取方法与独立分量分析方法相结合,并与传统语音识别方法在有噪声和无噪声的情况下进行了比较,进而对识别率、计算时间等结果进行了分析。MVDR参数提取方法可以提高语音识别系统的识别率,但是会增加平均识别时间;而经过ICA特征变换后的语音识别系统具有较好的鲁棒性。     

基于非参数独立分量分析的说话人识别方法

首先用非参数独立分量分析方法提取表征说话人音频特性的时域基函数组,语音信号可由这些基函数线性组合而成。每个可识别的说话人对应一个不同的基函数组,对某个特定人的输入音频,只有与它对应的基函数组使其系数向量各分量之间的独立性最强(也就是互信息最小)。对待识别音频,分别用已知说话人的时域基函数组计算各自的系数向量,并计算系数向量各分量之间的互信息。互信息最小的基函数组对应的说话人即为识别结果。实验结果表明,即使用很少的测试数据.也能达到很高的识别率。     

基于独立分子量分析的图象分离技术及应用

简要介绍了有关独立分量分析的基本理论和算法,探讨了独立分量分析在序列图象处理方面的应用,提出了基于独立分量分析的运动目标检测新方法,同时用独立分量分析方法对含有运动目标的序列图象进行了独立分量分离的试验,试验中,首先获取序列图象的独立分量和模型混合矩阵,然后将含有背景干扰的独立分量置零,并用混合矩阵进行逆运算,从而获得非常清晰的运动目标轨迹,试验结果表明,这种独立分量分析方法具有良好的盲源分离性能,而且在运动目标检测等方面,基于独立分量分析的检测方法较传统的检测方法更有效。     

A Resampling Test for the Total Independence of Stationary Time Series: Application to the Performance Evaluation of ICA Algorithms

This paper addresses the independence testing of stationary time series. We develop a resampling test based on the Kankainen–Ushakov test of total independence. The resampling test, contrary to the original test, can be also applied to the data with a time-structure. The simulation studies demonstrate the good performance of the proposed test even with strongly autocorrelated time series. As an application, we consider biomedical signal processing and independent component analysis (ICA). The independence test can be used as a performance criterion for ICA algorithms. The practical example of performance evaluation deals with the ICA of electroencephalogram (EEG) data.     

Ensemble learning for independent component analysis

It is well known that the applicability of independent component analysis (ICA) to high-dimensional pattern recognition tasks such as face recognition often suffers from two problems. One is the small sample size problem. The other is the choice of basis functions (or independent components). Both problems make ICA classifier unstable and biased. In this paper, we propose an enhanced ICA algorithm by ensemble learning approach, named as random independent subspace (RIS), to deal with the two problems. Firstly, we use the random resampling technique to generate some low dimensional feature subspaces, and one classifier is constructed in each feature subspace. Then these classifiers are combined into an ensemble classifier using a final decision rule. Extensive experimentations performed on the FERET database suggest that the proposed method can improve the performance of ICA classifier.     

Generalized likelihood ratio test for varying-coefficient models with different smoothing variables

Varying-coefficient models are popular multivariate nonparametric fitting techniques. When all coefficient functions in a varying-coefficient model share the same smoothing variable, inference tools available include the F-test, the sieve empirical likelihood ratio test and the generalized likelihood ratio (GLR) test. However, when the coefficient functions have different smoothing variables, these tools cannot be used directly to make inferences on the model because of the differences in the process of estimating the functions. In this paper, the GLR test is extended to models of the latter case by the efficient estimators of these coefficient functions. Under the null hypothesis the new proposed GLR test follows the χ²-distribution asymptotically with scale constant and degree of freedom independent of the nuisance parameters, known as Wilks phenomenon. Further, we have derived its asymptotic power which is shown to achieve the optimal rate of convergence for nonparametric hypothesis testing. A simulation study is conducted to evaluate the test procedure empirically.     

基于最短路径和自然梯度的过完备ICA算法

独立成分分析(ICA)是一种在给出的随机向量中找出统计独立的数据的统计方法，而过完备独立成分分析则是ICA问题中的一类特殊的情形，它要的源信号的数目比观测信号的数目要多。该文提出了一种基于最短路径算法和自然梯度的解决过完备独立成分分析的新算法Turbo-overcomplete。该算法采用了最短路径方法来推断源信号和采用自然梯度的方法来学习基向量，并采用Turbo-overcomplete算法来进行语音信号分离的实验，并把实验结果与现在的一些过完备独立成份分析算法进行了比较。     

Using an ICA representation of local color histograms for object recognition

This paper applies a Bayesian classification scheme to the problem of object recognition through probabilistic modeling of local color histograms. In this context, the density estimation is generally performed via nonparametric kernel methods and the high dimensionality does not allow precision in the results. We propose a local independent component analysis (ICA) representation of the data. Within this representation, the components can be assumed statistically independent and, for this particular problem, sparsity of the independent components is observed. We show how these two characteristics simplify and add accuracy to the density estimation and develop a Bayesian decision scheme within this representation. We propose a set of possible density estimations for supergaussian densities, the density type associated with a sparse representation. Two experiments were performed. The first one illustrates the properties of the ICA representation for local color histograms. The second experiment tests the ICA classification model for a large set of pharmaceutical products and compares this scheme with a nonparametric technique based on Gaussian Kernels, two nearest-neighbor techniques and global histogram approach.     

独立成分分析应用于人脸识别中的几个问题

独立成分分析近年来广泛应用于人脸识别等模式领域。首先对人脸图像进行预处理降维,然后利用ICA算法获得人脸影像独立基成分,利用人脸影像独立基来构造一个子空间,最后利用待识别图像在这个空间上的投影进行人脸识别。针对训练样本个数,训练人数以及独立基数目影响识别率等三个问题进行实验,得出结果并进行分析。     

一种基于FastICA的运动目标检测新方法

独立分量分析是一种新颖的自源分离技术,目前已经在语音识别、图像处理、通信系统和医学信号处理等领域得到了广泛的关注。简单介绍了独立分量分析的基本理论和算法,用快速独立分量分析(FastICA)方法进行运动目标检测的试验,试验结果表明这是一种鲁棒性较强的运动目标检测方法。     

一种改进的FastICA算法及其应用

独立分量分析是基于信号高阶统计量的信号分析方法,它可以找到隐含在数据中的独立分量,已经广泛应用到语音信号处理、图像处理及信息通信等方面。目前应用较多的快速独立分量分析（FastICA）利用了牛顿迭代法原理,具有较快的收敛速度,但对初始值的选择比较敏感。为克服其缺点,改进其优化学习算法,在牛顿迭代方向增加一维搜索,使改进后的算法的收敛性不依赖于初始值的选择。将改进的FastICA算法应用到运动目标检测中,取得稳定性较强的结果。     

基于核独立成分分析的人脸识别研究

在人脸识别中提出一种基于非线性子空间的核独立成分分析(KICA)方法。在简单介绍了ICA方法的基础上,对KICA方法的基本原理和算法作了较为详细的描述。为了验证基于KICA和ICA的人脸识别方法的识别效果,进行了对比实验和分析。实验和分析结果表明,在人脸识别中,基于KICA的方法优于基于ICA的方法。     

Estimation of speech embedded in a reverberant and noisy environment by independent component analysis and wavelets

In this paper, we develop a system for enhancement of the speech signal with highest energy from a linear convolutive mixture of n statistically independent sound sources recorded by m microphones, where m相似文献