Scene-based nonuniformity correction algorithm based on interframe registration

In this paper, we present a simple and effective scene-based nonuniformity correction (NUC) method for infrared focal plane arrays based on interframe registration. This method estimates the global translation between two adjacent frames and minimizes the mean square error between the two properly registered images to make any two detectors with the same scene produce the same output value. In this way, the accumulation of the registration error can be avoided and the NUC can be achieved. The advantages of the proposed algorithm lie in its low computational complexity and storage requirements and ability to capture temporal drifts in the nonuniformity parameters. The performance of the proposed technique is thoroughly studied with infrared image sequences with simulated nonuniformity and infrared imagery with real nonuniformity. It shows a significantly fast and reliable fixed-pattern noise reduction and obtains an effective frame-by-frame adaptive estimation of each detector's gain and offset.     

Scene-based nonuniformity correction using local constant statistics

In scene-based nonuniformity correction, the statistical approach assumes all possible values of the true-scene pixel are seen at each pixel location. This global-constant-statistics assumption does not distinguish fixed pattern noise from spatial variations in the average image. This often causes the "ghosting" artifacts in the corrected images since the existing spatial variations are treated as noises. We introduce a new statistical method to reduce the ghosting artifacts. Our method proposes a local-constant statistics that assumes that the temporal signal distribution is not constant at each pixel but is locally true. This considers statistically a constant distribution in a local region around each pixel but uneven distribution in a larger scale. Under the assumption that the fixed pattern noise concentrates in a higher spatial-frequency domain than the distribution variation, we apply a wavelet method to the gain and offset image of the noise and separate out the pattern noise from the spatial variations in the temporal distribution of the scene. We compare the results to the global-constant-statistics method using a clean sequence with large artificial pattern noises. We also apply the method to a challenging CCD video sequence and a LWIR sequence to show how effective it is in reducing noise and the ghosting artifacts.     

Scene-based nonuniformity correction and enhancement: pixel statistics and subpixel motion

We propose a framework for scene-based nonuniformity correction (NUC) and nonuniformity correction and enhancement (NUCE) that is required for focal-plane array-like sensors to obtain clean and enhanced-quality images. The core of the proposed framework is a novel registration-based nonuniformity correction super-resolution (NUCSR) method that is bootstrapped by statistical scene-based NUC methods. Based on a comprehensive imaging model and an accurate parametric motion estimation, we are able to remove severe/structured nonuniformity and in the presence of subpixel motion to simultaneously improve image resolution. One important feature of our NUCSR method is the adoption of a parametric motion model that allows us to (1) handle many practical scenarios where parametric motions are present and (2) carry out perfect super-resolution in principle by exploring available subpixel motions. Experiments with real data demonstrate the efficiency of the proposed NUCE framework and the effectiveness of the NUCSR method.     

Scene-based nonuniformity correction technique that exploits knowledge of the focal-plane array readout architecture

Spatial fixed-pattern noise is a common and major problem in modern infrared imagers owing to the nonuniform response of the photodiodes in the focal plane array of the imaging system. In addition, the nonuniform response of the readout and digitization electronics, which are involved in multiplexing the signals from the photodiodes, causes further nonuniformity. We describe a novel scene based on a nonuniformity correction algorithm that treats the aggregate nonuniformity in separate stages. First, the nonuniformity from the readout amplifiers is corrected by use of knowledge of the readout architecture of the imaging system. Second, the nonuniformity resulting from the individual detectors is corrected with a nonlinear filter-based method. We demonstrate the performance of the proposed algorithm by applying it to simulated imagery and real infrared data. Quantitative results in terms of the mean absolute error and the signal-to-noise ratio are also presented to demonstrate the efficacy of the proposed algorithm. One advantage of the proposed algorithm is that it requires only a few frames to obtain high-quality corrections.     

Scene-based nonuniformity correction for focal plane arrays by the method of the inverse covariance form

What is to our knowledge a new scene-based algorithm for nonuniformity correction in infrared focal-plane array sensors has been developed. The technique is based on the inverse covariance form of the Kalman filter (KF), which has been reported previously and used in estimating the gain and bias of each detector in the array from scene data. The gain and the bias of each detector in the focal-plane array are assumed constant within a given sequence of frames, corresponding to a certain time and operational conditions, but they are allowed to randomly drift from one sequence to another following a discrete-time Gauss-Markov process. The inverse covariance form filter estimates the gain and the bias of each detector in the focal-plane array and optimally updates them as they drift in time. The estimation is performed with considerably higher computational efficiency than the equivalent KF. The ability of the algorithm in compensating for fixed-pattern noise in infrared imagery and in reducing the computational complexity is demonstrated by use of both simulated and real data.     

Adaptive convergence nonuniformity correction algorithm

Nowadays, convergence and ghosting artifacts are common problems in scene-based nonuniformity correction (NUC) algorithms. In this study, we introduce the idea of space frequency to the scene-based NUC. Then the convergence speed factor is presented, which can adaptively change the convergence speed by a change of the scene dynamic range. In fact, the convergence speed factor role is to decrease the statistical data standard deviation. The nonuniformity space relativity characteristic was summarized by plenty of experimental statistical data. The space relativity characteristic was used to correct the convergence speed factor, which can make it more stable. Finally, real and simulated infrared image sequences were applied to demonstrate the positive effect of our algorithm.     

微测辐射热计的非均匀性校正新方法

针对微测辐射热计的非均匀性校正对衬底温度要求较高的问题,从探测器的线性模型出发,提出了一种新型非均匀性校正方法。方法首先令阵列中不同探测单元的光响应率比和衬底温度响应率比分别相等,达到补偿衬底温度变化的目的;随后再执行传统的两点非均匀性校正。用数模转换器将存储在EPROM内的偏置电压输出到MOS管的栅极上,实现对偏置电流的控制,调节探测元及补偿元的响应率。仿真结果表明,该校正方法可以在变化范围约为4K的均匀衬底温度内达到良好校正效果。     

Generalized algebraic scene-based nonuniformity correction algorithm

A generalization of a recently developed algebraic scene-based nonuniformity correction algorithm for focal plane array (FPA) sensors is presented. The new technique uses pairs of image frames exhibiting arbitrary one- or two-dimensional translational motion to compute compensator quantities that are then used to remove nonuniformity in the bias of the FPA response. Unlike its predecessor, the generalization does not require the use of either a blackbody calibration target or a shutter. The algorithm has a low computational overhead, lending itself to real-time hardware implementation. The high-quality correction ability of this technique is demonstrated through application to real IR data from both cooled and uncooled infrared FPAs. A theoretical and experimental error analysis is performed to study the accuracy of the bias compensator estimates in the presence of two main sources of error.     

Statistical algorithm for nonuniformity correction in focal-plane arrays

A statistical algorithm has been developed to compensate for the fixed-pattern noise associated with spatial nonuniformity and temporal drift in the response of focal-plane array infrared imaging systems. The algorithm uses initial scene data to generate initial estimates of the gain, the offset, and the variance of the additive electronic noise of each detector element. The algorithm then updates these parameters by use of subsequent frames and uses the updated parameters to restore the true image by use of a least-mean-square error finite-impulse-response filter. The algorithm is applied to infrared data, and the restored images compare favorably with those restored by use of a multiple-point calibration technique.     

Radiometrically accurate scene-based nonuniformity correction for array sensors

A novel radiometrically accurate scene-based nonuniformity correction (NUC) algorithm is described. The technique combines absolute calibration with a recently reported algebraic scene-based NUC algorithm. The technique is based on the following principle: First, detectors that are along the perimeter of the focal-plane array are absolutely calibrated; then the calibration is transported to the remaining uncalibrated interior detectors through the application of the algebraic scene-based algorithm, which utilizes pairs of image frames exhibiting arbitrary global motion. The key advantage of this technique is that it can obtain radiometric accuracy during NUC without disrupting camera operation. Accurate estimates of the bias nonuniformity can be achieved with relatively few frames, which can be fewer than ten frame pairs. Advantages of this technique are discussed, and a thorough performance analysis is presented with use of simulated and real infrared imagery.     

Noise-cancellation-based nonuniformity correction algorithm for infrared focal-plane arrays

The spatial fixed-pattern noise (FPN) inherently generated in infrared (IR) imaging systems compromises severely the quality of the acquired imagery, even making such images inappropriate for some applications. The FPN refers to the inability of the photodetectors in the focal-plane array to render a uniform output image when a uniform-intensity scene is being imaged. We present a noise-cancellation-based algorithm that compensates for the additive component of the FPN. The proposed method relies on the assumption that a source of noise correlated to the additive FPN is available to the IR camera. An important feature of the algorithm is that all the calculations are reduced to a simple equation, which allows for the bias compensation of the raw imagery. The algorithm performance is tested using real IR image sequences and is compared to some classical methodologies.     

An algebraic algorithm for nonuniformity correction in focal-plane arrays

A scene-based algorithm is developed to compensate for bias nonuniformity in focal-plane arrays. Nonuniformity can be extremely problematic, especially for mid- to far-infrared imaging systems. The technique is based on use of estimates of interframe subpixel shifts in an image sequence, in conjunction with a linear-interpolation model for the motion, to extract information on the bias nonuniformity algebraically. The performance of the proposed algorithm is analyzed by using real infrared and simulated data. One advantage of this technique is its simplicity; it requires relatively few frames to generate an effective correction matrix, thereby permitting the execution of frequent on-the-fly nonuniformity correction as drift occurs. Additionally, the performance is shown to exhibit considerable robustness with respect to lack of the common types of temporal and spatial irradiance diversity that are typically required by statistical scene-based nonuniformity correction techniques.     

非均匀校正技术算法分析与实时系统设计

为获得良好的红外焦平面阵列非均匀校正效果,讨论了非均匀性的来源、噪声类型和目前基于定标,基于场景的常用非均匀校正方法.对修正的时域高通滤波、改进的神经元网络等利用场景信息来估计探测器参数的校正算法进行了仿真效果和实时性能的分析与评价.同时设计了一种以TMS320DM642为处理核心的小型低功耗DSP硬件系统平台,描述了系统流程和实时实现策略,为红外焦平面系统提供了一条有效的实现路径.     

基于自适应多点法的sCMOS实时非均匀性校正

为改善sCMOS读出电路工艺偏差导致的非均匀性问题,本文提出了自适应多点非均匀性校正方法。算法首先以搜寻最小范数点、阈值比较的方式分别确定最优分段点的位置以及最佳分段数量,然后再根据这些分段信息在各区间段分别进行两点校正。通过该自适应方法可有效改善传统多点法中由于分段参数选择不当导致的校正性能下降。同时,为实现实时的非均匀性校正,文中根据自适应多点法的算法特点,提出了一种与之匹配的嵌入式数据串流校正方案,可在不影响现有相机采集结构以及采集速率的情况下实现非均匀性的校正。     

Statistical algorithm for nonuniformity correction in focal-plane arrays.

A statistical algorithm has been developed to compensate for the fixed-pattern noise associated with spatial nonuniformity and temporal drift in the response of focal-plane array infrared imaging systems. The algorithm uses initial scene data to generate initial estimates of the gain, the offset, and the variance of the additive electronic noise of each detector element. The algorithm then updates these parameters by use of subsequent frames and uses the updated parameters to restore the true image by use of a least-mean-square error finite-impulse-response filter. The algorithm is applied to infrared data, and the restored images compare favorably with those restored by use of a multiple-point calibration technique.     

Multimodel Kalman filtering for adaptive nonuniformity correction in infrared sensors

We present an adaptive technique for the estimation of nonuniformity parameters of infrared focal-plane arrays that is robust with respect to changes and uncertainties in scene and sensor characteristics. The proposed algorithm is based on using a bank of Kalman filters in parallel. Each filter independently estimates state variables comprising the gain and the bias matrices of the sensor, according to its own dynamic-model parameters. The supervising component of the algorithm then generates the final estimates of the state variables by forming a weighted superposition of all the estimates rendered by each Kalman filter. The weights are computed and updated iteratively, according to the a posteriori-likelihood principle. The performance of the estimator and its ability to compensate for fixed-pattern noise is tested using both simulated and real data obtained from two cameras operating in the mid- and long-wave infrared regime.     

Solution for the nonuniformity correction of infrared focal plane arrays

Based on the S-curve model of the detector response of infrared focal plan arrays (IRFPAs), an improved two-point correction algorithm is presented. The algorithm first transforms the nonlinear image data into linear data and then uses the normal two-point algorithm to correct the linear data. The algorithm can effectively overcome the influence of nonlinearity of the detector's response, and it enlarges the correction precision and the dynamic range of the response. A real-time imaging-signal-processing system for IRFPAs that is based on a digital signal processor and field-programmable gate arrays is also presented. The nonuniformity correction capability of the presented solution is validated by experimental imaging procedures of a 128 x 128 pixel IRFPA camera prototype.     

Kalman filtering for adaptive nonuniformity correction in infrared focal-plane arrays

A novel statistical approach is undertaken for the adaptive estimation of the gain and bias nonuniformity in infrared focal-plane array sensors from scene data. The gain and the bias of each detector are regarded as random state variables modeled by a discrete-time Gauss-Markov process. The proposed Gauss-Markov framework provides a mechanism for capturing the slow and random drift in the fixed-pattern noise as the operational conditions of the sensor vary in time. With a temporal stochastic model for each detector's gain and bias at hand, a Kalman filter is derived that uses scene data, comprising the detector's readout values sampled over a short period of time, to optimally update the detector's gain and bias estimates as these parameters drift. The proposed technique relies on a certain spatiotemporal diversity condition in the data, which is satisfied when all detectors see approximately the same range of temperatures within the periods between successive estimation epochs. The performance of the proposed technique is thoroughly studied, and its utility in mitigating fixed-pattern noise is demonstrated with both real infrared and simulated imagery.     

Action performance evaluation in video sequences

In this paper, we propose a computer vision scheme for action performance evaluation in video sequences. Different from action recognition algorithms that aim at the classification of an unknown action from a set of predefined reference actions, the action evaluation system scores the action performance of a trainee with respect to professional trainers. It can be applied to sports, exercise fitness and rehabilitation evaluation. The global spatiotemporal representation extended from the Motion History Image is used to describe space–time changes of an action in videos. A self-comparison mechanism that reconstructs the trainee’s action as a linear combination of the trainers’ temporal templates is used to measure the deviation. An exponential utility function converts the reconstruction error into an understandable score between 0% and 100%. Test results on table-tennis scenarios have shown the effectiveness of the proposed method. It is also computationally very fast for on-line, real-time feedback of action performance.     

Comments on “A correction algorithm for detector nonuniformity in computed tomography”

In this paper we comment on the publication “A correction algorithm for detector nonuniformity in computed tomography” by Sun et al. (Nucl. Instr. and Meth. A 505 (2003) 552).