Adaptive tracking of multiple hot-spot target IR images

In the recent past, the capability of tracking dynamic targets from forward-looking infrared (FLIR) measurements has been improved substantially, by replacing standard correlation trackers with adaptive extended Kalman filters. This research investigates a tracker able to handle "multiple hot-spot" targets, in which digital (or optical) signal processing is employed on the FLIR data to identify the underlying target shape. This identified shape is then used in the measurement model portion of the filter as it estimates target offset from the center of the field-of-view. In this algorithm, an extended Kalman filter processes the raw intensity measurements from the FLIR to produce target estimates. An alternative algorithm uses a linear Kalman filter to process the position indications of an enhanced correlator in order to generate tracking estimates; the enhancement is accomplished not only by thresholding to eliminate poor correlation information, but also by incorporating the dynamics information from the Kalman filter and the on-line identification of the target shape as a template instead of merely using previous frames of data. The performance capabilities of these two algorithms are evaluated under various tracking environment conditions and for a range of choices of design parameters.     

一种红外序列图像弱小目标自动捕获方法

提出一种新的基于形态重构与自适应小波算法的自动捕获红外弱小目标的方法,处理方法分为帧间与帧内处理两部分。首先论证了形态重构滤波器在完备格理论下可以实现对红外图像背景的重构,其次分析了自适应小波结合了线性小波强抑制噪声特性和形态小波好的保留目标细节特性,在红外图像能够获得更好的去噪性能,最后通过结合自适应阈值处理方法和准则处理实现了帧内处理,利用时间序列上的形态膨胀累加完成帧间处理。通过对三种不同的红外图像序列的仿真处理,实验结果表明自动捕获方法可以快速准确地捕获图像的弱小目标。     

An evolutionary particle filter with the immune genetic algorithm for intelligent video target tracking

Particle filter algorithm is widely used for target tracking using video sequences, which is of great importance for intelligent surveillance applications. However, there is still much room for improvement, e.g. the so-called “sample impoverishment”. It is brought by re-sampling which aims to avoid particle degradation, and thus becomes the inherent shortcoming of the particle filter. In order to solve the problem of sample impoverishment, increase the number of meaningful particles and ensure the diversity of the particle set, an evolutionary particle filter with the immune genetic algorithm (IGA) for target tracking is proposed by adding IGA in front of the re-sampling process to increase particle diversity. Particles are regarded as the antibodies of the immune system, and the state of target being tracked is regarded as the external invading antigen. With the crossover and mutation process, the immune system produces a large number of new antibodies (particles), and thus the new particles can better approximate the true state by exploiting new areas. Regulatory mechanisms of antibodies, such as promotion and suppression, ensure the diversity of the particle set. In the proposed algorithm, the particle set optimized by IGA can better express the true state of the target, and the number of meaningful particles can be increased significantly. The effectiveness and robustness of the proposed particle filter are verified by target tracking experiments. Simulation results show that the proposed particle filter is better than the standard one in particle diversity and efficiency. The proposed algorithm can easily be extended to multiple objects tracking problems with occlusions.     

Robust scale invariant target detection using the scale-space theory and optimization for IRST

This paper presents a new small target detection method using scale invariant feature. Detecting small targets whose sizes are varying is very important to automatic target detection in infrared search and track (IRST). The conventional spatial filtering methods with fixed sized kernel show limited target detection performance for incoming targets. The scale invariant target detection can be defined as searching for maxima in the 3D (x, y, and scale) representation of an image with the Laplacian function. The scale invariant feature can detect different sizes of targets robustly. Experimental results with real FLIR images show higher detection rate and lower false alarm rate than conventional methods. Furthermore, the proposed method shows very low false alarms in scan-based IR images than conventional filters.     

Automatic target recognition and tracking in forward-looking infrared image sequences with a complex background

This paper presents a technique for automatic airborne target recognition and tracking in forward-looking infrared (FLIR) images with a complex background. An image splitting and merging method is applied for detecting target signals. The presence of a complex background due to clouds and sun glint generates clutter in the image with the resulting possibility of false alarms. A Bayesian classifier trained using the NMI (normalized moment of inertia) feature is proposed for efficient clutter rejection. After classification, target candidates are entered into a tracking filter. As an efficient and robust multi-target tracking filter in cluttered environments, the JDC-JIHPDAF is proposed. Experimental results using a wide range of real FLIR images ensure reliable classification and automatic target recognition performance.     

Improved infrared small target detection and tracking method based on new intelligence particle filter

Track‐before‐detect algorithm based on the particle filter algorithm has the problems of low tracking precision, poor particles, and requiring a large amount of particles to be calculated in a low signal‐to‐noise ratio, which is difficult to meet the accuracy and speed required by the modern infrared search and tracking system. In this paper, an improved infrared small target detection and tracking method based on a new particle filter is proposed. This is where particles are used to represent an individual bat to imitate the hunting process of bats. By adjusting loudness, frequency, and impulse emissivity of a particle swarm, the optimal particle at that time is followed to search in the solution space. In addition, the global search and the local search can also be dynamically switched to improve the quality and distribution of the particle swarm. The performance of the proposed algorithm is tested in a simulation scene and the real scene of the infrared small target detection and tracking. Experimental results show that the proposed algorithm improves the performance of the infrared searching and tracking system.     

基于辅助粒子滤波的红外小目标检测前跟踪算法

研究低信噪比复杂环境下的红外小目标检测和跟踪问题,提出了基于辅助粒子滤波的检测前跟踪算法.首先使用形态学滤波算法对图像进行白化预处理;然后在跟踪阶段采用辅助粒子滤波算法估计目标运动状态,在检测阶段利用跟踪滤波器的输出构造似然比,并进行似然比检验.对真实红外图像序列的实验表明,该算法可成功跟踪和检测信噪比为2的小目标,且其性能优于传统的检测前跟踪算法.     

红外舰船目标的自适应鲁棒检测方法

针对背景杂乱的红外舰船目标检测问题,提出了一种红外舰船目标的自动检测新算法。该方法利用红外舰船图像中目标与背景在灰度直方图上的差异,通过对拟合直方图的多项式曲线参数鲁棒求解,进而求出舰船目标的分割阈值。然后,根据红外舰船目标亮度与图像平均亮度的关系等,对求得的阈值合理性进行判断。若该阈值不合理,则将其作为阈值初值,对红外舰船图像进行自适应局部递归分割。最后,结合红外舰船目标吃水线、天空与背景的边界特征等先验知识,对分割出的背景进行剔除。实验结果表明,该方法对强杂波干扰的红外舰船目标能实现可靠的检测,具有很好的适应性和鲁棒性。     

Dualband FLIR fusion for automatic target recognition

We investigate the potential benefits of fusing two bands of forward-looking infrared (FLIR) data for target detection and clutter rejection. We propose a similar set of neural-based clutter rejecters and target detectors, each of which consists of an eigenspace transformation and a simple multilayer perceptron. The same architecture is used to operate on either single band or dualband FLIR input images, so that the net effects of dualband fusion can be demonstrated. When the dualband inputs are used, the component bands are combined at either pixel or feature level, thus providing insight into methods of performing data fusion in this particular application. A large set of real FLIR images is used in two series of experiments, one for clutter rejection tasks and the other for target detection tasks. In both series, the results indicate that the dualband input images do improve the performance of the clutter rejecters and target detectors over their single band counterparts. On the other hand, results of the pixel and feature level fusions are quite similar, suggesting that dimensionality reduction by the eigenspace transformation can be performed independently on the two bands.     

基于区域目标检测的红外与可见光图像序列融合

提出了一种基于区域目标检测的红外与可见光图像序列融合方法。该方法通过目标检测技术将源图像序列分割成目标和背景区域,并在目标和背景区域里分别采用不同的融合规则,同时使用双树复小波变换方法使每一幅源图像具有移不变多分辨率表示。实验采用了实际图像序列数据。融合结果表明,该方法是可行和高效的,且比其他图像融合方法具有更好的性能。     

一种基于局部搜索采样的粒子滤波检测前跟踪算法

针对一类状态部分可测系统粒子滤波检测前跟踪算法中高维采样效率低的问题,提出一种基于局部搜索采样的粒子滤波器检测前跟踪算法.该算法在后验状态更新之后,在可测分量估计值的附近,对不可测分量引入先验分布信息,用少量粒子进行局部搜索采样,提高了粒子采样效率.仿真结果表明,所提出算法获得了更好的检测和跟踪性能.     

Pedestrian tracking for infrared image sequence based on trajectory manifold of spatio-temporal slice

The research of pedestrian tracking in infrared image sequences is a curial part of video surveillance. Considering the particular characteristics of the infrared image, such as low contrast, fuzzy edge and unknown noises interference, the study of infrared pedestrian tracking algorithm becomes a great challenge. Spatio-temporal slice method is effective due to considering both spatial and time scale. It can extract the trajectory of moving targets, reflecting the trajectory manifold variations of targets along the time, to provide ways to depict the regions of targets. However, traditional spatio-temporal based methods only consider the horizontal slice analysis and usually require a large amount of calculation time; this paper proposes a spatio-temporal tracking algorithm to infrared image sequences, using both horizontal and vertical multi-layer slices to obtain the integral trajectory manifold. The integral trajectory is analyzed to obtain the target boundary and position information, with which the target can be tracked in each frame. The experimental results show that the proposed method has a relatively high tracking accuracy with a fast computing speed. Moreover, it can perform effectively in different infrared image sequences with various motion modes by single pedestrian from OTCBVS/05 Terravic Motion IR Database.

     

A comparative case study of neural network training by using frame-level cost functions for automatic speech recognition purposes in Spanish

Training procedures of a deep neural network are still an area with ample research possibilities and constant improvement either to increase its efficiency or its time performance. One of the lesser-addressed components is its objective function, which is an underlying aspect to consider when there is the necessity to achieve better error rates in the area of automatic speech recognition. The aim of this paper is to present two new variations of the frame-level cost function for training a deep neural network with the purpose of obtaining superior word error rates in speech recognition applied to a case study in Spanish. The first proposed function is a fusion between the boosted cross-entropy and the so called cross-entropy/log-posterior-ratio. The main idea is to jointly emphasize the prediction of difficult/crucial frames provided by a boosting factor and at the same time enlarge the distance between the target senone and its closest competitor. The second proposal is a fusion between the non-uniform mapped cross-entropy and the cross-entropy/log-posterior-ratio. This function utilizes both the mapped function to enhance the frames that have ambiguity in their belonging to specific senones and the log-posterior-ratio with the purpose of separating the target senone against the most competing tied tri-phone state. The proposed approaches are compared against those frame-level cost functions discussed in the state of the art. This comparative has been made by using a personalized mid-vocabulary speaker-independent voice corpus. This dataset is employed for the recognition of digit strings and personal name lists in Spanish from the northern central part of México on a connected-words phone dialing task. A relative word error rate improvement of 15.14% and 12.30% is obtained with the two proposed approaches, respectively, against the plain well-established cross-entropy loss function.

     

MODEEP: a motion-based object detection and pose estimation method for airborne FLIR sequences

In this paper, we present a method called MODEEP (Motion-based Object DEtection and Estimation of Pose) to detect independently moving objects (IMOs) in forward-looking infrared (FLIR) image sequences taken from an airborne, moving platform. Ego-motion effects are removed through a robust multi-scale affine image registration process. Thereafter, areas with residual motion indicate potential object activity. These areas are detected, refined and selected using a Bayesian classifier. The resulting regions are clustered into pairs such that each pair represents one object's front and rear end. Using motion and scene knowledge, we estimate object pose and establish a region of interest (ROI) for each pair. Edge elements within each ROI are used to segment the convex cover containing the IMO. We show detailed results on real, complex, cluttered and noisy sequences. Moreover, we outline the integration of our fast and robust system into a comprehensive automatic target recognition (ATR) and action classification system.     

考虑导弹自动驾驶仪动态特性的带攻击角度约束制导律

针对打击机动目标时带攻击角度约束的制导问题,采用扩张状态观测器和动态面控制方法设计一种考虑自动驾驶仪动态特性的制导律.考虑期望视线角的变化率正比于未知的目标加速度,采用扩张状态观测器对未知目标加速度进行估计.为了避免奇异问题,并克服非匹配不确定项对系统性能的影响,采用非奇异终端滑模和动态面控制方法进行制导律设计.与传统的将目标加速度设为零的制导律相比较,仿真结果表明所提出的制导律具有良好的制导性能.     

基于边缘化粒子滤波的红外小目标检测跟踪

针对红外探测系统中单帧红外图像中低信噪比小目标检测问题,提出一种基于边缘化粒子滤波算法的检测前跟踪方法.该方法根据混合状态滤波的思想,直接利用原始图像数据,采用粒子数确定的持续概率密度函数和新生概率密度函数,推导出目标存在的概率.对没有出现在量测方程中的线性状态变量边缘化,用卡尔曼滤波器进行时间更新.实验结果证明,该方...     

An ant colony-based algorithm for integrated scheduling on batch machines with non-identical capacities

In this paper, a production–distribution scheduling problem with non-identical batch machines and multiple vehicles is considered. In the production stage, n jobs are grouped into batches, which are processed on m parallel non-identical batch machines. In the distribution stage, there are multiple vehicles with identical capacities to deliver jobs to customers after the jobs are processed. The objective is to minimize the total weighted tardiness of the jobs. Considering the NP-hardness of the studied problem, an algorithm based on ant colony optimization is presented. A new local optimization strategy called LOC is proposed to improve the local exploitation ability of the algorithm and further search the neighborhood solution to improve the quality of the solution. Moreover, two interval candidate lists are proposed to reduce the search for the feasible solution space and improve the search speed. Furthermore, three objective-oriented heuristics are developed to accelerate the convergence of the algorithm. To verify the performance of the proposed algorithm, extensive experiments are carried out. The experimental results demonstrate that the proposed algorithm can provide better solutions than the state-of-the-art algorithms within a reasonable time.

     

Physiologically motivated image fusion for object detection using apulse coupled neural network

This paper presents the first physiologically motivated pulse coupled neural network (PCNN)-based image fusion network for object detection. Primate vision processing principles, such as expectation driven filtering, state dependent modulation, temporal synchronization, and multiple processing paths are applied to create a physiologically motivated image fusion network. PCNN are used to fuse the results of several object detection techniques to improve object detection accuracy. Image processing techniques (wavelets, morphological, etc.) are used to extract target features and PCNN are used to focus attention by segmenting and fusing the information. The object detection property of the resulting image fusion network is demonstrated on mammograms and forward-looking infrared radar (FLIR) images. The network removed 94% of the false detections without removing any true detections in the FLIR images and removed 46% of the false detections while removing only 7% of the true detections in the mammograms. The model exceeded the accuracy obtained by any individual filtering methods or by logical ANDing the individual object detection technique results.     

基于Hopfield神经网络的FLIR图像分割

针对前视红外(FLIR)图像的分割,在基于模型的FLIR图像分割算法所提出的全 局准则函数及初始概率确定方法的基础上.建立了与之相对应的Hopfield网络的能量函数 及网络的初始状态,当网络运行达到稳定状态后,便可获得图像的分割结果.分析了能量函数 中,目标函数与约束条件的加权系数对分割结果的影响,并根据分割结果的非模糊性准则,提 出了一个确定加权系数的、简单有效的方法.给出了针对真实红外目标图像的分割结果.     

A developed system based on nature-inspired algorithms for DNA motif finding process

In this paper, recent algorithms are suggested to repair the issue of motif finding. The proposed algorithms are cuckoo search, modified cuckoo search and finally a hybrid of gravitational search and particle swarm optimization algorithm. Motif finding is the technique of handling expressive motifs successfully in huge DNA sequences. DNA motif finding is important because it acts as a significant function in understanding the approach of gene regulation. Recent results of existing motifs finding programs display low accuracy and can not be used to find motifs in different types of datasets. Practical tests are implemented first on synthetic datasets and then on benchmark real datasets that are based on nature-inspired algorithms. The results revealed that the hybridization of gravitational search algorithm and particle swarm algorithms provides higher precision and recall values and provides average enhancement of F-score up to 0.24, compared to other existing algorithms and tools, and also that cuckoo search and modified cuckoo search have been able to successfully locate motifs in DNA sequences.