Lasso约束下融和光流信息的DCF目标跟踪算法

视频目标跟踪是计算机视觉的基础问题之一。近来由于 discriminative correlation filter（DCF）跟踪器的高效性和鲁棒性,出现了许多基于DCF的目标跟踪算法。为了克服DCF跟踪器对运动模糊目标的不适应性,本文提出了一种利用Lasso约束并融入光流信息的目标跟踪算法。首先在跟踪器抽取特征通道块中融入光流特征。然后在通道块之后进行多特征融合。其次利用Lasso约束DCF跟踪器的目标函数。考虑到所约束的目标函数在定义域上不连续和目标跟踪的优化效率。最后,采用块坐标下降算法来优化所约束的目标函数。实验结果表明,与基于DCF视觉跟踪算法相比,所提出的算法可以有效的处理运动模糊目标,实现复杂环境下鲁棒的视觉目标跟踪。      

基于区域卷积神经网络和光流法的目标跟踪

为解决基于深度学习的在线目标跟踪算法速度慢的问题,设计并实现了一种基于区域卷积网络和光流法相结合的目标跟踪算法。该算法在T-1帧跟踪结果的基础上使用光流法计算跟踪目标的运动矢量计算出跟踪目标在T帧上的初选框,再将初选框区域作为区域卷积网络的输入,计算目标的精确跟踪结果。通过实验分析对比,算法对目标运动速度和形变具有很好的鲁棒性,并且跟踪速度可以达到50 frame/s。相较于在线跟踪算法,所提方法在满足较高的跟踪准确率的基础上大大提升了目标跟踪算法的速度。     

基于关键特征信息感知和在线自适应掩模的孪生网络目标跟踪

近年来,孪生网络在视觉目标跟踪的应用给跟踪器性能带来了极大的提升,可以同时兼顾准确率和实时性。然而,孪生网络跟踪器的准确率在很大程度上受到限制。为了解决上述问题,该文基于通道注意力机制,创新地提出了关键特征信息感知模块来增强网络模型的判别能力,使网络聚焦于目标的卷积特征变化;在此基础上,该文还提出了一种在线自适应掩模策略,根据在线学习到的互相关层输出状态,自适应掩模后续帧,以此来突出前景目标。在OTB100, GOT-10k数据集上进行实验验证,所提跟踪器在不影响实时性的前提下,准确率相较于基准有了显著提升,并且在遮挡、尺度变化以及背景杂乱等复杂场景下具有鲁棒的跟踪效果。     

融合检测技术的孪生网络跟踪算法综述

近年来,基于孪生网络的方法在视觉目标跟踪中取得了巨大的进步,但是这类方法在处理跟踪中的目标状态估计以及复杂场景干扰中仍存在较大的提升空间。随着深度学习在目标检测领域取得的成功,越来越多的研究将其成果用于指导目标跟踪技术的发展。对融合检测技术的孪生目标跟踪算法进行了综述。首先介绍检测和跟踪的联系与区别,同时分析检测技术对改进基于孪生网络的跟踪算法的可行性;然后阐述在不同检测框架指导下的孪生目标跟踪算法,以及使用OTB100、VOT2018、GOT-10k和LaSOT公开数据集对各类算法进行对比和分析;最后对全文进行总结,并对目标跟踪的未来发展方向进行展望。     

视觉跟踪技术中孪生网络的研究进展

在计算机视觉领域中,基于孪生网络的跟踪算法相比于传统算法提高了精度和速度,但是仍会受到目标遮挡、变形、环境变化等影响,导致孪生网络的跟踪算法的性能降低。为了深入了解基于孪生网络的单目标跟踪算法,本文对现有基于孪生网络目标跟踪算法进行了总结和分析,主要包括在孪生网络中引入注意力机制方法、超参数推理方法和模板更新方法,对这3种方法的目标跟踪算法进行了综述,详细介绍了国内外近几年基于孪生网络的算法研究和发展现状。对3个方面的代表算法采用VOT2016、VOT2017、VOT2018和OTB-2015数据集进行实验对比,获得了多种基于孪生网络的目标跟踪算法的性能。最后对基于孪生网络的目标跟踪算法进行了总结,并对未来的发展方向进行了展望。     

基于残差网络运动场景分类的目标跟踪算法

在目标跟踪中,目标本身容易发生变化,且目标的运动场景是复杂多样的,而不同网络训练的跟踪模型在跟踪同一场景的目标性能会有较大差异,进而使很多算法的跟踪效果不太理想.针对这一问题,文章提出了一种基于目标运动场景分类的目标跟踪方法,解决了单一模型在应对目标处于不同复杂场景中性能不稳定的问题.该算法利用残差网络对目标运动场景进...     

基于增强RPN的孪生网络目标跟踪算法

目前孪生网络跟踪器已经具有比较良好的表现,但是对于卷积神经网络所提取的特征仍没有较好地利用其特点,同时孪生网络通过相似性学习进行跟踪的特性使跟踪器的准确性和鲁棒性存在不足。提出了一种金字塔式特征融合的方法,根据骨干网络特征提取层不同深度具有不同侧重的特点提高网络对目标的表征能力,然后使用注意力机制对区域推荐网络（Region Proposal Network,RPN）进行增强,最终实现更精准更鲁棒的跟踪。在OTB100数据集的实验中,新提出的SiamERPN(Siamese Enhanced RPN)算法分别得到了0.668的成功率和0.876的精度,测试结果好于基线算法和其他对比算法。     

复杂背景下多信息融合的粒子滤波跟踪算法

将颜色和运动这两种信息融合进粒子滤波跟踪器,并提出分层抽样的方法,克服了利用单一信源所带来的跟踪不稳定问题;与典型的基于边缘特征或仅基于颜色信息的粒子滤波器相比,计算简单,并能够有效解决由于目标形状或颜色模糊而产生的跟踪困难问题.实验结果表明,该粒子滤波融合算法在复杂背景下能够稳健可靠的跟踪目标.     

复杂地面场景下的红外运动目标跟踪

复杂地面场景下的红外目标易受背景影响并经常出现遮挡情况,难以简单地依靠亮度或梯度信息检测并跟踪目标。根据复杂背景下红外运动目标与背景的速度场差异,提出了利用光流对目标进行跟踪的算法。首先对图像进行配准,保证在随动跟踪时背景的相对静止;然后在目标的跟踪波门内计算改进的Horn-Schunck 光流;最后根据目标的光流特征,优化粒子滤波算法中粒子的转移概率,实现对目标的稳健跟踪。实验结果表明,该跟踪算法能对复杂地面场景下的红外运动目标持续跟踪,并不受目标被短时遮挡的影响。     

基于KL散度与通道选择的热红外目标跟踪算法

为了解决单一跟踪器无法有效应对复杂背景及目标外观的显著变化,对于热红外目标跟踪准确度不高的问题,基于全卷积孪生网络提出了一种多响应图集成的跟踪算法用于热红外跟踪。首先,使用预训练的卷积神经网络来提取热红外目标的多个卷积层的特征并进行通道选择,在此基础上分别构建3个对应的跟踪器,每个跟踪器独立执行跟踪并返回一个响应图。然后,利用Kullback–Leibler（KL）散度对多个响应图进行优化集成,得到一个更强的响应图。最后利用集成后的响应图来确定目标位置。为了评估所提算法的性能,在当前最全面的热红外跟踪基准LSOTB-TIR（Large-Scale Thermal Infrared Object Tracking Benchmark）上进行了实验。实验结果表明,所提算法能够适应复杂多样的红外跟踪场景,综合性能超过了现有的红外跟踪算法。     

SiamMBFAN: Siamese tracker with multi-branch feature aggregation network

Siamese trackers have attracted considerable attention in the field of object tracking because of their high precision and speed. However, one of the main disadvantages of Siamese trackers is that their feature extraction network is relatively single. They often use AlexNet or ResNet50 as the backbone network. AlexNet is shallow and thus cannot easily extract abundant semantic information, whereas ResNet50 has many convolutional layers, reducing the real-time performance of Siamese trackers. We propose a multi-branch feature aggregation network with different designs in the shallow and deep convolutional layers. We use the residual module to build the shallow convolutional layers to extract textural and edge features. The deep convolution layers, designed with two independent branches, are built with residual and parallel modules to extract different semantic features. The proposed network has a depth of only nine modules, and thus it is a simple and effective network. We then apply the network to a Siamese tracker to form SiamMBFAN. We design multi-layer classification and regression subnetworks in the Siamese tracker by aggregating the last three modules of the two branches, improving the localization ability of the tracker. Our tracker achieves a better balance between performance and speed. Finally, SiamMBFAN is tested on four challenging benchmarks, including OTB100, VOT2016, VOT2018, and UAV123. Compared with other trackers, our tracker improves by 7% (OTB100).     

DSiamMFT: An RGB-T fusion tracking method via dynamic Siamese networks using multi-layer feature fusion

The task of object tracking is very important since its various applications. However, most object tracking methods are based on visible images, which may fail when visible images are unreliable, for example when the illumination conditions are poor. To address this issue, in this paper a fusion tracking method which combines information from RGB and thermal infrared images (RGB-T) is presented based on the fact that infrared images reveal thermal radiation of objects thus providing complementary features. Particularly, a fusion tracking method based on dynamic Siamese networks with multi-layer fusion, termed as DSiamMFT, is proposed. Visible and infrared images are firstly processed by two dynamic Siamese Networks, namely visible and infrared network, respectively. Then, multi-layer feature fusion is performed to adaptively integrate multi-level deep features between visible and infrared networks. Response maps produced from different fused layer features are then combined through an elementwise fusion approach to produce the final response map, based on which the target can be located. Extensive experiments on large datasets with various challenging scenarios have been conducted. The results demonstrate that the proposed method shows very competitive performance against the-state-of-art RGB-T trackers. The proposed approach also improves tracking performance significantly compared to methods based on images of single modality.     

TRBACF: Learning temporal regularized correlation filters for high performance online visual object tracking

Correlation filter-based trackers (CFTs) have recently shown remarkable performance in the field of visual object tracking. The advantage of these trackers originates from their ability to convert time-domain calculations into frequency domain calculations. However, a significant problem of these CFTs is that the model is insufficiently robust when the tracking scenarios are too complicated, meaning that the ideal tracking performance cannot be acquired. Recent work has attempted to resolve this problem by reducing the boundary effects from modeling the foreground and background of the object target effectively (e.g., CFLB, BACF, and CACF). Although these methods have demonstrated reasonable performance, they are often affected by occlusion, deformation, scale variation, and other challenging scenes. In this study, considering the relationship between the current frame and the previous frame of a moving object target in a time series, we propose a temporal regularization strategy to improve the BACF tracker (denoted as TRBACF), a typical representative of the aforementioned trackers. The TRBACF tracker can efficiently adjust the model to adapt the change of the tracking scenes, thereby enhancing its robustness and accuracy. Moreover, the objective function of our TRBACF tracker can be solved by an improved alternating direction method of multipliers, which can speed up the calculation in the Fourier domain. Extensive experimental results demonstrate that the proposed TRBACF tracker achieves competitive tracking performance compared with state-of-the-art trackers.     

ACSiam: Asymmetric convolution structures for visual tracking with Siamese network

Object trackers based on Siamese network usually transform the tracking task into a matching problem between the candidate samples and the target template. However, with the increasing depth and width of backbone networks, researches on Siamese trackers using backbone networks are not very advanced. Therefore, it is necessary for us to further investigate the characteristics of backbone network. As a fact, the ability of backbone network to extract features can directly determine the performance of object tracker. Given this, in this paper, we first propose an asymmetric convolutional network to improve the representational capability of backbone network. And then, the strip convolution is employed to enhance the operational capability of square kernel convolution in the backbone network. Besides, we also construct a novel module named Feature Dropblock (i.e., FD) to simulate the occlusion of hidden space, which goal is to improve the performance of backbone network in the target tracking under occlusion. To demonstrate the effectiveness of the proposed tracker, extensive ablation studies are conducted. Better results are obtained on the tracking benchmarks OTB100 and VOT2018, compared to other state-of-the-art trackers.     

Siamese visual tracking with multilayer feature fusion and corner distance IoU loss

The tracker based on the Siamese network regards tracking tasks as solving a similarity problem between the target template and search area. Using shallow networks and offline training, these trackers perform well in simple scenarios. However, due to the lack of semantic information, they have difficulty meeting the accuracy requirements of the task when faced with complex backgrounds and other challenging scenarios. In response to this problem, we propose a new model, which uses the improved ResNet-22 network to extract deep features with more semantic information. Multilayer feature fusion is used to obtain a high-quality score map to reduce the influence of interference factors in the complex background on the tracker. In addition, we propose a more powerful Corner Distance IoU (intersection over union) loss function so that the algorithm can better regression to the bounding box. In the experiments, the tracker was extensively evaluated on the object tracking benchmark data sets, OTB2013 and OTB2015, and the visual object tracking data sets, VOT2016 and VOT2017, and achieved competitive performance, proving the effectiveness of this method.     

Learning complementary Siamese networks for real-time high-performance visual tracking

Recently, Siamese based methods have made a breakthrough in the visual tracking field. However, the existing trackers still cannot take full advantage of the deep features. In this work, we improve the performances of Siamese trackers by complementary learning with different types of matching features. Specifically, a Matching Activation Network (MAN) is firstly designed to highlight the matching regions of the search image given a template. Since only sparse parts of feature maps contribute to the matching result, an important design choice is to emphasize the weak-matching features by erasing the strong-matching ones and learn complementary classifiers from both types of features. Then we propose a novel complementary region proposal network (CoRPN) to take complementary features as inputs and their outputs complement to each other, which are fused to improve the performance. Experiments show that our proposed tracker achieves leading performances on five tracking datasets while retaining real-time speed.     

基于孪生神经网络的两阶段目标跟踪方法

深度学习技术使目标跟踪的精度和鲁棒性得到了很大提高,基于孪生网络的跟踪方法通过在大规模数据集上进行训练,使模型能应对目标的各种形变,缺点是无法排除相似目标的干扰。为此,提出了一种基于孪生网络的两阶段目标跟踪方法。首先,采用修改后的残差网络提取性能更优的深度特征。区域建议网络通过相关滤波调制自适应更新模板,结合时域信息过滤掉易区分的负样本;然后,通过感兴趣池化层提取候选区域固定尺度的特征,并馈送到验证网络进行更精细的分类与回归。为了提升网络对高难度样本的区分能力,采用正负样本对联合训练的方式提高特征匹配的性能。在OTB100、VOT标准测试集和UAV123无人机航拍数据集上进行了评测,实验结果表明:所提方法能明显改进基准算法的性能。     

L2范数正则化鲁棒编码视觉跟踪

针对基于稀疏表示的视觉跟踪计算效率低和易于产生模型漂移的不足,该文提出一种基于L2范数正则化鲁棒编码的视觉跟踪方法。该方法利用L2范数正则化鲁棒编码求解候选目标的编码系数,以粒子滤波为框架,利用候选目标的加权重建误差建立似然模型跟踪目标。为了适应目标的变化并克服模型漂移问题,利用L2范数正则化鲁棒编码估计当前目标的加权矩阵用于遮挡检测,根据遮挡检测结果实现模型更新。对提出的跟踪方法进行实验的结果表明:与现有跟踪方法相比,该方法具有较优的跟踪性能。     

Tracking by dynamic template: Dual update mechanism

Recently, Siamese trackers have received widespread attention for visual object tracking owing to their good balance between speed and performance. Those Siamese trackers heavily depend on target template while conventional practice fixes the template to initial frame. This strategy makes it unable to cope with variation of target appearance, which often leads to tracking failures and causes the gap in performance from other tracking methods. Despite the performance gain achieved by few template update methods with target templates generated by the tracked results, these tracked templates are easy to accumulate errors and cause tracking drift. In this paper, we propose two template update mechanisms to effectively adapt the target template during the tracking process which is dubbed as DTDU (Dynamic Template with Dual Update). Unlike predecessors that directly use the tracked template, we use initial template to perform similar transformation to the tracked template. Then the similar transformed template and the tracked template are combined linearly to capture the variation of target appearance. These updated templates are stored in a memory bank and retrieved to generate the final target template. In order to enhance quick update of memory bank to accommodate the target appearance, we use the retrieved template to further update the templates in memory bank for subsequent tracking. Extensive experiments on OTB-2015, VOT2016, VOT2018 and GOT-10k datasets have proved the effectiveness of these two update mechanisms and the proposed tracker achieves a real-time speed of 44 fps.