Adaptive visual target detection and tracking using weakly supervised incremental appearance learning and RGM-PHD tracker

Multiple visual target tracking is a challenging problem due to various uncertainties including occlusion, miss-detection and noisy measurement. Most tracking approaches utilize an object-specific detector, pre-trained on many labeled images, to provide suitable measurements for their tracking system. In this paper, we use a simple background subtraction detector which only needs the background image to localize targets independent of their shape or type. In order to cope with the uncertainties resulted by the detector, we propose an adaptive appearance model and develop an incremental appearance learning algorithm to learn the target appearances in time. The proposed method employs the background information and our defined keypoints’ miss-matched history to adapt the target appearances within different frames. Furthermore, we combine Refined Gaussian Mixture Probability Hypothesis Density (RGM-PHD) tracker with the detectors to keep target trajectories and handle uncertainties. The experiments conducted on several video datasets show the effectiveness of our proposed method.