Drift-correcting template update strategy for precision feature point tracking

In this paper we present a drift-correcting template update strategy for precisely tracking a feature point in 2D image sequences. The proposed strategy greatly complements one of the latest published template update strategies by incorporating a robust non-rigid image registration step. Previous strategies use the first template to correct drifts in the current template; however, the drift still builds up when the first template becomes different from the current one particularly in a long image sequence. In our strategy the first template is updated timely when it is revealed to be quite different from the current template and henceforth the updated first template is used to correct template drifts in subsequent frames. Our method runs fast on a 3.0 GHz desktop PC, using about 0.03 s on average to track a feature point in a frame (under the assumption of a general affine transformation model, 61 × 61 pixels in template size) and less than 0.1 s to update the first template. The proposed template update strategy can be implemented either serially or in parallel. Quantitative evaluation results show the proposed method in precision tracking of a distinctive feature point whose appearance is constantly changing. Qualitative evaluation results show that the proposed method has a more sustained ability to track a feature point than two previous template update strategies. We also revealed the limitations of the proposed template update strategy by tracking feature points on a human’s face.