Creating a clickable TV program by sketching and tracking freeform triggers

Viewers watching Interactive TV can click on video objects on the screen, connecting them to an advertisement or more detailed content. But this requires an interactive authoring process to attach triggers to clickable objects, which is time-consuming because these objects can appear intermittently, move, and change shape. We facilitate authoring by combining a sketching interface with shot-based object tracking and trigger verification. Experiments involving professional video authors and non-specialist viewers suggest that this approach is an improvement on previous methods.