Augmenting reality by using uncalibrated optical tracking

The paper describes the use of an optical tracking method for superimposing computer-generated images oriented and positioned in 3D to augment a real scene. In a medical scenario, a physician may view the images created by an ultrasound device directly related to the patient. Typically, the position of the images or the position of the physician changes almost always and the mapping of images has to be recalculated. The optical tracking method in combination with artificial landmarks, is used to get the information about how to transform the superimposed images After segmenting and tracking the landmarks the perspective transformation of the ultrasonic image can be determined.