Managing Latency in Complex Augmented Reality SystemsMarco C. Jacobs, Mark A. Livingston, Andrei State |
Versions of the paper available:
Download the original TIFF image. Plate 1. AR registration problems resulting from relative latency. Left: AR view of a mannequin from a moving camera. The wireframe model lags behind due to relative latency in the magnetic tracker compared to the camera video. Center: AR view of a moving ultrasound probe. The wireframe model of the probe and the probes ultrasound image data field lag behind the real world video due to the relative latency in the mechanical tracker compared to the camera video. Right: AR view of a volume of ultrasound data. Note how the needle trace in the volume (green arrows) curves due to the relative latency between the ultrasound image data and the mechanical tracker. |
Download the original TIFF image. Plate 2. Rotating drum used to measure relative latency in the ultrasound image data (black rectangular frame) compared to the camera video (background). Despite correct static spatial registration (left), the framed image lags behind as we spin the drum (center). We compute the latency from the measured rotational velocity and a known angular distance (right). |
Download the original TIFF image. Plate 3. Left: Verifying the accuracy of temporal interpolation for the mechanical tracker by performing a zig-zag ultrasound sweep of a cylinder in a water tank. Center: The reconstructed cylinder undulates due to the relative latency between the ultrasound image data and the mechanical tracker. Right: A sweep using the measured relative latency yields a straight cylinder in the volume data. |
Download the original TIFF image. Plate 4. Left: AR view of mannequin from a moving camera. Vision-based tracking eliminates relative latency and temporal registration error; cf. Plate 1, left. Center: AR view of the moving ultrasound probe. Predictive tracking of the mechanical tracker reduces the effect of relative latency and temporal registration error; cf. Plate 1, center. Right: Applying the relative latency measurement makes the ultrasound data lag behind the video image of the probe, but aligns the ultrasound data with the inside of the breast. |
This work is part of the UNC Ultrasound Visualization project.
Last Modified: 29 Jul 97 by Mark A. Livingston.
Mail Andrei State for more info