Proceedings Article | 25 February 2008
KEYWORDS: Stereoscopic cameras, 3D image processing, Optical tracking, Cameras, 3D vision, Imaging systems, Visualization, Data modeling, Digital signal processing, Light sources and illumination
Physical security increasingly involves sophisticated, real-time visual tracking of a person's location inside a given
environment, often in conjunction with biometrics and other security-related technologies. However, demanding real-world
conditions like crowded rooms, changes in lighting and physical obstructions have proved incredibly challenging
for 2D computer vision technology. In contrast, 3D imaging technology is not affected by constant changes in lighting
and apparent color, and thus allows tracking accuracy to be maintained in dynamically lit environments. In addition,
person tracking with a 3D stereo camera can provide the location and movement of each individual very precisely, even
in a very crowded environment. 3D vision only requires that the subject be partially visible to a single stereo camera to
be correctly tracked; multiple cameras are used to extend the system's operational footprint, and to contend with heavy
occlusion.
A successful person tracking system, must not only perform visual analysis robustly, but also be small, cheap and
consume relatively little power. The TYZX Embedded 3D Vision systems are perfectly suited to provide the low power,
small footprint, and low cost points required by these types of volume applications. Several security-focused
organizations, including the U.S Government, have deployed TYZX 3D stereo vision systems in security applications.
3D image data is also advantageous in the related application area of gesture tracking. Visual (uninstrumented) tracking
of natural hand gestures and movement provides new opportunities for interactive control including: video gaming,
location based entertainment, and interactive displays. 2D images have been used to extract the location of hands within
a plane, but 3D hand location enables a much broader range of interactive applications.
In this paper, we provide some background on the TYZX smart stereo cameras platform, describe the person tracking
and gesture tracking systems implemented on this platform, and discuss some deployed applications.
