Hardware Implementation and Evaluation of Real-Time Wireless Video Tracking System
Hongsheng Zhang
Imaging, Robotics, and Intelligent Systems Laboratory
The University of Tennessee
[Motivation] [Research Objectives] [Technical Approach] [Results] [Publications]



Motivation:


Figure 1. Block Diagram of Real Time Video Tracking System

It is now well accepted that vision will play a major role in both supervised and unsupervised operations for the automation of several security activities. The purpose of video tracking is to stabilize the line-of-sight (LOS) of a camera to the actual LOS of a moving target, such as a moving human. Video tracking, by definition, is to track the moving objects by some typical features, and monitor their activities by image sequence taken the video cameras. By video tracking, we can answer some questions such as who are they, what are they doing, and where and when they are acting. Video tracking system can be used in many areas such as airport, embassies, battlefield, robots controlling and even in classroom or living room. For an example, the video tracking system can be installed in airport to collect the pictures of people entering and exiting the building so that suspected terrorist can be found in the airport before he aboard the plain. Real-time information from the battlefield can improve the situational awareness of commanders and stuff. In remote education, camera can track the face of the instructor. For robots industries, real-time video tracking system can send command to robots to perform some tough tasks.

Objectives:

We made a plan for a wireless, pan-tilt-zoom (PTZ) camera-based video surveillance system.  The goal of this work is to realize a prototype of video surveillance system, which can provide the high-end video tracking functions based on a mobile server platform.  The above mentioned video tracking functions include; (i) flexible camera position by wireless video and data transmission, (ii) wide range of search areas by multiple PTZ cameras, (iii) extracting a suspicious person out of complicated background, such as crowd of multiple people and non-stationary background, and (iv) dynamic analysis of the trajectory of a suspicious person by the inter-camera object handover technique.

Technical Approach:

This system consists of several modules as shown in Figure 1. The first module is image acquisition module. This function is completed by PTZ camera. The next stage is digitization. Since computer deals with digital signal, the NTSC video signal has to be digitized before they are input to the computer. The digitized image will be input to computer for image processing. The Image processing module includes three sub-modules such as Background Generation module, Segmentation module and Tracking module. The main algorithm of this system will be completed in these three modules. Some background information taken by PTZ camera is stored in the Background Generation module. Then the difference between the input image and the background image is computed to detect the moving image. This method is known as background subtraction. The moving image is segmented by Segmentation module. Only segmented image will be send to tracking module. This decrease the data amount, thus save computational time. Tracking module will detect the position and size of the object. It will generate a command sending to computer through communication port such as RS485 data communication port. Then camera can move according to the command to track the object automatically. Figure 2 shows the hardware component of the system. The camera control software is written in Visual C++ with Panasonic command protocol.

Figure 2. Hardware block diagram of wireless video tracking system.

Results:

The software is implemented in Visual C++. It can control the function of the camera such as panning, tilting zooming and focusing; it can also control ALC, AGC, Shutter speed, White balance, Sensitivity, and etc. A system with single camera was setup and tested. The result shows that the system work well with wired connection. The cable length will affect the performance of the system. For cable length less than 200 feet, the whole system works well. There is some delay as cable become longer. For wireless communication, the effect communication distance for video is about 50 feet, and for control data is about 70 feet. There exist some problems. But theses problems are related to the performance of the wireless transmitter and receiver. We truly believe if we use better wireless equipment, these problems can be solved. A camera mounting system is designed for the system. With this mounting system, the whole system can be easily move around and is stable for various environments.

Publications:

No publications currently available for this project.

This research is being conducted at the IRIS Lab by Hongsheng Zhang under the supervision of Dr. Mongi A. Abidi.




Last updated:
Webmaster