Smart Camera Keeps Eye on Crowd

Thursday, October 14, 2010 @ 09:10 AM gHale


A new Smart Eye camera system could some day soon enhance security in public areas and buildings. The system analyzes the recorded data in real time and then immediately flags up salient features and unusual scenes.
As the home team scores a goal on the playing field, fans in the stadium go crazy cheering. So it‘s hardly surprising security personnel fail to spot a brawl going on between a few spectators.

A new Smart Eye camera system could soon enhance security in public spaces.

A new Smart Eye camera system could soon enhance security in public spaces.

Separating jubilant fans from fighting thugs is virtually impossible in such a situation. Special surveillance cameras that immediately spot anything untoward and identify anything out of the ordinary could provide a solution. Researchers from the Fraunhofer Institute for Applied Information Technology FIT in Sankt Augustin, Germany, now developed such a device as part of the EU project “SEARISE – Smart Eyes: Attending and Recognizing Instances of Salient Events.” The automatic camera system takes on human-like capabilities in identifying and processing moving images.
Like the human eye, it can, for instance, distinguish objects when observing a scene, even if the objects are moving in front of a very turbulent background.
The Smart Eyes system analyzes the video data in real time and immediately points out salient features. “That is invaluable for video surveillance of public buildings or places,” Dr. Martina Kolesnik, research scientist at the FIT. “In certain circumstances the capabilities of a human observer are limited. Ask someone to keep an eye on a certain stand in a football stadium and they are bound to miss many details. That same person can only carefully monitor certain sections of the whole area and will quickly get tired. That‘s where Smart Eyes clearly comes into its own.”
The system hardware consists of a fixed surveillance camera which covers a certain area, and two ultra-active stereo cameras. Like human eyes, these can fix on and follow various points very quickly in succession, but also zoom in on details.
At the heart of Smart Eyes is software that automatically analyzes the image sequences. It replicates key strategies of the human eye and brain. Taking its lead from the flow of visual images in the brain, the software has a hierarchical, modular structure.
It initially ascertains the degree of movement for each pixel, thus identifying the particular active areas in the scene. From this it learns motion patterns and stores them as typical models. On the basis of these models the system then identifies events and classifies them: For instance the software can distinguish between passive spectators and fans jumping up and down. The system is also able to identify image patterns such as empty seats or steps.
The application picks out salient events and focuses on these using the active stereo cameras. The program can, where necessary, filter out objects such as waiving flags to focus specifically on other salient events, for instance a person on the edge of the pitch.
“Our image analysis software is compatible with camera systems produced by all vendors. It can be installed easily. The user doesn‘t have to make any adjustments,” Kolesnik said.



One Response to “Smart Camera Keeps Eye on Crowd”


Leave a Reply

You must be logged in to post a comment.