A Camera that Works Like the Human Eye

An innovative camera system could enhance security in public areas and buildings. Smart Eyes works just like the human eye. The system analyzes the recorded data in real time and then immediately flags salient features and unusual scenes.

"Goal, goal, goal!" fans in the stadium are absolutely ecstatic, the uproar is enormous. So it's hardly surprising that the security personnel fail to spot a brawl going on between a few spectators. Separating jubilant fans from scuffling hooligans is virtually impossible in such a situation. Special security cameras that immediately spot anything untoward and identify anything out of the ordinary could provide a solution.

Researchers from the Fraunhofer Institute for Applied Information Technology FIT in Sankt Augustin have now developed such a device as part of the EU project "SEARISE - Smart Eyes: Attending and Recognizing Instances of Salient Events". The automatic camera system is designed to replicate human-like capabilities in identifying and processing moving images.

Like the human eye, it can, for instance, distinguish objects when observing a scene, even if the objects are moving in front of a very turbulent background. The Smart Eyes system analyzes the video data in real time and immediately points out salient features. "That is invaluable for video surveillance of public buildings or places," said Dr. Martina Kolesnik, research scientist at the FIT. "In certain circumstances the capabilities of a human observer are limited. Ask someone to keep an eye on a certain stand in a football stadium and they are bound to miss many details. That same person can only carefully monitor certain sections of the whole area and will quickly get tired. That's where Smart Eyes clearly comes into its own."

The system hardware consists of a fixed surveillance camera which covers a certain area, and two ultra-active stereo cameras. Like human eyes, these can fix on and follow various points very quickly in succession, but also zoom in on details. At the heart of Smart Eyes is innovative software that automatically analyzes the image sequences. It replicates key strategies of the human eye and brain. Taking its lead from the flow of visual images in the brain, the software has a hierarchical, modular structure. It initially ascertains the degree of movement for each pixel, thus identifying the particular active areas in the scene. From this it learns motion patterns and stores them as typical models.

On the basis of these models the system then identifies events and classifies them: for instance the software can distinguish between passive spectators and fans jumping up and down. Image patterns such as empty seats or steps are also identified. The application picks out salient events and focuses on these using the active stereo cameras. Depending on the priorities set by the security experts, various events are designated as salient. The program can, where necessary, filter out objects such as flags being waved to focus specifically on other salient events, for instance a person on the edge of the pitch. "Our image analysis software is compatible with camera systems produced by all vendors. It can be installed easily. The user doesn't have to make any adjustments," said the researcher.

Featured

  • Progressing in Capabilities

    Progressing in Capabilities

    Hazardous areas within industries like oil and gas, manufacturing, agriculture and the like, have long-sought reliable video surveillance cameras and equipment that can operate safely in these harsh and unpredictable environments. Read Now

  • A Comprehensive Nationwide Solution

    A Comprehensive Nationwide Solution

    Across the United States, manufacturing facilities, distribution centers, truck yards, parking lots and car dealerships all have a common concern. They are targets for catalytic converters. In nearly every region, cases of catalytic converter thefts have skyrocketed. Read Now

  • Planning for Your Perimeter

    Planning for Your Perimeter

    The perimeter is an organization’s first line of defense and a critical element of any security and surveillance program. Even if a building’s interior or exterior security is strong, without a solid perimeter surveillance approach any company or business is vulnerable. Read Now

  • The Key Issue

    The Key Issue

    It is February 2014. A woman is getting ready in her room on a cruise ship when she hears a knock on the door; it is a crewmember delivering breakfast. She is not presentable so she tells him to leave it by the door. Read Now

Featured Cybersecurity

New Products

  • Genetec Security Center

    Genetec Security Center

    This major new release allows more system components to run in the cloud, reducing the gap between cloud and on-premises security systems. It also makes it easier to connect external systems and tap external data for use in dashboards, maps and investigations without relying on complex, specialized integrations. 3

  • VideoEdge 2U High Capacity Network Video Recorder

    VideoEdge 2U High Capacity Network Video Recorder

    Johnson Controls announces a powerful recording solution to meet demanding requirements with its VideoEdge 2U High Capacity Network Video Recorder. This solution combines the powerful capabilities of victor with the intelligence of VideoEdge NVRs, fueled by Tyco Artificial Intelligence, for video management that provides actionable insights to save time, money and lives. 3

  • Connect ONE’s powerful cloud-hosted management platform provides the means to tailor lockdowns and emergency mass notifications throughout a facility – while simultaneously alerting occupants to hazards or next steps, like evacuation.

    Connect ONE®

    Connect ONE’s powerful cloud-hosted management platform provides the means to tailor lockdowns and emergency mass notifications throughout a facility – while simultaneously alerting occupants to hazards or next steps, like evacuation. 3