A Camera that Works Like the Human Eye

An innovative camera system could enhance security in public areas and buildings. Smart Eyes works just like the human eye. The system analyzes the recorded data in real time and then immediately flags salient features and unusual scenes.

"Goal, goal, goal!" fans in the stadium are absolutely ecstatic, the uproar is enormous. So it's hardly surprising that the security personnel fail to spot a brawl going on between a few spectators. Separating jubilant fans from scuffling hooligans is virtually impossible in such a situation. Special security cameras that immediately spot anything untoward and identify anything out of the ordinary could provide a solution.

Researchers from the Fraunhofer Institute for Applied Information Technology FIT in Sankt Augustin have now developed such a device as part of the EU project "SEARISE - Smart Eyes: Attending and Recognizing Instances of Salient Events". The automatic camera system is designed to replicate human-like capabilities in identifying and processing moving images.

Like the human eye, it can, for instance, distinguish objects when observing a scene, even if the objects are moving in front of a very turbulent background. The Smart Eyes system analyzes the video data in real time and immediately points out salient features. "That is invaluable for video surveillance of public buildings or places," said Dr. Martina Kolesnik, research scientist at the FIT. "In certain circumstances the capabilities of a human observer are limited. Ask someone to keep an eye on a certain stand in a football stadium and they are bound to miss many details. That same person can only carefully monitor certain sections of the whole area and will quickly get tired. That's where Smart Eyes clearly comes into its own."

The system hardware consists of a fixed surveillance camera which covers a certain area, and two ultra-active stereo cameras. Like human eyes, these can fix on and follow various points very quickly in succession, but also zoom in on details. At the heart of Smart Eyes is innovative software that automatically analyzes the image sequences. It replicates key strategies of the human eye and brain. Taking its lead from the flow of visual images in the brain, the software has a hierarchical, modular structure. It initially ascertains the degree of movement for each pixel, thus identifying the particular active areas in the scene. From this it learns motion patterns and stores them as typical models.

On the basis of these models the system then identifies events and classifies them: for instance the software can distinguish between passive spectators and fans jumping up and down. Image patterns such as empty seats or steps are also identified. The application picks out salient events and focuses on these using the active stereo cameras. Depending on the priorities set by the security experts, various events are designated as salient. The program can, where necessary, filter out objects such as flags being waved to focus specifically on other salient events, for instance a person on the edge of the pitch. "Our image analysis software is compatible with camera systems produced by all vendors. It can be installed easily. The user doesn't have to make any adjustments," said the researcher.

Featured

  • 12 Commercial Crime Sites to Do Your Research

    12 Commercial Crime Sites to Do Your Research

    Understanding crime statistics in your industry and area is crucial for making important decisions about your security budget. With so much information out there, how can you know which statistics to trust? Read Now

  • Boosting Safety and Efficiency

    Boosting Safety and Efficiency

    In alignment with the state of Mississippi’s mission of “Empowering Mississippi citizens to stay connected and engaged with their government,” Salient's CompleteView VMS is being installed throughout more than 150 state boards, commissions and agencies in order to ensure safety for thousands of constituents who access state services daily. Read Now

  • Live From GSX: Post-Show Review

    Live From GSX: Post-Show Review

    This year’s Live From GSX program was a rousing success! Again, we’d like to thank our partners, and IPVideo, for working with us and letting us broadcast their solutions to the industry. You can follow our Live From GSX 2023 page to keep up with post-show developments and announcements. And if you’re interested in working with us in 2024, please don’t hesitate to ask about our Live From programs for ISC West in March or next year’s GSX. Read Now

    • Industry Events
    • GSX
  • People Say the Funniest Things

    People Say the Funniest Things

    By all accounts, GSX version 2023 was completely successful. Apparently, there were plenty of mix-ups with the airlines and getting aircraft from the East Coast into Big D. I am all ears when I am in a gathering of people. You never know when a nugget of information might flip out. Read Now

    • Industry Events
    • GSX

Featured Cybersecurity

Webinars

New Products

  • ComNet CNGE6FX2TX4PoE

    The ComNet cost-efficient CNGE6FX2TX4PoE is a six-port switch that offers four Gbps TX ports that support the IEEE802.3at standard and provide up to 30 watts of PoE to PDs. It also has a dedicated FX/TX combination port as well as a single FX SFP to act as an additional port or an uplink port, giving the user additional options in managing network traffic. The CNGE6FX2TX4PoE is designed for use in unconditioned environments and typically used in perimeter surveillance. 3

  • Automatic Systems V07

    Automatic Systems V07

    Automatic Systems, an industry-leading manufacturer of pedestrian and vehicle secure entrance control access systems, is pleased to announce the release of its groundbreaking V07 software. The V07 software update is designed specifically to address cybersecurity concerns and will ensure the integrity and confidentiality of Automatic Systems applications. With the new V07 software, updates will be delivered by means of an encrypted file. 3

  • ResponderLink

    ResponderLink

    Shooter Detection Systems (SDS), an Alarm.com company and a global leader in gunshot detection solutions, has introduced ResponderLink, a groundbreaking new 911 notification service for gunshot events. ResponderLink completes the circle from detection to 911 notification to first responder awareness, giving law enforcement enhanced situational intelligence they urgently need to save lives. Integrating SDS’s proven gunshot detection system with Noonlight’s SendPolice platform, ResponderLink is the first solution to automatically deliver real-time gunshot detection data to 911 call centers and first responders. When shots are detected, the 911 dispatching center, also known as the Public Safety Answering Point or PSAP, is contacted based on the gunfire location, enabling faster initiation of life-saving emergency protocols. 3