Stereo Cameras Detect Pedestrians from Within a Car

A team of German researchers, with the help of a lecturer at the University of Alcalá in Spain has developed a system that locates pedestrians in front of the vehicle using artificial vision. Soon to be integrated into the top-of-the-range Mercedes vehicles, the device includes two cameras and a unit that process information supplied in real time by all image points.

"The new system can detect pedestrians from within vehicles using visible spectrum cameras and can do so even at night," said SINC David Fernández Llorca, lecturer at the University of Alcalá.

Along with other scientists from the University of Heidelberg and the Max Planck Institute for Informatics, the researcher was involved in the new development for the prototypes of the company Daimler, which has research centres in Ulm (Germany). The study has been published in the IEEE Transactions on Intelligent Transportation Systems journal.

The newest feature of the device is the use of a dense stereo system. The term 'stereo' refers to the use of two cameras, which are 30 cm apart in a structure below the rear-view mirror.

"Human beings are able to make out the distance and depth of objects thanks to our two eyes – the same occurs with artificial vision," said the researcher.

Fernández Llorca adds that "the system is called 'dense' because it collects this information from all the points making up each one of the images that the cameras capture." When information is collected from just some points, whether they may be very characteristic (like the edges or corners of an object), the term 'non-dense' is used.

Dense stereo vision allows for a much more precise real time recognition of the surroundings in front of the vehicle (the shape of the road, the presence of pot holes and variations in contact between the vehicle and the road). In fact, pedestrian recognition is improved by a factor of up to 7.5 compared to non-dense systems. Animate objects can be detected in less that 200 milliseconds, like a child who suddenly runs across the road.

The processing unit for executing the algorithm

The two cameras are connected to a processing unit that executes the artificial vision algorithm. The complex hardware has taken years to develop and is based on FPGA (Field Programmable Gate Array) technology – an electronic system with logic blocks which can be configured on-site using specialised language.

Images can be seen live on a screen with 'heads-up displays' (front transparent screen) or through projections on the inner side of the windscreen. Different response elements can also be added to warn or assist the driver. These include alarms that warn of the presence of a pedestrian, break activation systems and even devices that take control of the wheel to avoid knocking someone down.

"It is possible that we will see this pedestrian recognition system very shortly in the new, top-of-the-range Mercedes models," says Fernández Llorca. But, he recognises that the last word "will depend on business issues" as many decisions need to be made before we can implement it into the production chain.

At the moment, Class C Mercedes vehicles already have single camera systems to detect special objects, such as road signs. Other manufacturers like Toyota have also announced that they will soon launch pedestrian detection stereo systems onto the market.

Featured

  • CISA Kicks Off 20th Anniversary of Cybersecurity Awareness Month

    CISA Kicks Off 20th Anniversary of Cybersecurity Awareness Month

    The Cybersecurity and Infrastructure Security Agency (CISA) recently announced the kickoff of the 20th Cybersecurity Awareness Month. Throughout October, CISA and the National Cybersecurity Alliance (NCA) will focus on ways to “Secure Our World” by educating the public on how to stay safe online. Read Now

  • Cybersecurity Awareness Month: Top Five Action Items to Elevate Your Data Security Posture Management and Secure Your Data

    October is Cybersecurity Awareness Month, and every year most tips for security hygiene and staying safe have not changed. We’ve seen them all – use strong passwords, deploy multi-factor authentication (MFA), be vigilant to spot phishing attacks, regularly update software and patch your systems. These are great recommended ongoing tips and are as relevant today as they’ve ever been. But times have changed and these best practices can no longer be the bare minimum. Read Now

  • Boosting Safety and Efficiency

    Boosting Safety and Efficiency

    In alignment with the state of Mississippi’s mission of “Empowering Mississippi citizens to stay connected and engaged with their government,” Salient's CompleteView VMS is being installed throughout more than 150 state boards, commissions and agencies in order to ensure safety for thousands of constituents who access state services daily. Read Now

  • Live From GSX: Post-Show Review

    Live From GSX: Post-Show Review

    This year’s Live From GSX program was a rousing success! Again, we’d like to thank our partners, and IPVideo, for working with us and letting us broadcast their solutions to the industry. You can follow our Live From GSX 2023 page to keep up with post-show developments and announcements. And if you’re interested in working with us in 2024, please don’t hesitate to ask about our Live From programs for ISC West in March or next year’s GSX. Read Now

    • Industry Events
    • GSX

Featured Cybersecurity

New Products

  • A8V MIND

    A8V MIND

    Hexagon’s Geosystems presents a portable version of its Accur8vision detection system. A rugged all-in-one solution, the A8V MIND (Mobile Intrusion Detection) is designed to provide flexible protection of critical outdoor infrastructure and objects. Hexagon’s Accur8vision is a volumetric detection system that employs LiDAR technology to safeguard entire areas. Whenever it detects movement in a specified zone, it automatically differentiates a threat from a nonthreat, and immediately notifies security staff if necessary. Person detection is carried out within a radius of 80 meters from this device. Connected remotely via a portable computer device, it enables remote surveillance and does not depend on security staff patrolling the area. 3

  • HD2055 Modular Barricade

    Delta Scientific’s electric HD2055 modular shallow foundation barricade is tested to ASTM M50/P1 with negative penetration from the vehicle upon impact. With a shallow foundation of only 24 inches, the HD2055 can be installed without worrying about buried power lines and other below grade obstructions. The modular make-up of the barrier also allows you to cover wider roadways by adding additional modules to the system. The HD2055 boasts an Emergency Fast Operation of 1.5 seconds giving the guard ample time to deploy under a high threat situation. 3

  • Luma x20

    Luma x20

    Snap One has announced its popular Luma x20 family of surveillance products now offers even greater security and privacy for home and business owners across the globe by giving them full control over integrators’ system access to view live and recorded video. According to Snap One Product Manager Derek Webb, the new “customer handoff” feature provides enhanced user control after initial installation, allowing the owners to have total privacy while also making it easy to reinstate integrator access when maintenance or assistance is required. This new feature is now available to all Luma x20 users globally. “The Luma x20 family of surveillance solutions provides excellent image and audio capture, and with the new customer handoff feature, it now offers absolute privacy for camera feeds and recordings,” Webb said. “With notifications and integrator access controlled through the powerful OvrC remote system management platform, it’s easy for integrators to give their clients full control of their footage and then to get temporary access from the client for any troubleshooting needs.” 3