Stereo Cameras Detect Pedestrians from Within a Car

A team of German researchers, with the help of a lecturer at the University of Alcalá in Spain has developed a system that locates pedestrians in front of the vehicle using artificial vision. Soon to be integrated into the top-of-the-range Mercedes vehicles, the device includes two cameras and a unit that process information supplied in real time by all image points.

"The new system can detect pedestrians from within vehicles using visible spectrum cameras and can do so even at night," said SINC David Fernández Llorca, lecturer at the University of Alcalá.

Along with other scientists from the University of Heidelberg and the Max Planck Institute for Informatics, the researcher was involved in the new development for the prototypes of the company Daimler, which has research centres in Ulm (Germany). The study has been published in the IEEE Transactions on Intelligent Transportation Systems journal.

The newest feature of the device is the use of a dense stereo system. The term 'stereo' refers to the use of two cameras, which are 30 cm apart in a structure below the rear-view mirror.

"Human beings are able to make out the distance and depth of objects thanks to our two eyes – the same occurs with artificial vision," said the researcher.

Fernández Llorca adds that "the system is called 'dense' because it collects this information from all the points making up each one of the images that the cameras capture." When information is collected from just some points, whether they may be very characteristic (like the edges or corners of an object), the term 'non-dense' is used.

Dense stereo vision allows for a much more precise real time recognition of the surroundings in front of the vehicle (the shape of the road, the presence of pot holes and variations in contact between the vehicle and the road). In fact, pedestrian recognition is improved by a factor of up to 7.5 compared to non-dense systems. Animate objects can be detected in less that 200 milliseconds, like a child who suddenly runs across the road.

The processing unit for executing the algorithm

The two cameras are connected to a processing unit that executes the artificial vision algorithm. The complex hardware has taken years to develop and is based on FPGA (Field Programmable Gate Array) technology – an electronic system with logic blocks which can be configured on-site using specialised language.

Images can be seen live on a screen with 'heads-up displays' (front transparent screen) or through projections on the inner side of the windscreen. Different response elements can also be added to warn or assist the driver. These include alarms that warn of the presence of a pedestrian, break activation systems and even devices that take control of the wheel to avoid knocking someone down.

"It is possible that we will see this pedestrian recognition system very shortly in the new, top-of-the-range Mercedes models," says Fernández Llorca. But, he recognises that the last word "will depend on business issues" as many decisions need to be made before we can implement it into the production chain.

At the moment, Class C Mercedes vehicles already have single camera systems to detect special objects, such as road signs. Other manufacturers like Toyota have also announced that they will soon launch pedestrian detection stereo systems onto the market.

Featured

  • Video Surveillance Trends to Watch

    With more organizations adding newer capabilities to their surveillance systems, it’s always important to remember the “basics” of system configuration and deployment, as well as the topline benefits of continually emerging technologies like AI and the cloud. Read Now

  • New Report Reveals Top Trends Transforming Access Controller Technology

    Mercury Security, a provider in access control hardware and open platform solutions, has published its Trends in Access Controllers Report, based on a survey of over 450 security professionals across North America and Europe. The findings highlight the controller’s vital role in a physical access control system (PACS), where the device not only enforces access policies but also connects with readers to verify user credentials—ranging from ID badges to biometrics and mobile identities. With 72% of respondents identifying the controller as a critical or important factor in PACS design, the report underscores how the choice of controller platform has become a strategic decision for today’s security leaders. Read Now

  • Overwhelming Majority of CISOs Anticipate Surge in Cyber Attacks Over the Next Three Years

    An overwhelming 98% of chief information security officers (CISOs) expect a surge in cyber attacks over the next three years as organizations face an increasingly complex and artificial intelligence (AI)-driven digital threat landscape. This is according to new research conducted among 300 CISOs, chief information officers (CIOs), and senior IT professionals by CSC1, the leading provider of enterprise-class domain and domain name system (DNS) security. Read Now

  • ASIS International Introduces New ANSI-Approved Investigations Standard

    • Guard Services
  • Cloud Security Alliance Brings AI-Assisted Auditing to Cloud Computing

    The Cloud Security Alliance (CSA), the world’s leading organization dedicated to defining standards, certifications, and best practices to help ensure a secure cloud computing environment, today introduced an innovative addition to its suite of Security, Trust, Assurance and Risk (STAR) Registry assessments with the launch of Valid-AI-ted, an AI-powered, automated validation system. The new tool provides an automated quality check of assurance information of STAR Level 1 self-assessments using state-of-the-art LLM technology. Read Now

New Products

  • PE80 Series

    PE80 Series by SARGENT / ED4000/PED5000 Series by Corbin Russwin

    ASSA ABLOY, a global leader in access solutions, has announced the launch of two next generation exit devices from long-standing leaders in the premium exit device market: the PE80 Series by SARGENT and the PED4000/PED5000 Series by Corbin Russwin. These new exit devices boast industry-first features that are specifically designed to provide enhanced safety, security and convenience, setting new standards for exit solutions. The SARGENT PE80 and Corbin Russwin PED4000/PED5000 Series exit devices are engineered to meet the ever-evolving needs of modern buildings. Featuring the high strength, security and durability that ASSA ABLOY is known for, the new exit devices deliver several innovative, industry-first features in addition to elegant design finishes for every opening.

  • 4K Video Decoder

    3xLOGIC’s VH-DECODER-4K is perfect for use in organizations of all sizes in diverse vertical sectors such as retail, leisure and hospitality, education and commercial premises.

  • ResponderLink

    ResponderLink

    Shooter Detection Systems (SDS), an Alarm.com company and a global leader in gunshot detection solutions, has introduced ResponderLink, a groundbreaking new 911 notification service for gunshot events. ResponderLink completes the circle from detection to 911 notification to first responder awareness, giving law enforcement enhanced situational intelligence they urgently need to save lives. Integrating SDS’s proven gunshot detection system with Noonlight’s SendPolice platform, ResponderLink is the first solution to automatically deliver real-time gunshot detection data to 911 call centers and first responders. When shots are detected, the 911 dispatching center, also known as the Public Safety Answering Point or PSAP, is contacted based on the gunfire location, enabling faster initiation of life-saving emergency protocols.