Researchers Find Steps To Improve Facial Recognition Systems At Border Entry Points

Facial recognition systems perform some very challenging tasks such as checking an individual’s photo against a database of known or suspected criminals. The task can become nearly impossible when the systems acquire poor facial images -- a situation that occurs all too often in real-world environments.

Now, researchers at the National Institute of Standards and Technology (NIST) have found that several simple steps can significantly improve the quality of facial images that are acquired at border entry points such as airports and seaports.

Better yet, the NIST recommendations for improving facial images can be implemented relatively easily with existing facial recognition technology.

Travelers entering the United States have their pictures taken and their fingerprints collected digitally as part of the US-VISIT program implemented by the Department of Homeland Security. US-VISIT and NIST work together on an ongoing basis to improve processes and technology. A 2007 NIST study of facial images collected at border entry points, however, found that the captured facial images were not as clear and useful for automated recognition as they could be.

In usability and human factors research performed for US-VISIT as part of a large joint effort to improve facial recognition technology, NIST’s Mary Theofanos and her colleagues sought simple ways of obtaining better facial images in often hectic real-world conditions without having to deploy new technology. The NIST researchers first visited and observed a DHS border entry point at Dulles Airport in the Washington, D.C. area to see the facial-image capturing process.

As a result of these observations, the researchers identified and shared with US-VISIT a number of steps to take for acquiring better facial images. For example, the report recommends that operators should adjust camera settings to ensure the subject comes into sharp focus. The report also recommends using a traditional-looking camera in facial-recognition systems so that individuals could clearly recognize the camera and look into it.

Following the Dulles site visit, a study adopted these steps in taking facial images of 300 participants while mimicking the real-world conditions of a border entry point. In these tests, 100 percent of the images fully captured the participant's face; all of the participants faced the camera; and the researchers found additional improvements by using a graphical overlay to the camera display in order to better position the camera.

The researchers believe these steps will improve the performance of facial recognition systems in real-world settings using existing technology. A follow-up study is underway in which the researchers are incorporating the graphical overlay into the workflow of camera operators.

This work was sponsored by the Science and Technology Directorate at the Department of Homeland Security.

Featured

  • The Evolution of IP Camera Intelligence

    As the 30th anniversary of the IP camera approaches in 2026, it is worth reflecting on how far we have come. The first network camera, launched in 1996, delivered one frame every 17 seconds—not impressive by today’s standards, but groundbreaking at the time. It did something that no analog system could: transmit video over a standard IP network. Read Now

  • From Surveillance to Intelligence

    Years ago, it would have been significantly more expensive to run an analytic like that — requiring a custom-built solution with burdensome infrastructure demands — but modern edge devices have made it accessible to everyone. It also saves time, which is a critical factor if a missing child is involved. Video compression technology has played a critical role as well. Over the years, significant advancements have been made in video coding standards — including H.263, MPEG formats, and H.264—alongside compression optimization technologies developed by IP video manufacturers to improve efficiency without sacrificing quality. The open-source AV1 codec developed by the Alliance for Open Media—a consortium including Google, Netflix, Microsoft, Amazon and others — is already the preferred decoder for cloud-based applications, and is quickly becoming the standard for video compression of all types. Read Now

  • Cost: Reactive vs. Proactive Security

    Security breaches often happen despite the availability of tools to prevent them. To combat this problem, the industry is shifting from reactive correction to proactive protection. This article will examine why so many security leaders have realized they must “lead before the breach” – not after. Read Now

  • Achieving Clear Audio

    In today’s ever-changing world of security and risk management, effective communication via an intercom and door entry communication system is a critical communication tool to keep a facility’s staff, visitors and vendors safe. Read Now

  • Beyond Apps: Access Control for Today’s Residents

    The modern resident lives in an app-saturated world. From banking to grocery delivery, fitness tracking to ridesharing, nearly every service demands another download. But when it comes to accessing the place you live, most people do not want to clutter their phone with yet another app, especially if its only purpose is to open a door. Read Now

New Products

  • AC Nio

    AC Nio

    Aiphone, a leading international manufacturer of intercom, access control, and emergency communication products, has introduced the AC Nio, its access control management software, an important addition to its new line of access control solutions.

  • ResponderLink

    ResponderLink

    Shooter Detection Systems (SDS), an Alarm.com company and a global leader in gunshot detection solutions, has introduced ResponderLink, a groundbreaking new 911 notification service for gunshot events. ResponderLink completes the circle from detection to 911 notification to first responder awareness, giving law enforcement enhanced situational intelligence they urgently need to save lives. Integrating SDS’s proven gunshot detection system with Noonlight’s SendPolice platform, ResponderLink is the first solution to automatically deliver real-time gunshot detection data to 911 call centers and first responders. When shots are detected, the 911 dispatching center, also known as the Public Safety Answering Point or PSAP, is contacted based on the gunfire location, enabling faster initiation of life-saving emergency protocols.

  • Connect ONE’s powerful cloud-hosted management platform provides the means to tailor lockdowns and emergency mass notifications throughout a facility – while simultaneously alerting occupants to hazards or next steps, like evacuation.

    Connect ONE®

    Connect ONE’s powerful cloud-hosted management platform provides the means to tailor lockdowns and emergency mass notifications throughout a facility – while simultaneously alerting occupants to hazards or next steps, like evacuation.