AI-Based Vision System Prevents Contraband Drops in Prisons

AI-Based Vision System Prevents Contraband Drops in Prisons

Recreational drone popularity continues to rise as the devices become less expensive, easier to use, and safer to fly. Current Federal Aviation Administration figures show more than 500,000 recreational drones registered, and this does not include those that weigh 0.55 pounds or less. These figures, of course, do not show unregistered drones being used for nefarious and otherwise illegal activities.

Such activities include contraband drops in prison yards, a growing problem for corrections departments around the world. In such instances, operators use unregistered drones to drop drugs, money, cigarettes, and other contraband into prison yards at nighttime to avoid detection. But as bad actor drone operators become more intelligent and adapt, drone detection capabilities have advanced as well. Some systems offer autonomous and threat-agnostic capabilities.

Bad Actors Adapt
Fighting illegal drone activity has traditionally involved deploying a radio frequency–based system to detect communication between a pilot and a commonly used drone, such as one from DJI. But this approach has become less effective because over time, tactics for drone-based contraband drops have evolved, according to Kyle Meloney, co-founder and CEO of airspace awareness company Walaris. 

“Traditional drone detection systems rely on libraries to match signals and detect known drone platforms they’ve encountered before. Perpetrators are becoming more clever, oftentimes using lesser-known drones and sometimes repurposing drones, making them more difficult to detect, track, and identify using traditional means,” he said.

As perpetrators learn more about traditional detection systems and develop ways to get around them, the need for more threat-agnostic (or “library-less”) systems has emerged. Systems today must be capable of quickly detecting, tracking, and classifying all drone makes and models, even if they haven’t encountered the drone before or if the drone has been modified.

A Multisensor Approach
Designed to work alongside other detection modalities — such as radar, radio frequency, and acoustic sensors — Walaris’ AirScout Verify is a tracking and identification software solution with autonomous threat-verification capabilities. Depending on the individual deployment, the hardware-agnostic system may deploy an AXIS Communications Q6225-LE pan-tilt-zoom (PTZ) camera with near infrared illuminators to capture images at night or a dual daytime and thermal infrared camera from Bosch.

When the slew-to-cue system (a drone detection unit integrated with another sensor, such as radar, that tells the camera the initial location of the object) receives a cue, system software positions the camera to target the detected object’s airspace. It then analyzes the camera’s imagery to locate the suspected threat and capture its precise coordinates. A PTZ algorithm triggers the camera to zoom in on the coordinates to further investigate the object while artificial intelligence (AI) and range-to-focus control algorithms enable the system to acquire the target, maintain a clear image, and classify it. The system capably tracks only verified drone threats, ignoring objects not considered a threat, such as birds. 

Once the software classifies the detected object as a drone, it sends an alert to the system operator, along with full-motion video of the threat, so the operator can decide how to handle the situation. In a prison scenario, this might mean securing the yard and bringing inmates inside, but the response also involves identifying the location of the drone to intercept the contraband. In addition, finding the location of the pilot is a priority as well, according to Meloney.

“Beyond interdicting the contraband, prisons want to find the operator of the drone. A lot of the same people are doing this repeatedly,” he said. “If there are 300 incursions in a year, it’s unlikely that 300 different people are using drones to drop contraband. It might be just a handful of groups doing it, so the system can also be used to track the drone back to its origin and make an arrest.”

Enter Edge AI
While traditional techniques work in simpler scenarios, they are less effective when dealing with complex scenes, according to Meloney. “Aerial scenes often contain a lot of clutter, motion, and varying levels of contrast, making it difficult for traditional techniques to find and verify drone threats,” he said.

To handle such complexity, the system software features proprietary AI computer vision algorithms for detection, acquisition, classification, tracking, and more. “Our software processes sequences of images in real time and preclassifies every object to determine relevance and prioritize suspected threats. This approach can effectively manage dynamic and complex scenes, while reducing false positives and automating the detect–track–identify response chain,” Meloney said. Getting to that point, however, requires a lot of algorithm and data preparation.

Walaris’ data acquisition pipeline involves acquiring a large and diverse set of high-quality images to better train its AI models. “Our AI models continuously retrain on a growing preprocessed dataset, and the AI model development, fine tuning, and training process is perpetual,” said Meloney. “Walaris constantly experiments with new AI models, optimizes existing models, and adds new images to its dataset to improve AirScout’s performance in all spectral domains and ultimately make the system more effective.”

Powering the software and its complex algorithms is a custom-configured IP67-rated industrial PC from CoastIPC, which features an NVIDIA graphics processing unit (GPU).

“Applications that require real-time responses need reliable, powerful PCs,” said Meloney. “We partnered with CoastIPC because every PC they supply fits the exact requirements needed to execute on every mission without failure, and the units always arrive on time.”

A Hands-Off Detection Approach
While contraband drops remain an issue for prisons around the world, several methods for drone detection exist on the market today. Walaris’ hands-off, comprehensive optical approach to the problem allows prisons to use advanced technologies such as radar and AI computer vision for autonomous detecting, tracking, and identifying drones in dynamic environments.

The AirScout Verify system has been operationally deployed at many corrections facilities in the United States, with many more currently rolling out. In addition, the company’s AirScout Sentry end-to-end optical detection system has been operationally deployed at prisons in Europe.

“Using an integrated sensor set that includes EO/IR cameras, radar, and other military-grade technology at a prison is a new concept,” said Meloney. “These are complex technologies and being able to run these systems fully autonomously as a force multiplier at prisons and have them work reliably against the full spectrum of drone threats is a novel concept.”


  • Secure Your Home During the Holidays

    The most wonderful time of the year can easily transform into a nightmare. Being vigilant, while still enjoying the holiday season, is possible. The holiday season is the perfect time to start implementing security measures to protect one’s home and ensure security while out and about. Read Now

  • Five Cybersecurity Trends Predictions for 2024

    According to Cybersixgill, threat research experts, AI’s evolution will continually improve both organizations’ cyber defense efforts and cybercriminal activities. At the same time, increasingly complex regulatory requirements, continued consolidation of cybersecurity tools, a widening attack surface, and heightened global geopolitical issues will all play a significant role in driving the direction of cybersecurity. Read Now

  • AI on the Edge

    Discussions about the merits (or misgivings) around AI (artificial intelligence) are everywhere. In fact, you’d be hard-pressed to find an article or product literature without mention of it in our industry. If you’re not using AI by now in some capacity, congratulations may be in order since most people are using it in some form daily even without realizing it. Read Now

  • NSA Report Focuses on How to Protect Against Evolving Phishing Attacks

    The National Security Agency (NSA) and U.S. partners have released a new report describing the latest techniques in phishing attacks and the defenses organizations can deploy against them. Read Now

Featured Cybersecurity

New Products

  • ComNet CNGE6FX2TX4PoE

    The ComNet cost-efficient CNGE6FX2TX4PoE is a six-port switch that offers four Gbps TX ports that support the IEEE802.3at standard and provide up to 30 watts of PoE to PDs. It also has a dedicated FX/TX combination port as well as a single FX SFP to act as an additional port or an uplink port, giving the user additional options in managing network traffic. The CNGE6FX2TX4PoE is designed for use in unconditioned environments and typically used in perimeter surveillance. 3

  • Mobile Safe Shield

    Mobile Safe Shield

    SafeWood Designs, Inc., a manufacturer of patented bullet resistant products, is excited to announce the launch of the Mobile Safe Shield. The Mobile Safe Shield is a moveable bullet resistant shield that provides protection in the event of an assailant and supplies cover in the event of an active shooter. With a heavy-duty steel frame, quality castor wheels, and bullet resistant core, the Mobile Safe Shield is a perfect addition to any guard station, security desks, courthouses, police stations, schools, office spaces and more. The Mobile Safe Shield is incredibly customizable. Bullet resistant materials are available in UL 752 Levels 1 through 8 and include glass, white board, tack board, veneer, and plastic laminate. Flexibility in bullet resistant materials allows for the Mobile Safe Shield to blend more with current interior décor for a seamless design aesthetic. Optional custom paint colors are also available for the steel frame. 3

  • FEP GameChanger

    FEP GameChanger

    Paige Datacom Solutions Introduces Important and Innovative Cabling Products GameChanger Cable, a proven and patented solution that significantly exceeds the reach of traditional category cable will now have a FEP/FEP construction. 3