Understanding AI in Video Surveillance

Applying human intelligence to computer programs

Many video surveillance professionals have come across the terms Artificial Intelligence (AI), Machine Learning (ML), and Deep Learning (DL). But what do those terms mean, and how do they affect Video Surveillance?

AI, MACHINE LEARNING AND DEEP LEARNING

AI is a term that loosely refers to applying human intelligence to computer programs or allowing programs to learn over time with the goal of producing better results as they learn. Machine Learning is a technique used to achieve a level of AI, and Deep Learning is an evolution of Machine Learning. In short, Deep Learning is an advanced, more sophisticated Machine Learning technique, and both are methods of achieving a level of AI.

Application in video surveillance. In video surveillance, video analytics uses Machine Learning and Deep Learning methods to identify objects, classify them, and determine their properties.

Whenever people receive new information, our brains attempt to compare the data to similar items in order to make sense of it. This comparative approach is the same concept that Machine and Deep Learning algorithms employ.

Machine and Deep Learning algorithms differ in how they are programmed to determine what constitutes a known object. Machine Learning requires more human intervention from a programmer to establish desired parameters in order to achieve the desired outcome. Deep Learning identifies object attributes independently and may consider characteristics the programmers would not.

Machine learning versus deep learning. What do Machine Learning and Deep Learning mean for Video Analytics? Both approaches describe programming methods where a system learns based on a data set. With Machine Learning, the attributes of the data a system looks for are usually preset, or corrected for, by human programmers. For instance, the system may be programmed to delineate an object that is taller than it is wide, with limbs moving in specified ways, and so on, and label this object a “person.”

Deep Learning is considered superior to Machine Learning, in part because the programmers may not recognize the most relevant criteria. Using the previous algorithm to identify a person, a seated and stationary person may not trigger an accurate detection.

With Deep Learning, the video analytic algorithms are fed an extensive data set representing an object. This step is called training, where the algorithm trains itself to recognize a type of object. For example, the system is fed thousands of images of people of varying genders, styles of clothing, ethnic backgrounds, images taken at different angles, and more.

The algorithm figures out attributes that are similar as well as dissimilar, and also determines how to weigh the relevance of those characteristics. After analyzing thousands of images, the algorithm may calculate the majority of images include a triangular- shaped object near the upper part of the image, with two darkened oval spots near its bottom, which we would think of as a nose on someone’s face. In fact, the algorithm may have identified many other such characteristics we wouldn’t think of.

Training the system is done by the developers of the software before it is used by a consumer. The process takes a substantial amount of computing power; much more than what is required to detect and classify objects when used in the field. The result is a file that is referenced by the system to determine if a detected object matches the classification.

Because the Deep Learning process uses the machine to determine object characteristics, it has led to analytics which can provide much more granular classification. For instance, older approaches may be able to detect a person, but Deep Learning based analytics can detect whether the person is a man, woman, or child. It may also be able to detect associated characteristics of an individual as well as vehicle type or make.

Learning over time. Typically, AI in video surveillance is trained at design time and, in some cases, does not get progressively “smarter” when used in the field. Deep Learning and Machine Learning do have this capability, however, and if used, can employ analytics which can learn over time.

Typical applications may include systems that determine what is normal in a scene. For instance, a school hallway experiences a rush of traffic about every 45 minutes between class periods. During that high traffic time, the traffic is dispersed and not concentrated in any particular area.

Furthermore, it is unusual for all the people to be moving at a very high speed. If the system detects an unusual concentration of objects, it could indicate a fight broke out. If all the people are running in the same direction outside of the usual inter-class period, it could indicate an emergency situation.

SMARTER SYSTEMS, BETTER RESULTS

Video surveillance systems produce huge volumes of data. Monitoring and filtering through such vast quantities of information makes the task of quickly identifying security incidents and finding evidence more difficult than ever.

Intelligent systems using Deep Learning can help us identify evidence much more promptly and analyze video in real-time to alert system operators of suspected events, providing better results for your security program.

This article originally appeared in the May/June 2020 issue of Security Today.

Featured

  • Evolving Cybersecurity Strategies: Uniting Human Risk Management and Security Awareness Training

    Organizations are increasingly turning their attention to human-focused security approaches, as two out of three (68%) cybersecurity incidents involve people. Threat actors are shifting from targeting networks and systems to hacking humans via social engineering methods, living off human errors as their most prevalent attack vector. Whether manipulated or not, human cyber behavior is leveraged to gain backdoor access into systems. This mainly results from a lack of employee training and awareness about evolving attack techniques employed by malign actors. Read Now

  • Report: 1 in 3 Easily Exploitable Vulnerabilities Found on Cloud Assets

    CyCognito recently released new research highlighting critical security vulnerabilities across cloud-hosted assets, revealing that one in three easily exploitable vulnerabilities or misconfigurations are found on cloud assets. As organizations increasingly shift to multi-cloud strategies, the findings underscore significant security gaps that could provide attackers with potential footholds into networks. Read Now

  • Built for Today, Ready for Tomorrow

    Selecting the right VMS is critical for any organization that depends on video surveillance to ensure safety, security and operational efficiency. While many organizations focus on immediate needs such as budget and deployment size, let us review some of the long-term considerations that can significantly impact a VMS's utility and flexibility. Read Now

  • Paving the Way to Smart Buildings

    In today's rapidly evolving security landscape, the convergence of on-prem, edge and cloud technologies are critical. The physical security landscape is undergoing a profound transformation, driven by the rapid digitalization of buildings and the evolving needs of modern organizations. As the buildings sector pivots towards smart, AI and data-driven operations, the integration of both edge and cloud technology has become crucial. Read Now

  • The Cybersecurity Time Bomb

    If you work in physical security, you have probably seen it: a camera, access control system, or intrusion detection device installed years ago, humming along without a single update. It is a common scenario that security professionals have come to accept as "normal." But here is the reality: this mindset is actively putting organizations at risk. Read Now

New Products

  • Mobile Safe Shield

    Mobile Safe Shield

    SafeWood Designs, Inc., a manufacturer of patented bullet resistant products, is excited to announce the launch of the Mobile Safe Shield. The Mobile Safe Shield is a moveable bullet resistant shield that provides protection in the event of an assailant and supplies cover in the event of an active shooter. With a heavy-duty steel frame, quality castor wheels, and bullet resistant core, the Mobile Safe Shield is a perfect addition to any guard station, security desks, courthouses, police stations, schools, office spaces and more. The Mobile Safe Shield is incredibly customizable. Bullet resistant materials are available in UL 752 Levels 1 through 8 and include glass, white board, tack board, veneer, and plastic laminate. Flexibility in bullet resistant materials allows for the Mobile Safe Shield to blend more with current interior décor for a seamless design aesthetic. Optional custom paint colors are also available for the steel frame.

  • Connect ONE’s powerful cloud-hosted management platform provides the means to tailor lockdowns and emergency mass notifications throughout a facility – while simultaneously alerting occupants to hazards or next steps, like evacuation.

    Connect ONE®

    Connect ONE’s powerful cloud-hosted management platform provides the means to tailor lockdowns and emergency mass notifications throughout a facility – while simultaneously alerting occupants to hazards or next steps, like evacuation.

  • Unified VMS

    AxxonSoft introduces version 2.0 of the Axxon One VMS. The new release features integrations with various physical security systems, making Axxon One a unified VMS. Other enhancements include new AI video analytics and intelligent search functions, hardened cybersecurity, usability and performance improvements, and expanded cloud capabilities