The Data Dilemma

The Data Dilemma

Solve video surveillance with a multi-tier approach

Today, smart devices seem to be everyplace—homes, cars, transit stations, workplaces, stores, restaurants, and even on our bodies to name just a few—capturing information and creating massive amounts of data. According to recent reports, approximately 3 exabytes of raw storage capacity was shipped to customers in 2015 to address the growth. With the explosion of sensor-enabled, network-addressable devices out there, it is no wonder storage and data analytics are such hot topics, and both are affecting not only the way we live and work, but also in how we use video-based data to protect ourselves.


The security and surveillance industry has undergone a steady transition in recent years, and the pace is accelerating. An industry long dominated by stationary analog cameras is embracing digital on a large scale with HD camera shipments exceeding analog cameras for the first time in 2015.

High-resolution, multi-sensor panoramic cameras are fast-becoming the new normal for video surveillance, streaming more HD images than ever before and requiring huge increases in storage capacity and performance to handle it. These new cameras produced 556 petabytes of data per day in 2015, and that is expected to steadily increase. In fact, the total RAW capacity of enterprise storage used just for video surveillance is expected to increase by 48 percent in 2016, according to predictions by IHS. By 2019, the average amount of data generated daily by new surveillance cameras is projected to reach 2.5 exabytes.

In addition, retention times are also increasing. To adhere to regulatory requirements and protect against litigation, many companies and municipalities are keeping surveillance data much longer—years instead of days—and that is putting even more demand on storage infrastructures.

Another factor forcing change in the industry is the ongoing maturation and expanded adoption of video analytics applications. Trends and patterns emerge as data is integrated from different inputs and analyzed over long periods of time. Analytics solutions are becoming more sophisticated, integrating video data with other systems and sensor input and requiring data to be kept longer in order for patterns to be determined over time. As new use cases for these applications emerge, non-traditional business units are taking notice that video-based data— when integrated and correlated with data from other systems—can be used to make better business decisions. Logistics companies use video data to track cargo through ports and rail yards to improve efficiency. Retail companies use video to observe shopper behavior to make better decisions regarding product placement, store layout, and advertising. Municipalities use video to analyze traffic flow, reduce congestion, and increase commerce.

Given the industry challenges and new uses for video-based data via enhanced analytics, storage is no longer just a peripheral consideration. It is the foundation of today’s—and tomorrow’s—security and surveillance system. As a result, storage architecture decisions need to be made carefully in order to meet the future demands.


Today’s storage infrastructure for video surveillance must be high-performing, scalable and affordable. It must provide the capability to keep video files for a long time while providing easy access and retrieval. The best approach is to implement a tiered architecture, especially one that can be tuned specifically for processing video files and viewed as a single file system.

In a tiered architecture, multiple levels of storage exist. The architecture consists of high performance disk, secondary disk, tape, and cloud storage structured in tiers, enabling data sets to be stored on the most cost-effective medium based on user-defined policies. High priority, frequently-used files are stored on high performance disk while lower priority files are stored on tape or in the cloud. Done well, the architecture provides a single file system view, and the system manages the movement of data between tiers keeping the metadata intact, allowing files to be retained economically for a long period of time and still remain accessible for analysis when needed.

Whether implementing new fixed cameras, expanding existing installations, or implementing new law enforcement solutions via body-worn or vehicle-mounted cameras, selecting the right storage infrastructure is essential in order to build the right foundation. But regardless of which configuration is implemented the full benefits of a tiered storage solution are available, including high-performance, scalable capacity, low-cost alternatives for long-term retention, and accessibility through a single file system interface.


Sometimes it seems that cameras are everywhere. Stationary cameras monitor public and commercial buildings, transit stations, ports, and a host of other spaces, and more are installed every day. Camera counts can vary widely depending on the need—anywhere from tens of units to tens of thousands of units, and all points in between. Implementing a storage infrastructure that can grow as camera counts increase, camera technology changes and file sizes get bigger can be a challenge.

For fixed camera storage environments it is vital that the basic foundational elements of a robust storage infrastructure can be implemented in the beginning, and then scaled accordingly to address increasing capacity needs over time.


As already mentioned, deploying more cameras and shifting to HD technology stresses existing storage infrastructures, forcing the infrastructure to change. However, with existing installations, sizeable investments in storage infrastructure have already been made, making expansion difficult without throwing away money. This is where gateway reference architectures can help.

A gateway architecture can provide customers with the ability to migrate to a tiered storage infrastructure without sacrificing the investment they have already made in their existing infrastructure. No forklift upgrade is required. The foundational elements of a tiered architecture can be implemented alongside the existing infrastructure and used for new camera installations. With the foundation in place, existing storage can be retired over time as refresh cycles dictate, and new capacity added to the tiered system in its place. Using this approach saves money by protecting investments made in storage while not slowing down the move to new HD technology.


While first responders, like paramedics and firefighters may use them, mobile cameras are most often used by law enforcement staff. Video footage captured by body-worn and vehicle-mounted cameras serves as crucial evidence in helping bring criminals to justice, and provides a valuable tool to meet the public demand for greater police accountability and transparency.

Video data from mobile cameras adds another layer of complexity to police operations that are already struggling with understaffed IT departments trying to manage volumes of digital evidence from still images, audio recordings from wiretaps, and recorded video from interviews and interrogations. A mobile camera reference architecture as seen in figure 3 below can help alleviate some of the challenges.

With a tiered architecture for mobile camera environments, law enforcement personnel can access video files and maintain control of the data for evidence management without relying on a dedicated IT staff. In addition, the cost-effective nature of storing files on the least expensive tier delivers robust functionality without busting departmental budgets.


Data is vital for efforts to improve our society and to spur ongoing innovation. Technological advancements and the Internet of Things are making it possible to capture and use unprecedented amounts of data. Success in every industry, including security and surveillance, is increasingly dependent on finding creative new uses for data and technology, driving significant changes in IT infrastructure.

Keeping up with the increased demand for capacity and unlocking the value of video-based data through enhanced analytics requires a storage infrastructure that is flexible, high-performing and affordable. Today, storage is no longer a peripheral consideration. It is the foundation of a robust surveillance system, and selecting the right storage solution is essential. Managing video data from new fixed cameras, or expanding existing installations, or implementing new law enforcements solutions, all can benefit from tiered storage architecture, the most scalable, cost-effective approach to meeting the need for more capacity.

This article originally appeared in the August 2016 issue of Security Today.


  • 12 Commercial Crime Sites to Do Your Research

    12 Commercial Crime Sites to Do Your Research

    Understanding crime statistics in your industry and area is crucial for making important decisions about your security budget. With so much information out there, how can you know which statistics to trust? Read Now

  • Boosting Safety and Efficiency

    Boosting Safety and Efficiency

    In alignment with the state of Mississippi’s mission of “Empowering Mississippi citizens to stay connected and engaged with their government,” Salient's CompleteView VMS is being installed throughout more than 150 state boards, commissions and agencies in order to ensure safety for thousands of constituents who access state services daily. Read Now

  • Live From GSX: Post-Show Review

    Live From GSX: Post-Show Review

    This year’s Live From GSX program was a rousing success! Again, we’d like to thank our partners, and IPVideo, for working with us and letting us broadcast their solutions to the industry. You can follow our Live From GSX 2023 page to keep up with post-show developments and announcements. And if you’re interested in working with us in 2024, please don’t hesitate to ask about our Live From programs for ISC West in March or next year’s GSX. Read Now

    • Industry Events
    • GSX
  • People Say the Funniest Things

    People Say the Funniest Things

    By all accounts, GSX version 2023 was completely successful. Apparently, there were plenty of mix-ups with the airlines and getting aircraft from the East Coast into Big D. I am all ears when I am in a gathering of people. You never know when a nugget of information might flip out. Read Now

    • Industry Events
    • GSX

Featured Cybersecurity


New Products

  • Camden CV-7600 High Security Card Readers

    Camden CV-7600 High Security Card Readers

    Camden Door Controls has relaunched its CV-7600 card readers in response to growing market demand for a more secure alternative to standard proximity credentials that can be easily cloned. CV-7600 readers support MIFARE DESFire EV1 & EV2 encryption technology credentials, making them virtually clone-proof and highly secure. 3

  • XS4 Original+

    XS4 Original+

    The SALTO XS4 Original+ design is based on the same proven housing and mechanical mechanisms of the XS4 Original. The XS4 Original+, however, is embedded with SALTO’s BLUEnet real-time functionality and SVN-Flex capability that enables SALTO stand-alone smart XS4 Original+ locks to update user credentials directly at the door. Compatible with the array of SALTO platform solutions including SALTO Space data-on-card, SALTO KS Keys as a Service cloud-based access solution, and SALTO’s JustIn Mobile technology for digital keys. The XS4 Original+ also includes RFID Mifare DESFire, Bluetooth LE and NFC technology functionality. 3

  • ResponderLink


    Shooter Detection Systems (SDS), an company and a global leader in gunshot detection solutions, has introduced ResponderLink, a groundbreaking new 911 notification service for gunshot events. ResponderLink completes the circle from detection to 911 notification to first responder awareness, giving law enforcement enhanced situational intelligence they urgently need to save lives. Integrating SDS’s proven gunshot detection system with Noonlight’s SendPolice platform, ResponderLink is the first solution to automatically deliver real-time gunshot detection data to 911 call centers and first responders. When shots are detected, the 911 dispatching center, also known as the Public Safety Answering Point or PSAP, is contacted based on the gunfire location, enabling faster initiation of life-saving emergency protocols. 3