The Truth about Fisheye

The Truth about Fisheye

Dewarping and how to use it

As most in the video surveillance industry know, traditional video surveillance cameras have an inherent flaw: blind spots. For example, if a fixed field-ofview camera is pointed left and an incident occurs on the right, then the camera is useless. So, couldn’t we just double or triple the number of cameras used in every cafeteria and parking lot in order to capture every angle? Sure, but then users are forced to incur extra hardware costs, installation costs, software licensing and added maintenance expenses.

With demand for comprehensive security increasing—while corresponding budgets decrease or stay the same—that is not a practical solution. This is why Sentry360 has made obtaining an affordable, true, 360-degree-view a technology that is accessible to the masses. Looking at a pure fisheye image might be a novel perspective, but when it comes to a security professional investigating, it becomes something to decipher. A 360° fisheye allows the curved fisheye affect to become corrected, like looking at a normal camera through a process called dewarping; however, this is only half the battle. Let’s put this into context relative to the current state of the market. 

The Market

There has been a big boom in the past few years with manufacturers producing cameras with fisheye lenses. The reality is that many of these products came to market to fill a gap in said manufacturer’s product-line, which often times is an imitation not an innovation. Many in the 360-degree sector believe that all they have to do to achieve full coverage is attach a fisheye lens to an IP video camera and—voila!—they will receive full coverage. Not so. If you don’t have the ability to first dewarp then allow full PTZ in live and recorded 360-degree fisheye images, then the result is a product that may be misleading to an end-user.

The majority of these recent entrants to the fisheye market do allow dewarping through a common DSP chip manufacturer Ambarella, but there’s a catch: The user must dewarp the stream incamera coming into the VMS which is typically 20 to 30 percent of the overall fisheye, leaving 70 to 80 percent unrecorded. To reduce blind spots, the user can repeat this process, adding multiple dewarped streams from the camera at different angles, but this could, in some cases, increase bandwidth and storage, or add software licenses and increase power consumption from the camera. Throughout this restricted process, it eliminates the ability to PTZ the dewarped single stream view in recorded video, which should ultimately be the sole purpose for choosing this breed of technology.

The following will help users understand best practices, positioning and applications for this technology with one common goal: to capture the largest amount of information with the least amount of cameras (sensors) from a single vantage point.

The Application: Ceiling Mount with 360° Technology

This is the North, South, East and West approach—with everything in between. 360°cameras are designed to capture a full half of circle and to be mounted on the ceiling looking straight down so it can capture, record and reproduce corrected perspective PTZ windows in recorded or live video. The optimization of the Sentry360 dewarping technology reduces the amount of total single field-of-view cameras you will need to cover heavy traffic or open areas within schools, banks, retail, assembly lines, busses, trains, airports and more.

The DOs:

  1. Mount in a ceiling using a surfacemount mini dome or flush-mount (discreet accessory) with a drop ceiling.
  2. Make a clear decision at what radius image quality is needed. Think detection vs. identification. Results will vary depending on how high the camera is mounted and how far away the subject is from the camera.
  3. Plan for evenly distributed lighting. If part of environment is poorly lit that section of the image will be affected.

The DON’Ts:

  1. Do not mount the 360°camera in a corner. This reduces its effective coverage. Ensure the camera is mounted in intersections or heavy traffic areas in open spaces.
  2. Because it’s a 5MP sensor, do not expect that a dewarped section will be that same resolution. A single dewarped view can be, depending on what native resolution of the camera, VGA or less, based on how much the user digitally zooms.

The Application: Wall Mount with 180°

This is taking the fisheye and wall mounting it for a desired 180° viewing angle (east to west). As opposed to stitching multiple sensors, for this application, the fisheye is displayed in one full panoramic view in your VMS of choice. Users can then digitally zoom into this view for a more detailed perspective. Because of the use of a fisheye and to minimize distortion, the best portions of the image are sectioned off for display, and eliminate the unimportant sections such as the sky, for example. The panoramic view is intended to be an overview shot and will provide users a camera reduction solution with a single installation point. Applications include sides of buildings and parking lots, retail checkout counters, stairwells, hallways (T intersections) and bus/train platforms.

The DOs:

  1. Ensure the 180 is mounted in the middle of the environment, centralizing its perspective view to evenly distribute  the image quality throughout the panoramic image.
  2. Make a clear decision on what mounting height as this effects the overall pixel density of the image. 
  3. For higher mounting, ensure that the 180 has the ability to point downward, either with the outdoor housing or mini-dome lens gimbal, as not to record unnecessary information such as clouds or the ceiling.

The DON’Ts:

  1. Do not mount the camera where large obstructions can cause blind-spots.
  2. Do not use this as a replacement for optically-zoomed PTZ for license plate capture. The 180-degree, panoramic view is designed to be an overview scene.

The Application: Table, Counter, Floor and Vehicle 360° Technology

This is using the 360° with a completely different algorithm that we’ve named “InVerted360°,” and could even call for applications users haven’t been thinking about.  When mounting the camera on a surface, table, counter or floor looking upward, the perspective changes. In a conference room, for example, you can navigate to the speaker or presenter and interact with others in the meeting room while being on a remote connection. In a retail or cash counting application by mounting or embedding the camera in the counter, users get a closer, more interactive perspective. It even has applications in gaming tables for blackjack or poker to have a table-level perspective of the full interaction between players and dealers.

To deliver the full functionality of 360° fisheye technology, Sentry360 has developed a software development kit (SDK) customized for VMS developers and NVR manufacturers. IP video surveillance has evolved into an ecosystem that allows the users to choose best-in-breed technologies to create a full, customized solution for the end-user, based on their application. Over the years, we were forced to adapt our SDK to work within a variety of different software environments, languages and operating systems.  To date, we feel that our SDK is the most integrated, flexible and customizable, enabling the future of this technology to not be limited. We boast that our SDK works with any operating system and software platform/language, and is ready to scale with any resolution as fisheye lenses improve and Ultra-HD becomes more common place.

The Sentry360 SDK has given security providers the tools necessary to record and display the full 360° fisheye image, and then in live or playback, correct the view for a full retrospective PTZ in all directions. The point of 360 is to enable that PTZ experience with the ability of hindsight in full 360 degrees, all while providing full situational awareness.

With nearly 30 technology integrations to date, Sentry360 has laid the ground work to optimize the future of this technology and has laid a path for future quality improvements for scaling in resolution and compression while opening the door to new applications.

This article originally appeared in the December 2014 issue of Security Today.

About the Author

Thomas Carnevale is the CEO of Umbrella Technologies

Featured

  • Cutting Retail Losses

    Retail is still a more complex and dynamic security vertical in modern society. Inherent challenges with in-store and distribution center operations are primarily due to constantly shifting consumer buying trends. Retailers must show daily flexibility to keep workers, meet sales goals and attract customers while maintaining safe and efficient operations. Retail is an intricate web of interconnected elements. Read Now

  • The Key to Wellbeing in the Office

    A few years ago, all we saw in the news was the ‘great resignation.’ Now we have another ‘great’ to deal with. According to CBRE, 2023 was the start of the ‘great return’ as office workers returned to their normal offices after working from home. The data shows that two-thirds of all U.S office buildings were more than 90% leased as of Q2 2023. Read Now

  • Failed Cybersecurity Controls Costing U.S. Businesses $30 Billion Yearly

    Panaseer recently released ControlWatch and the Continuous Controls Battle: Panaseer 2025 Security Leaders Report examining the cost of cybersecurity control failures and the impact of growing personal liability for security failings on security leaders. The report analyzes the findings of a survey of 400 security decision makers (SDMs) across the US and UK. It shows that security leaders feel under increasing pressure to provide assurances around cybersecurity, exposing them to greater personal risk – yet many lack the data and resources to accurately report and close cybersecurity gaps. Read Now

  • The Business Case for Video Analytics: Understanding the Real ROI

    For security professionals who may be hesitant to invest in video analytics, now's the time to reconsider. In a newly released Omdia report commissioned by BriefCam (now Milestone Systems), the research firm uncovered a compelling story: more than 85% of North American and European organizations that use video analytics achieve a return on investment within just one year. The study, which surveyed 140 end users across multiple industries, demonstrates that security technology is no longer just for security — it's a cross-organizational tool that delivers measurable business value far beyond traditional safety applications. Read Now

Featured Cybersecurity

Webinars

New Products

  • Automatic Systems V07

    Automatic Systems V07

    Automatic Systems, an industry-leading manufacturer of pedestrian and vehicle secure entrance control access systems, is pleased to announce the release of its groundbreaking V07 software. The V07 software update is designed specifically to address cybersecurity concerns and will ensure the integrity and confidentiality of Automatic Systems applications. With the new V07 software, updates will be delivered by means of an encrypted file. 3

  • PE80 Series

    PE80 Series by SARGENT / ED4000/PED5000 Series by Corbin Russwin

    ASSA ABLOY, a global leader in access solutions, has announced the launch of two next generation exit devices from long-standing leaders in the premium exit device market: the PE80 Series by SARGENT and the PED4000/PED5000 Series by Corbin Russwin. These new exit devices boast industry-first features that are specifically designed to provide enhanced safety, security and convenience, setting new standards for exit solutions. The SARGENT PE80 and Corbin Russwin PED4000/PED5000 Series exit devices are engineered to meet the ever-evolving needs of modern buildings. Featuring the high strength, security and durability that ASSA ABLOY is known for, the new exit devices deliver several innovative, industry-first features in addition to elegant design finishes for every opening. 3

  • Camden CM-221 Series Switches

    Camden CM-221 Series Switches

    Camden Door Controls is pleased to announce that, in response to soaring customer demand, it has expanded its range of ValueWave™ no-touch switches to include a narrow (slimline) version with manual override. This override button is designed to provide additional assurance that the request to exit switch will open a door, even if the no-touch sensor fails to operate. This new slimline switch also features a heavy gauge stainless steel faceplate, a red/green illuminated light ring, and is IP65 rated, making it ideal for indoor or outdoor use as part of an automatic door or access control system. ValueWave™ no-touch switches are designed for easy installation and trouble-free service in high traffic applications. In addition to this narrow version, the CM-221 & CM-222 Series switches are available in a range of other models with single and double gang heavy-gauge stainless steel faceplates and include illuminated light rings. 3