Testing of an Intelligent Video Surveillance for a Video Analytics company

Executive Summary

Our customer's intelligent surveillance software algorithm enables motion detection more effectively than any human can. The software pro actively monitors numerous simultaneous video feeds, track objects, classify each object and compare the behavior of those objects to the given set of rules. The software has the ability to identify, classify, and understand the behavior of events (for example, the software can tell the difference between a car and a person and it can tell what the object is doing). The main purpose of the Intelligent surveillance system is to provide real time event detection based upon established rules. Users then receive alerts in real time, allowing them to pro actively address threats and other events of importance within their environment.

The customer engaged ennovate to perform Software QA and Testing on their surveillance software. ennovate set up a hardware/software lab in its facility and carried out regression, functional, ad-hoc and installation testing in phases. Over the past 3 years, ennovate has executed over 2000 test cases, enabling various successful revisions of this product.      

The Customer

• Intelligent video analytics software from our customer is based on years of advanced computer vision expertise, resulting in robust and field-proven technology that turns video data into information. The practical uses for this data extracted from video are virtually limitless - from real-time electronic notifications about perimeter breaches to determining department store shopping patterns, from detecting tail-gaters at secure entryways to measuring traffic density in tunnels or from triggering alarms on stolen equipment to saving energy in unused building space

Project Overview

• Setup a lab for testing which includes configuring hardware provided by customer and installing the software to test
• Manual testing is carried out in following phases:
  • Test Design: This phase deliverables are Test Sets, Test Groups, Test Suite Design status documents. Also Test System Components and Test System diagrams were prepared during this phase
  • Test Configuration: This phase deliverables are Test cases, test steps, test procedures and test data. This phase also involves maintaining the test cases, test steps, test procedure and test data
  • Test Execution: The process is carried out after Test Configuration is completed. All the test case execution is carried out in this phase. At the end of this phase Test results are delivered to the customer. Bugs are reported using Customer’s Bug Tracking tool
  • Test Analysis: In this phase, analysis of test case execution are carried to know the overall testing efforts effectiveness
  • Test Reporting : The phase deliverables are Test execution summary report, test analysis summary report, defect report, summary report and test result summary report
• Tests:
  • Regression testing
  • Functional testing
  • Ad-hoc testing
  • Installation testing

The Highlights

• Prepared and executed around 2000 test cases to ensure that the product is bug free
• In period of 3 years around 10 projects were executed in the given time line (on time completion)