International Telecommunication Union The Impact of Video Surveillance Technology on Future Video Coding Standards Dr. Michael J. Horowitz Office of the CTO CoVi Technologies ITU- T VICA Workshop 22-23 July 2005, ITU Headquarter, Geneva Talk Overview ITU-T o Background • Evolution of video surveillance • System overview • Video coding standards in surveillance o Video feature requirements o System cost considerations o Concluding remarks dates ITU- T VICA Workshop 22-23 July 2005, ITU Headquarter, Geneva 2 Evolution of Video Surveillance ITU-T Imaging Vidicon (B&W) CCD Fiber Transport Megapixel IP Cameras Coax RF IP/Ethernet UTP Digital Multiplex Storage VCR 1970 dates 1980 DVR 1990 ITU- T VICA Workshop 22-23 July 2005, ITU Headquarter, Geneva NVR 2000 3 Evolution of Video Surveillance ITU-T Analog Video to DVR Megapixel IP Camera (NTSC with CIF Encoding) dates ITU- T VICA Workshop 22-23 July 2005, ITU Headquarter, Geneva (1280x720) 4 Video System Overview ITU-T Centralized IP Video Distributed IP Video ` ` NVR dates ITU- T VICA Workshop 22-23 July 2005, ITU Headquarter, Geneva 5 Video Coding Standards in Surveillance ITU-T o Simplifies exchange of video information • Component-to-component • Manufacturer-to-manufacturer o Compatible with feature requirements o Reasonable impact on system cost dates ITU- T VICA Workshop 22-23 July 2005, ITU Headquarter, Geneva 6 Video Feature Requirements o Temporal scalability (active JVT topic) ITU-T • Graceful degradation of archive video • Heterogeneous environments • Guard on patrol • Central monitoring station • Forensic analysis o Error resilience ü o Flexible source formats dates ü ITU- T VICA Workshop 22-23 July 2005, ITU Headquarter, Geneva 7 Feature Requirements (continued) ITU-T dates o Spatial scalability (active JVT topic) • Graceful degradation of archive video • Heterogeneous environments • Selectively code regions of interest ITU- T VICA Workshop 22-23 July 2005, ITU Headquarter, Geneva 8 Feature Requirements (continued) o Low latency (<350ms one-way delay)ü ITU-T • Real-time viewing • Remote camera control o Trick modes for archival playback • Intra-pictures • SI and SP pictures (H.264) o Content retrieval from archive • Time stamp-based • Alarm event-based (meta data) dates ITU- T VICA Workshop 22-23 July 2005, ITU Headquarter, Geneva ü ü 9 Feature Requirements (continued) o Video data integrity ó • Error detection ITU-T • Tamper resistance o Alarm events from video content û • Motion detection • Object tracking • Face recognition dates ITU- T VICA Workshop 22-23 July 2005, ITU Headquarter, Geneva 10 System Cost Considerations o Computational complexity ITU-T • Encoding at camera û • Hardware cost • Power dissipation ⇒ Heat o o Increased sensor noise Increased mechanical cost • Multiple simultaneous decoders o Coding efficiency ó • Video transport: cost per kilobits / second • Video storage: cost per megabyte dates ITU- T VICA Workshop 22-23 July 2005, ITU Headquarter, Geneva 11 Concluding Remarks ITU-T o Existing & emerging video coding standards meet most needs o Recommended future enhancements • Reduced computational complexity • Enhanced tools for video data integrity • Tools to facilitate video event generation • Improved coding efficiency dates ITU- T VICA Workshop 22-23 July 2005, ITU Headquarter, Geneva 12