P.O. Box 521 Solomons, Maryland 20688 Office: 410-326-3001 - Fax: 410-414-8496 http://www.ciffbe.com CIFF System, Image/Video Compression - The “Next-Generation Technology” Document Prepared for: Mr. Bob Atkins Northrop Grumman IS/DTD/IIS 3200 Samson Way Bellevue, NE 68123 CIFF SYSTEM CAPABILITIES ("COMPRESSED VIDEO/IMAGE FILE FORMAT") CIFF as I-frame CIFF (each frame compressed independently from the others) and IP-frame CIFF (heuristic group of predicted frames without motion vectors) provides very low bitrates, such as full HD 1920x1080p with 384kbit/s @ 30fps, 256kbit/s @ 20fps and 128kbit/s @ 10fps in addition to highest error resilience, because CIFF does not use any motion vectors. Measured CIFF latency, before the compression by the encoder and after the decompression and playing by the decoder, is between one and two frames, (33..66ms @ 30 fps), which makes it a perfect tool for UAV, Targeting and Smart Weapons. CIFF PERFORMANCE - TESTS- PAX NAVAL AIR BASE MD TO L3 AND NGC 1) CIFF delivers- live full HD 1920x1080P 30 FPS through a 356Kbps link (or comparable Verizon air-card) from location near Pax Naval Air base Maryland to L3, NGC, locations. In addition, we deliver HD video over 123Kbps 10 FPS. We can stream HD video over Link 16. 2) CIFF delivers all three CIFF scalabilities, i.e. Quality, Spatial and Temporal all on the fly to achieve the socalled “sweet spot” for video transmission over any IP link in a secure, robust, military order. Briefly, CIFF enables the militaries fastest most elite “QOS” quality of service video system ever due to all three scalabilities changing on the fly within one frame (33ms). 3) CIFF delivers two frame latency (66ms) in the entire video chain. From capture, display, compress, stream, decompress, display. 4) CIFF delivers compression and decompression of gigapixel size images with 2 year old off the shelf notebook computer within seconds. This enables soldiers in the field to capture and send extreme resolutions through already deployed assets. 5) CIFF delivers streaming of Ultra HD (4 times the resolution of HD) with off the shelf consumer grade notebook computers. Once compressed, this high quality video can be streamed though TCDL’s and CDL’s already deployed. 6) CIFF delivers robust error resilience even without FEC (forward error correction). 1 7) CIFF will enable extremely small “micro” form factors for leave behind sensors, micro UAV’s, longer endurance, or increased payload on already deployed assets. 8) Where standard definition sensors are, still deployed CIFF enables orders of magnitude better efficiency in transmission than already deployed technologies. For example, if an “asset” uses the entire bandwidth in a CDL link, range or distance is short. If compressed with CIFF at half the capable bit-rate of CDL or less the distance or range will be extended in some cases more than twice. 9) CIFF is a linear technology, in that whatever you can sacrifice you will gain somewhere else, by selecting: resolution, frame rate, quality, and bitrate. CIFF PERFORMANCE - TESTS - VIZADA SATELLITE COMMUNICATIONS Initial Test Results – BGAN (Vizada-USA to Internet) 1920x1080 HD or 720x480 SD Source (Highway Traffic) Link Resolution Frame Rate [fps] Notes 384K Streaming 1920 x 1080 30 Good quality picture, very smooth movements 384K Streaming 1920 x 1080 15 Excellent quality picture, medium smooth movements 256K Streaming 1920 x 1080 20 Good quality picture, smooth movements 256K Streaming 1920 x 1080 10 Excellent quality picture, abrupt movements 128K Streaming 1920 x 1080 10 Good quality picture, abrupt movements 128K Streaming 1920 x 1080 5 Background 720 x 480 30 Acceptable quality picture, very smooth movement Background 720 x 480 15 Good quality picture, medium smooth movement Background 720 x 480 5 Excellent quality picture, very abrupt movement Excellent quality picture, very abrupt movement Company Confidential June 2010 2 CIFF PERFORMANCE - TESTS Drug Enforcement Agency Beverly Hills Police Department Los Angeles Police Department (Add others as you see of importance) 2 CIFF PERFORMANCE - TESTS – NGC NGC –Defense System Division NGC –Intelligence System Division NGC –Mission Systems Sector NGC –Mission Systems, Ground and Space Networks Operating Unit NGC –Aerospace Systems NGC –IT, Commercial, State & Local Group During NGC tests, CIFF Team received the following observations: CIFF preformance and capability to stream gigabyte size high-resolution ultra high-definition video compression and decompression in real-time have been verified, with NGC tests –Defense, Intelligence, Mission Systems, Aerospace Systems and IT Commercial. CIFF delivers all three CIFF scalabilities, i.e. Quality, Spatial and Remporal all on the fly to achieve the socalled “sweet spot” for video transmission over any IP link in a secure and robust order. Picture-in-Picture (PiP) display from all available streams: (the other methods can do 0,1 or max 2 PiPs in high-end systems due to very high processing requirements for each PiP - full size decode+ scale down), while CIFF can provide video-wall functionality. CIFF is designed in such way that frame decompression is done incrementally, starting from smallest resolution thus decoding can stop at any point and deliver only chosen sub-resolution frame. CIFF PERFORMANCE - LAB/FIELD TESTS – USSOCOM CIFF system tests of CIFF (“Compressed Video/Image File Format”) and “CIFF Container Format” Brief Points Provided by the Lead Team at USSOCOM: CIFF System has the ability to take in just about any video or imagery stream, WMV, AVI and MPEGJPEG and decompile it and then re-encode it with CIFF on the fly with little processor power and a delay that was measured in milliseconds. This is significant advantage because most tools have to buffer the stream, analyze the stream, correct the stream and then re-encode the stream, thus being the complete processor hogs. CIFF System has optional forward error correction (FEC) algorithm, so when the video is sent over a wireless link like satellite or a bad radio link it still has the ability to stream smooth video. CIFF System is finalized with the 256-bit AES-GCM-AEAD security module (AES in GCM IP-packet mode with authentication), but the user can drop in any encryption module they choose instead of dictating what the user will use. So one could drop any other AES, RSA or a proprietary algorithm with very little programming. The uniqueness of CIFF System is the symmetrical compression and decompression time, mathematically lossless or lossy compression performed in the same algorithm, still image and intraframe video compression using the same algorithm, integer arithmetic's without multiplication and division operations. Orders of magnitude smaller compression and decompression memory requirements, being approximately 3 lines of a single frame each for hardware or one frame each for software codec. 3 CIFF System requires 50% less bandwidth, partly due to better compression efficiency and partly due to better error resilience, requiring less percentage of FEC bits, also Servers and Data Centers will benefit from CIFF compression efficiency and power consumption reduction. How CIFF Delivers Low bit-rates: For low bit rates, CIFF select IP-frame codec instead of I-frame codec as "Encoding method", while H.264 is using I, P and B-frames. For even lower bit rates, CIFF uses optional Frame Preprocessing and Video Preprocessing on CIFF Capture side, as well as optional Frame Postprocessing and Video Postprocessing on CIFF Player side. CIFF filters are optimized for multi-threaded support, which increased speed of operation and the CIFF encoder and decoder are multi-threaded. For very low bit rates, CIFF decreases frame rate by using Temporal scale smaller than default 100%. For example, 50% will show half of the original frame rate, while 75% will display 3/4 of the original frame rate. The concluded laboratory/field tests of CIFF System (July 2008 to July 2010), were performed in the Unclassified Test Bed (UTB) laboratory in the presence of USSOCOM, USCENTOM, NSA, NGA and CIA representatives, under the supervision of USSOCOM. CIFF team was not present, the feedback we received is: “CIFF System met all claims and has already performed 100% beyond their expectations”. PROJECTS OF IMPORTANCE TO USSOCOM During testing at UTB, the Lab asked for specific applications of “CIFF Video/Image File Format” and “CIFF Container Format” which required specific developments, focusing on the projects of importance to SOCOM such as: Mobile Ad-Hoc Networking Technology (UAV + small battery powered ground units) SIGINT (Signal Intelligence) Payloads for UAS Unattended Persistent Surveillance Advanced Digital Image Processing and Compression Techniques Hi-Definition Video Anywhere, Anytime Downsized/Miniaturized Radio and Imaging Technology 3D Active Sensors Advanced Massive Storage Solutions (with lossless CIFF compression as add-on) Secure High-Speed Wireless Networking Technology Net-Centric Enterprise System (NCES) Technical Surveillance Equipment (audio and video surveillance systems) Video & Audio Studio Modernization Technologies Video & Audio Processing Enhancement Technologies Media dissemination and reception in telephone, cell phone devices, including text messaging, video and television streaming, etc. CIFF SYSTEM TECHNOLOGY MATURITY CIFF software application interfaces were 100% completed during UTB tests, so delivering solutions for “SOCOM projects of importance” will require a small development effort on the application interfaces per 4 client requirements, estimated at no more than 5% of the total effort. CIFF New Design & Architecture is evident in software size: CIFF.dll 1.2MB (common for both CIFF Capture and CIFF Player). CIFF Capture 1.8MB CIFF Player 1.7MB CIFF Capture + CIFF.dll = 3MB CIFF Player + CIFF.dll = 2.9MB CIFF Capture + CIFF Player + CIFF.dll = 4.7MB 1. CIFF Technology provides: a) Smaller power consumption of UAVs, UGVs, LAMs, ground control stations, computing centers and portable devices: toughbooks, desktops, notebooks, netbooks, PDAs, mobile phones and players b) Smaller heat dissipation of UAVs, UGVs, LAMs, ground control stations, computing centers, and portable devices c) Smaller energy for production of encoders/decoders due to smaller weight, size and complexity d) Smaller energy for delivery of encoders/decoders due to smaller weight and size e) Smaller batteries in portable devices f) Longer battery lifetime in portable devices g) Faster Web server (faster reading from hard drives and transmission of smaller CIFF images and video files instead of bigger JPEG images and MPEG-2 video files) h) Faster Web browsers (faster receiving and decompression of smaller CIFF images and video files instead of bigger JPEG images and MPEG-2 video files) i) More than 50% reduction of JPEG images and MPEG-2 video related Internet and Intranet traffic without noticeable quality loss j) Reduced IT power consumption (Watts of power per IT delivered to users) k) Reduced heat dissipation, Carbon footprint (CO2 emission) and energy costs to owners l) Increase of the efficiency of datacenter utilization (more clients per server) m) Increase in the efficiency of remote client computer utilization by faster Web page access & download n) Affordability due to low complexity and low cost Besides features from 1. CIFF codec (encoder and decoder) major features versus current state-of-the-art methods (such as MPEG, MJPEG or H264) are: 5 Smaller I-frame CIFF bitrate for the same quality in comparison with current state-of-the-art still image and intraframe (I-frame) video compression methods. Similar I-frame CIFF bitrate for the same quality as best state-of-the-art interframe (IPB-frames) video compression methods for fast and medium video. Similar IP-frame CIFF bitrate for the same quality as best state-of-the-art interframe (IPB-frames) video compression methods for any video. Spatial (resolution extraction) scalability, i.e. inherent extraction of lower resolutions from higher resolution bitstream (original resolution, original / 4, original / 16, original / 64,...) in the decoder. Quality (processing reduction) scalability, i.e. inherent extraction of lower quality frames from higher quality frames in both encoder and decoder. Temporal (frame dropping) scalability, i.e. dropping of any number of frames in both encoder and decoder Highest error resilience due to I-frames or unique IP-frame format with error concealment. No error propagation from frame to frame in case of I-frame CIFF. Limited error propagation from frame to frame in case of IP-frame CIFF. The same speed of I-frame compression and decompression. Twice slower IP-frame compression than I-frame compression. The same speed of I-frame and IP-frame decompression. The same latency of I-frame and IP-frame compression and decompression. Very low latency of one frame for I-frame or IP-frame encoder plus decoder combination. Integer arithmetic without multiplication and division operations. Orders of magnitude smaller compression and decompression memory requirements, being approximately 3 lines of a single frame each for hardware or one frame each for software codec. Smallest weight of both encoder and decoder. Smallest size of both encoder and decoder. Inherent parallelism due to encoding of the same frame or subsequent frames on separate CPU cores. Inherent parallelism due to decoding of the same frame or subsequent frames on separate CPU cores. Multithreading with CPU core balancing in both encoder and decoder. Portability to any platform, Windows DirectShow, Linux, or any other. Direct support for 4:4:4, 4:2:2 and 4:2:0 YUV and grayscale formats. Faster and better operation with increasing resolution than current methods, which means that both near and far future belongs to CIFF. Besides features from 2, CIFF provides the following network benefits: Smaller bandwidth. Faster transmission. Smaller congestion. UDP/IP and UDP Lite transmission possible. No need for TCP/IP Retransmission. Instantaneous switching between streamed video channels. IP Payload Error Corrections using forward error correction (FEC). Reconstruction of lost IP Packets using additional correction packets. 6 IP Header Error Corrections (optional) for transmission in closed end-to-end systems, for the reconstruction of IP Packets with damaged IP Header for ultimate infrastructural solutions. CIFF Dynamic Bandwidth Allocation (low latency bandwidth change on frame-by-frame basis). Faster Quality of Service (QoS). Fast JPEG, MPEG-1, MPEG-2 and H.264 Transcoding. Extremely fast opening of Web pages with image and video. CIFF provides seamless plug-in approach for other codecs. Simple upgrades in the future. Inherent compatibility of CIFF container format, with already archived streams (no need to reformat). Inherent compatibility of old container format with new container format (no need to upgrade). Simple upgrades in the future. CIFF COMPRESSION DELIVERED TO THE END-USER: Question: If data is compressed on the server-side (1 GB file compressed to 10 MB file) and delivered to the end-user, will the end-user receive the data in compressed form (10 MB), or will it be de-compressed (1 GB)? Answer 1: In case of downloading, depending on user selection, CIFF Player can: 1) receive 10MB file, decompress and play decompressed file on user display, or 2) receive 10MB file, store 10MB file, decompress and play decompressed file on user display, or 3) receive 10MB file, decompress, store 1GB file on a hard drive and play decompressed file on user display. Answer 2: In case of streaming, depending on user selection, CIFF Player can: 1) receive 10MB bitstream, decompress and play decompressed bitstream in real-time on user display, or 2) receive 10MB bitstream, store 10MB file on a hard drive, decompress and play decompressed bitstream in real-time on user display, or 3) receive 10MB bitstream, decompress, store 1GB file on a hard drive and play decompressed bitstream in real-time on user display. WHY CIFF AND NOT THE "COMPETITORS" - “HOW CIFF DIFFERS FROM "COMPETITORS" CIFF "competitors" did not invent new codec as CIFF team did. They are using existing MJPEG, MJPEG2000, MPEG-2, MPEG-4 or H264 video/image and compression technology, which are unable to support neither current nor future requirements, vital for the government and commercial markets. CIFF System is completely new - image/video compression algorithms in architecture and design. CIFF Quality of Video/Moving Image Compression – streaming high-resolution ultra high-definition video compression and decompression in real-time; the compression and decompression of high-resolution, high-definition and standard-def video at speeds faster than real-time; symmetrical times for compression and decompression with both being faster than existing methods for both lossless and lossy compressions; latency in video transport in milliseconds that allows real-time targeting, real-time two-way videoconferencing for critical operations; and the use of video/moving image frames to produce high-resolution still image photos with pixelto-pixel accuracy from any frame selected on the video. “Network Centric CIFF” supports both network centric warfare and IPTV requirements, through the maximization of the coding efficiency and error resilience by providing packetizing operation inside CIFF Image/Video Codec instead of relying on an external software or hardware packetizer. CIFF System provides high operational value due to solving all practical problems with video/image capture, compression, storage, 7 encryption, forward error correction, transmission, decompression and display, thanks to its unique set of features confirmed by best video/image specialists of several prime government contractors and commercial corporations. CIFF System is designed and developed to deliver precisely what it claims with absolute accuracy and guaranteed performance. Detailed CIFF comparison with MJPEG, MJPEG2000, MPEG-2, MPEG-4 and H.264 can be provided upon request. CIFF SYSTEM & GIG COMMUNICATIONS SYSTEMS CIFF System will deliver the next generation architecture configuration to GIG communications systems, necessary to support global requirements during next 20 + years, and at the same time extending life to current platforms, by providing easy transition from the old platforms to the Next-generation Hybrid Systems and Products. CIFF significantly enhance the quality of image and video transmissions over wired and wireless networksprovided connectivity, including low data rate pipes, used by many global networks. CIFF PERFORMANCE - BANDWIDTH MANAGEMENT-FIXED AND DYNAMIC BANDWIDTH CIFF DYNAMIC BANDWIDTH PROCESSOR CIFF provides opportunity to perform dynamic bandwidth allocation on a frame-by-frame basis CIFF can compress video for either: · chosen fixed quality of each frame · chosen fixed bitrate of each frame · chosen variable quality of each frame · chosen variable bitrate of each frame Variable frame rate, with chosen fixed bitrate, utilizes our fast compression and our ability to play variable frame rate where we save bandwidth by reducing frame rate where it is visually possible and reusing that savings to improve frame quality. In slow scenes we have less fps and more details in the frame while in fast scenes we have more fps and fewer details. Visually, that is very much justified and more desirable. Fixed quality is usually a better choice for downloaded movies, while fixed bitrate can fulfill stringent telecommunication channel requirements. However, CIFF can also compress for chosen variable quality or bitrate of each frame, and additionally provide dynamic bandwidth allocation on a frame-by-frame basis, because every frame can have the different bitrate / quality / frame size, while state-of-the-art MPEG based methods require seconds to settle between two different chosen bitrates. In addition to classic delivery system architecture with fixed quality or bitrate through any transmission media, including fiber optic, ADSL2, wireless or satellite, between a video server and a set-top box or PC software in either near or distant homes, CIFF can be delivered using the dynamic bandwidth allocation delivery. 8 CIFF Dynamic Bandwidth Processor: Namely, the video server can comprise the highest quality copy of the content, for example 1080p HDTV at 15Mb/s, which can be dynamically sealed in real-time using fast CIFF Dynamic Bandwidth Processor into any lower bitrate, for delivering to CIFF enabled device (set-top box, PC, or any mobile device with a screen), and thus varying bitrate and quality from near to far homes, with actual resolution of display. FIBER-OPTIC & CABLE & SATELITE & ADSL2 + PROBLEMS: The video server in the current delivery systems comprises either only one copy of the content, which quality is limited by the available bitrate for homes far from the video server, so all homes will get the same (bad) video quality independently of a distance between the video server and homes or several copies of the content encoded in different bit-rates and resolution. This model is time & money consuming in preparation of content on the server, requires expensive equipment for extensive time and still delivers sub-optimal solution. CIFF Advantage is that stream starting from the best quality source, read from the storage is dynamically optimized (scaled for best target bitrate, framerate, resolution, and quality) for best viewing experience for each customer optimizing not only bandwidth but power on display device as well. Even most disadvantaged customers at far end of link reach will not be left behind. CIFF Format at Full Quality & Intelligently Applying Current Channel Bandwidth: CIFF takes high quality source (for example 30+ Mb/sec 1920x1080p60 pre-encoded in CIFF format at full quality) and then for each customer it is scaled on the server, to exact target display windows size, encoded to current channel bandwidth intelligently applying available methods to maximize user experience in any given moment. On top of that we consider remaining power and consumption rate on user display device and calculate optimal quality for available power to ensure that device will have enough power to finish current movie or other program. This is possible because CIFF is at least two orders of magnitude less computationally demanding than competition and it does not require specialized hardware. Everything is done on standard Intel/AMD processor. CIFF BITRATE AND QUALITY FOR NEAR AND FAR HOMES: The video server in CIFF delivery systems can use the same delivery fixed bitrate method as in current delivery systems. However, CIFF can deliver high-quality video for homes close to the video server and still deliver best possible video for homes far from the video server. CIFF PROVIDES HIGHER AVERAGE BITRATE FOR ALL HOMES: CIFF provides higher average bitrate than state-of-the-art MPEG codecs for all homes, starting from homes close to the video server to homes far from the video server, plus single-frame latency for switching between channels, unlike seconds latency for MPEG based methods. CIFF PROVIDES DYNAMIC BANDWIDTH ALLOCATION: CIFF can easily provide dynamic bandwidth allocation by decreasing bitrate for currently transmitted channels in favor of newly transmitted channels in a matter of one frame. For example, one HDTV channel is transmitted through ADSL2 lines at the best available quality, which will be decreased in order to provide the additional HDTV channel or two SDTV channels. Visual quality of CIFF image/video compression is selected by: Quality (approximate bandwidth selection) Compression ratio (exact file size selection) Target size of each frame (accurate bandwidth) Target bitrate (exact average bandwidth selection with chosen maximum frame size) 9 CIFF compression ratio (CR) of: 2.5:1 to 3.5:1 is mathematically lossless 15:1 is visually lossless for best experts 50:1 is visually lossless for most viewers 100:1 is visually lossless for high resolutions 400:1 is visually lossless for large images and preprints 800:1 is visually lossless for many medical and astronomical images CIFF spatial (resolution) scalability benefits are: Simultaneous existence of all resolutions in the same bitstream Instant resolution change on frame-by-frame basis Instant bandwidth change on frame-by-frame basis Encoder power savings Decoder power savings Direct extracting of lower resolution video streams from higher resolution video stream without decompression and subsequent compression UHDTV extraction in a control station from UHDTV video stream HDTV extraction in a notebook from UHDTV video stream SDTV extraction in a palm top from UHDTV video stream CIF extraction in a PDA from UHDTV video stream Switching between one higher resolution video and several lower resolution videos on frame-by-frame basis CIFF AND OTHER IMAGE CODECS NUMBER OF INSTRUCTIONS PER COLOR PIXEL NUMBER OF INSTRUCTIONS PER GRAYSCALE PIXEL INSTRUCTIONS PER PIXEL ENCODING COLOR DECODING INSTRUCTIONS PER PIXEL ENCODING GRAYSCALE DECODING 6522 4109 2195 2173 636 142 298 CIFF- CIFF JPEG JPEG2000 166 327 195 CIFF- CIFF JPEG JPEG2000 73 170 498 CIFF- CIFF JPEG JPEG2000 89 175 89 CIFF- CIFF JPEG JPEG2000 10