Video Processing in an
Open Source
Environment
Brian Peebles
Chief Technology Officer
Dialogic Evolution
 TDM to IP Transition Leadership
 Extend into Web communication and open
source ISV innovators
 Enabling Video IP Streaming Value Added
Services
 Extends Mobile VAS Segment Leadership
 Extends Technology Enabling MSS Leadership
 Video Algorithmic and Analytics Leadership
 Extends Technology Enabling MSS Leadership
− Fax Segment MSS Leadership
 Deeper Service Provider Segment Products / Customers
− Service Provider gateway and IP media server
 Converged Communications Technology Enabling Market Segment Share Leadership
− Dialogic “pioneer” history, relationships and patent portfolio
− Enterprise Gateway
 Established SS7 / Signaling Part of Business
 Established HMP as core to Dialogic customer value proposition
2006
2007
2008
“VIDEO
IS THE IS
NEW
VOICE”™
“VIDEO
THE
NEW
VOICE”™
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 2
Video-Enablement of Traditional VAS Services
Location Based Service
Voice Mail
IVR
SMS
Conferencing
CRBT
Video Enabled LBS
Video Mail
IVVR
Video SMS
Video Conferencing
VRT
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 3
Dialogic has an extensive history in Video
 Already many 10s of thousands of ports of video
applications built on Dialogic
 First system shipped in early 2005
 Currently there are dozens of active deployments of
Dialogic Video Solutions involving
–
–
–
–
Video Telephony,
Video Enhanced Services
Mobile Video.
all Geos – NAR, APAC, CALA, EMEA, BRIC
 We are now setting the pace for advanced techniques
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 4
Case Study – Video Chat – Description
 Australia New Market – 3G Video Premium Rate for the largest
provider of both local and long distance telephone services,
mobile services, dialup, wireless, DSL and cable internet access
in Australia.
 Service and Development provided by a local Dialogic Partner
as a Video Hosting Bureau (ASP)
 Overview
 Live Operator Chat & Video Portal
 3G to SIP Softphone (High Quality) (and 3G)
 H.264/MPEG4 & AMR
 Billing - Premium Rate & Credit Card
 SMS Subscription Notification
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 5
Case Study – Video Chat - Architecture
3G Video
Handset
Streaming
Server
Customer Platform
3G Video
Dialogic MMA
Gateway
3G
Mobile
3GH.324M
Video Chat
Platform
RTSP
Media
App Server
VoiceXML
Dialogic
Media Engine
Media Server
Dialogic DNI
Dialogic
Media Engine
Web/IP
TSL
IP SoftPhone
SS7 & IN
CAMEL/IN
AP
SCP
MRCP
ISDN/CAS
ISUP
2/2.5 G
Mobile
VOIP
Speech
ETSI ES201 671
IP/SEC
TDM
XML/SOAP
Web Services
IP
GSM
Handset
Landline
Phone
Speech/T
TS
Lawful Interception
Transaction Recording
IP Handset
Business
Systems
IP VideoPhone
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 6
Note on Video Clips
 Due to Codec and Copyright limitations, the video clips
used during the live presentation at ClueCon have NOT
been included in this posted version.
 Please contact jeff.dworkin@dialogic.com for more
information.
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 7
Innovation At Work
 Video Telephony
Video Security
– Interactive Video
Response
– Video Security
– On Line Banking
On Line Banking
 Video IP Streaming
– Lets go to the mobile
device
7-9 months development cycle
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 8
“Love Meter”
 Application: Real-time voice analysis for mobile users
–
–
–
–
Detects range of emotions during session
Updates caller with current “love level”
Premium features: recording function
Final session analysis by SMS/MMS or Web
 Developer & Host: EGTEK/Maxis
 Platform:
– EGTEK 3G Video Solution Suite
– Based on Dialogic® HMP Software
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 9
Video Challenges
 Handset Compatibility and Interoperability
 Maintaining Quality
– Video Compression Techniques
– Capture/Transcode Quality
– Rate Control
 Video Analytics for Advertising and Security
– Pattern Matching
• Logo Detection
– Image Analysis
• Digital Watermarking
• Video Forensics
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 10
Why do we need Video Compression?

Standard Definition (SD) Video: 720x480 @ 30 frames/second (fps)
requires:
720 x 480 pixels 30 frames 3 colors
8 bits
---------------------- x -------------- x ------------ x -------- = ~250 Megabits/sec (Mbps)
frame
sec
pixel
color
Typical video delivery pipes

Compression Factor Required
Dialup Modem: 48 Kbps
~5000
ISDN: 128 Kbps:
~1900
T1: 1.5 Mbps:
~160
T3: 45 Mbps:
~5
H.264 is leading default with similar quality at half the bit rate of H.263 or MPEG-2
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 11
H.264 Codec Optimization:
Subjective Comparison
Noise and artifacts impair video frame quality
Quality degradation throughout the video frame
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 12
H.264 Codec Optimization:
Subjective Comparison
Stefan, CIF 30fps
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 13
Advanced Algorithms: Bit Rate Control
 To be incorporated in Dialogic® Host Media Processing Software Release 4.1
 First Dialogic® product release using Dialogic® Media Labs technology
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 14
Bit Rate Control
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 15
Advanced Algorithms: Error concealment
Artifacts are concealed using motion vector estimation techniques
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 16
Advanced Algorithms: Perceptual Quantization
Original
Perceptual Quantization
Normal Quantization
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 17
Measuring / Monitoring Video Quality
Video Bit Stream
Target use case
• Ensuring content is “advertiser-friendly”
Goal
• Measure quality and quantify result
• Compare “score” against parameters
• If quality is in the “good” range, then video is useful
for advertisers
Analyzes the video content itself
• Not the “protocol”
• Not the “network”
• Measurement of the user experience
Video
Capture
Quality
Video
Coding
Quality
User Definable
Classification
Good
Parameters:
• Motion Blur
• Shakiness
• Inconsistency
• Contrast
Parameters:
• Blockiness
• Blur
• Ringing
Unsure
Bad
Assessment
score
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 18
Video with Good Capture Quality
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 19
Video with Bad Capture Quality
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 20
Pattern Matching and Image Analysis
 Identifying objects within the stream
– Advertising applications
– Identifying persons of interest
– Medical imaging/diagnosis
– Video search applications
Views = 10 Eyeball seconds = 4.09
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 21
Logo Detection / Tracking
 Demonstration identifies the Dialogic logo within our corporate video
 Two-step process:
– Identify the logo (in different sizes, even if partially hidden)
– Track the duration of time the logo is visible
 Highlight the logo when it is recognized…
 … and keep track of number/duration of appearance
 In some cases (quick appearance, hidden) we will not recognize/track
the logo (not a useful appearance for advertising)
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 22
Dialogic Corporate Video Logo Tracking Demo
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 23
Digital Watermarking
 Most obvious application is to reduce piracy
 Also has applications in the enterprise space
– Ensuring authenticity of video delivery to your customers
– Tracking receipt of sensitive material to the intended audience
 Additional consumer applications
– Tracking what videos are being watched by a consumer
– Useful for rating services (what people have watched)
– Ad insertion/tracking (what advertising did people see?)
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 24
Video Forensics: Is seeing believing?
Top:
Forgery
picture
Bottom:
Two
original
pictures
Los Angeles Times on March 31, 2003
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 25
Project DiaStar™
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 26
DiaStar Messaging
 Solution for the high-end of the open source Market
– Creates a Client/Server Architecture that allows
Asterisk/FreeSWITCH/Other developers to continue to work
in their native environment but still get access to the feature
set provided by Dialogic.
– Companies that are using open source but are not happy with
the scalability, redundancy and reliability or those that would
try open source except for concerns about those same
issues.
– Companies are using or would use open source except for
missing features that we can provide via DiaStar
• First Available Feature: Dialogic Perfect Call Progress Analysis
and Answering Machine Detection
• Next Feature: Video Support
www.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 27
Dialogic, Dialogic Pro, Brooktrout, Diva, Cantata, SnowShore, Eicon, Eicon Networks, NMS Communications, NMS (stylized), Eiconcard, SIPcontrol, Diva ISDN,
TruFax, Exnet, EXS, SwitchKit, N20, Making Innovation Thrive, Connecting to Growth, Video is the New Voice, Fusion, Vision, PacketMedia, NaturalAccess,
NaturalCallControl, NaturalConference, NaturalFax and Shiva, among others as well as related logos, are either registered trademarks or trademarks of Dialogic
Corporation or its subsidiaries (“Dialogic”). The names of actual companies and products mentioned herein are the trademarks of their respective owners. Dialogic
encourages all users of its products to procure all necessary intellectual property licenses required to implement their concepts or applications, which licenses may vary
from country to country. Dialogic may make changes to specifications, product descriptions, and plans at any time, without notice.
USE CASE(S)
Any use case(s) shown and/or described herein represent one or more examples of the various ways, scenarios or environments in which Dialogic products can be
used. Such use case(s) are non-limiting and do not represent recommendations of Dialogic as to whether or how to use Dialogic products.
2/09
www.dialogic.comwww.dialogic.com
Company Confidential • © Copyright 2008 Dialogic Corporation. All rights reserved.
Slide 28