©2013 Avaya Inc. All rights reserved
February 26-28, 2013 | Orlando, FL
The Impact of Network on
Video Quality
Anatoli Levine
Director, Product Management
Radvision, an Avaya Company
#AvayaATF
©2013 Avaya Inc. All rights reserved
February 26-28, 2013 | Orlando, FL
Outline
• Importance of Video
Quality
• Factors affecting QoE
• QoE challenge
• Video Quality
measurement
• Steps in implementing
Video
• Evident Monitoring
Solution
©2013 Avaya Inc. All rights reserved
3
February 26-28, 2013 | Orlando, FL
The Importance of the Video Quality
• Video services are becoming a popular mode of
communication
• The visual sense is extremely important
• How do network conditions affect Voice & Video
Quality?
• Is your network ready to provide Video services?
©2013 Avaya Inc. All rights reserved
4
February 26-28, 2013 | Orlando, FL
Video is Everywhere!
Video Conferencing
& Telepresence
Video Streaming
©2013 Avaya Inc. All rights reserved
IM &Video
Messengers
Social Networking Sites
IP Video Surveillance
Video Web Collaboration
5
Video Conferencing
ASPs
Video Mobile
February 26-28, 2013 | Orlando, FL
Parameters Affecting Quality of Audio ?
Sender
Receiver
Encoder
Packetize
Distortion
& delay
Delay
IP
Network
Loss, Delay,
Jitter,
Ordering,
Duplicate,…..
Unpack
Delay
Jitter
buffer
Delay &
Loss
Decoder
Codec
impairment
Delay
End-to-end perceived voice quality (MOS)
©2013 Avaya Inc. All rights reserved
6
February 26-28, 2013 | Orlando, FL
Why Interactive Video Is So Unique ?
250ms
Interactive video is sensitive to latency
x20
Video is high capacity
1:400
Video is error sensitive
2-20
Video traffic is not uniform or constant
Packets/frame
+45ms /
-75ms
Interactive video is sensitive to lip sync
Source: IEEE publications
©2013 Avaya Inc. All rights reserved
7
February 26-28, 2013 | Orlando, FL
Parameters Affecting Quality of Experience
Encoding and Compression
Frame per seconds
©2013 Avaya8 Inc. All rights reserved
February 26-28, 2013 | Orlando, FL
Audio / Video Quality Scoring
• Mean Opinion Score (MOS)
• The arithmetic mean of all individual observations,
ranging from 1 (Bad) to 5 (Excellent).
©2013 Avaya Inc. All rights reserved
9
February 26-28, 2013 | Orlando, FL
Questions
Pre-deployment
• Can my network support full video services ?
• What is the expected video / audio quality after
full deployment ?
• Do I expect to have interoperability issues ?
Post-deployment
•
•
•
•
In-Service
• What is the status of the calls on my network ?
©2013 Avaya Inc. All rights reserved
Why do I suffer from pixelated video / freezes ?
How network conditions affect my video ?
Why do I have interoperability issues ?
Why do I have audio issues ?
10
February 26-28, 2013 | Orlando, FL
Video Quality Measurement
Methodology
©2013 Avaya Inc. All rights reserved
11
February 26-28, 2013 | Orlando, FL
Media Quality Becomes an Issue
• Unmanaged
Networks
• Varying Network
Capacities
• Varying Devices
©2013 Avaya Inc. All rights reserved
12
February 26-28, 2013 | Orlando, FL
Factors Affecting Video Over IP Quality
Source: Packet loss, for instance, is considered by many to be the most annoying
disturbance in interactive video communications. In fact, in a poll question we posted
in a recent webinar on user experience, 46% of the participants chose packet loss as
the factor that affects the quality of real-time video most.
©2013 Avaya Inc. All rights reserved
13
February 26-28, 2013 | Orlando, FL
Video Quality Measurement Methodologies
“Full-Reference”
Based
©2013 Avaya Inc. All rights reserved
“No Reference”
Online
Real-time
14
“No Reference”
Image Based
February 26-28, 2013 | Orlando, FL
Video Quality Full-reference
• Full-reference allows you to perform a Video Quality
analysis and compare the original video sequence to a
degraded one:
• Unique synchronization algorithm developed by
Radvision take on consideration:
• Different frame rates, Resizing, profile, codec, bw….
• Partial picture, Picture in picture, Compression artifacts
• Black period, Welcome frames, Logo additions, Title additions
• Video Quality algorithm based on frame analysis
©2013 Avaya Inc. All rights reserved
15
February 26-28, 2013 | Orlando, FL
Video Quality Real-time Measurement
• Video Quality Online Standards
• ITU G.1070 performs global video quality estimation
based on network and codec parameters that are
unprecedented in scope to guarantee that the tool
maintains the highest correlation with video quality test
results measured by individual perception.
• ITU-T G.1070 (Objective Video Quality)
• ITU-R BT.500-9. (Subjective)
• Human Vision Survey
• Extensive & Automated Human
Vision survey based on Full-Reference
• Radvision Innovative techniques
©2013 Avaya Inc. All rights reserved
16
February 26-28, 2013 | Orlando, FL
Human Vision Database
• Video Quality Surveys
•
•
•
•
Unprecedented in scope (x1000 inputs)
Variable contents: video conferences, motion pictures…
Variable artifacts: blockiness, packet loss, blurriness…
Worldwide, different viewing preferences
©2013 Avaya Inc. All rights reserved
17
February 26-28, 2013 | Orlando, FL
Extensive & Automated
Human Vision Survey
• Guarantees high correlation with Human Perception
• Database enhanced with state-of-the-art RV FullReference algorithms
• RADVISION’s Human Vision Database was enhanced with
thousands of video samples and their references, designed for
objective analysis.
• We applied state-of-the-art RV Full-Reference (FR) standard
Video Quality algorithms, and obtained a Full-Reference
recommended Video Quality score
©2013 Avaya Inc. All rights reserved
18
February 26-28, 2013 | Orlando, FL
Innovative VQ Measurement
Algorithms
• Additional algorithms for
performing global video
quality estimation, based on:
• Packet-loss propagation
• Quality score based on
compression level
• Bit-rate and frame-rate
fluctuation as an indication of
quality
• Quality score based on the
dynamism level of the video
• Reason for Video Quality
degradation, as well as
optimization methods
©2013 Avaya Inc. All rights reserved
19
February 26-28, 2013 | Orlando, FL
Effect of Packet Loss Propagation
• Advanced techniques for packet loss propagation
analysis, based on:
• Refresh rate – Intra frame or Intra macro blocks
• Packet loss percentage
• Packet loss patterns
Standard
RV
VMOS: 4.4
VMOS: 4.4
No Packet loss
©2013 Avaya Inc. All rights reserved
Standard VMOS: 3.4
RV
VMOS: 2.4
Packet loss
20
Propagation of
Packet loss
February 26-28, 2013 | Orlando, FL
Video Quality, Image-Based
• Performs Video Quality analysis without
reference and without network parameters,
based on image quality:
• Blockiness, blurriness, image loss, …
• Video MOS is the aggregate of video
metrics
• CPU consumption is very extensive
©2013 Avaya Inc. All rights reserved
21
February 26-28, 2013 | Orlando, FL
How to Detect Image Quality Loss
• Video packet loss concealment detection based on
image content
• Innovative research presented in 16th European
Signal Processing Conference (EUSIPCO2008)
• Different algorithm for I-frame and P-frame
• Over 90% detection precision
©2013 Avaya Inc. All rights reserved
22
February 26-28, 2013 | Orlando, FL
Steps in Implementing Video
©2013 Avaya Inc. All rights reserved
23
February 26-28, 2013 | Orlando, FL
Steps in Implementing Video
Real Time Monitoring
Monitor
Optimize
QoE
Test and Optimize Your
Network
Assess
Network Readiness
for voice & video
©2013 Avaya Inc. All rights reserved
24
February 26-28, 2013 | Orlando, FL
eVident Video Monitoring
©2013 Avaya Inc. All rights reserved
25
February 26-28, 2013 | Orlando, FL
eVident Monitoring Solution
Video Network Monitoring - Market Segment
Service Provider
Enterprise
Video Network readiness
Video Network readiness
Room and network
assessment
Pre-Call assessment
Proactive monitoring
and management
Room and network
assessment
Video Service readiness
Proactive monitoring
and management
Improving Video services
Improve network visibility
System Integrator
Network readiness
as service
Video Service availability
Proactive monitoring
and management
Real-time monitoring
Easier deployment
Complete Video Monitoring Solution
©2013 Avaya Inc. All rights reserved
26
February 26-28, 2013 | Orlando, FL
eVident Monitoring Solution
The Intelligent and Easy Way to Monitor your Video Network
Radvision provides a software-based monitoring solution
for use during various stages of the network deployment cycle:
Real Time Video
Monitoring
Pre & Post
Deployment Video
Network Readiness
Video Quality
Measurement and
Analysis
©2013 Avaya Inc. All rights reserved
27
February 26-28, 2013 | Orlando, FL
eVident Benefits
• Reduction in customer turnup costs
• Lower network operations
center costs
• Monitor and proactively
troubleshooting V2oIP calls
• Increased customer
satisfaction
• Minimize deployment time
• Providing eVident based
analysis as a service to
customers.
©2013 Avaya Inc. All rights reserved
28
February 26-28, 2013 | Orlando, FL
Radvision’s PreVideo
• PreVideo ensures:
• Network readiness for Voice
and Video over IP (HD)
• Correct network configuration
• Client/Server architecture
• Topology emulation, including
interaction with various types
of infrastructures
• Problem prevention by
proactive testing
• Optimal end-user experience
(voice and video quality)
©2013 Avaya Inc. All rights reserved
29
February 26-28, 2013 | Orlando, FL
PreVideo – Distributed Solution
PreVideo
Agent Tokyo
PreVideo
Agent Paris
Manager
©2013 Avaya Inc. All rights reserved
30
February 26-28, 2013 | Orlando, FL
PreVideo - Functionality
• Support SIP, H323,
CISCO/TIP
• Voice & Video Quality MOS
• Hundred of calls
simultaneously
• XML – Remote Control API
• Report PDF, EXL, WORD
Format
• USB Agent Key (Plug &
Play)
• Pre-Call Self Testing
• QoS
©2013 Avaya Inc. All rights reserved
31
February 26-28, 2013 | Orlando, FL
Analyze and Measure Your Audio & Video
• Measure and analyze Audio and HD Video
Quality
• Cause analysis
• Quality improvement options
NETWORK
CAPTURE
©2013 Avaya Inc. All rights reserved
32
February 26-28, 2013 | Orlando, FL
Real Time Video Monitoring Solution
Actively Detects
•
•
•
Control your
infrastructure!
Tunes and
Optimizes your
Network
Real-time QoE Monitoring
• Non-intrusive (Agent-less)
Multiple Vendor Support (Radvision, Polycom, Lifesize, Tandberg, Cisco)
• P2P and Conference Call
• Problem Detection and Solution
• CDR with QoE as Metrics (History)
Alerts on Problems (< threshold) – Alarms
• System Performance Analysis
• Analyzes QoE Trends & Reports
©2013 Avaya Inc. All rights reserved
33
February 26-28, 2013 | Orlando, FL
RVMON – Architecture
SCOPIA XT
SCOPIA Elite
MCU
MCU
Public Internet
MPLS network
Gatekeeper
Gatekeeper
Location X
Location Y
WEB Interface
Radvision EPs
can send
additional
information
Reporting
MCU
RVMON
Alarm
Notification
Gatekeeper
EP
EP
Main Location
©2013 Avaya Inc. All rights reserved
34
February 26-28, 2013 | Orlando, FL
eVident Monitoring - Benefit
•
•
•
Enhances pro-active efforts to avoid
service quality problems
before deployment;
• Ensure high quality end-user
experience
• Automate, isolate and analyze
video problems
Increases the efficiency of reactive
measures by providing real-time
analysis and diagnostics
• Diagnostics and troubleshooting
• Reduced customer service
response time
Optimizes intelligent database indexing and
integrated call history End-to-end
integrated solution
Complete Monitoring Solution
©2013 Avaya Inc. All rights reserved
35
February 26-28, 2013 | Orlando, FL
Articles
embedded-computing
TMCNET
blog.radvision
blog.radvision
©2013 Avaya Inc. All rights reserved
36
February 26-28, 2013 | Orlando, FL
Thank you!
#AvayaATF
©2013 Avaya Inc. All rights reserved
37
February 26-28, 2013 | Orlando, FL