Workshop on “Monitoring Quality of Service and Quality of Experience of Multimedia Services in Broadband/Internet Networks” (Maputo, Mozambique, 14-16 April 2014) Key QoS parameters for Voice Services Martin Brand Vice Chair ITU-T Study Group 11 Joachim Pomy Consultant@joachimpomy.de OPTICOM, Germany Components and related QoS category with voice quality functions Maputo - Mozambique - 14 - 16 April 2013 2 ITU-T G.114 ITU-T G.107 Highly interactive tasks (e.g., Absolute delay does not some speech, video conferencing and interactive data applications) may be affected by delays below 100 ms. For many intra-regional (e.g., within Africa, Europe, North America) routes in the range of 5000 km or less, users of VoIP connections are likely to experience mouth-to-ear delays < 150 ms. impair the intelligibility of speech but if the total delay exceeds around 100 ms from mouth to ear, it begins to affect the interactivity of conversations. Therefore, if possible, large delays should be avoided. Maputo - Mozambique - 14 - 16 April 2013 4 Contributing Factors Delay - Codec Packet frame duration DSP/CPU processing time Play out buffer Link speed (serialization) Propagation delay De-jitter buffer delay PLC Maputo - Mozambique - 14 - 16 April 2013 Distorsion - Codec - Jitter Use of VAD Lost of packets Transcoding Sound level Echo level 5 E-Model Transmission Rating (R) ITU-T Rec. G.107 R summarizes the effects of network impairments including delay, distortions signal level & echo level R= Ro- Is - Id- Ie + A Simplified E-Model for codec and packet loss/burst impairments R = 93.4 – Ie Ro= basic signal to noise ratio Is= level impairments and distortion impairments Id= delay impairments Ie= codec and packet loss/burst impairments A= advantage factor Maputo - Mozambique - 14 - 16 April 2013 6 Provisional planning values for the equipment impairment factor (Ie) Codec type Reference Operating rate kbit/s Ie value G.726, G.727 40 2 G.721(1988), G.726, G.727 32 7 G.726, G.727 24 25 G.726, G.727 16 50 G.728 16 7 12.8 20 G.729 8 10 G.729-A VAD 8 11 VSELP IS-54 8 20 ACELP IS-641 7.4 10 QCELP IS-96-A 8 19 RCELP IS-127 8 6 VSELP Japanese PDC 6.7 24 RPE-LTP GSM 06.10, Full-rate 13 20 VSELP GSM 06.20, Half-rate 5.6 23 ACELP GSM 06.60, Enhanced Full Rate 12.2 5 ACELP G.723.1 5.3 19 MP-MLQ G.723.1 6.3 15 ADPCM LD-CELP CS-ACELP Maputo - Mozambique - 14 - 16 April 2013 7 Codec combination Maputo - Mozambique - 14 - 16 April 2013 8 E-Model Prediction of Echo and Delay Impairment Maputo - Mozambique - 14 - 16 April 2013 9 Relation between R-value and user satisfaction R Value MOS CQEN Categories of User Satisfaction Value 94 4,42 93 4,40 92 4,38 Very satisfied (Best) 91 4,36 90 4,34 87 4,195 85 4,18 82 4,09 81 4,06 Satisfied (High) 80 4,03 77 3,85 73 3,74 70 3,60 Some users dissatisfied (Medium) 68 3,50 60 3,10 Many users dissatisfied (Low) 50 2,58 Nearly all users dissatisfied (Poor) MOS = 1 + (0,035) × R + (000 007) × R (R - 60) (100 - R) NOTE 1: Connections with R-values below 50 are not recommended. NOTE 2: Although the trend in transmission planning is to use R-values, equations to convert R-values into other metrics e.g. MOS, % GoB, % PoW, can be found in ITU-T Recommendation G.107 [i.4], annex B. Maputo - Mozambique - 14 - 16 April 2013 10 Provisional Planning Values for the Equipment Impairment Factor Ie under Conditions of Packet Loss for Codecs G.711, G.729A + VAD and G.732.1 + VAD 60 50 40 Ie 30 20 10 0 0 5 10 15 20 25 Packet Loss % G.711 without PLC G.711 with PLC Bursty Packet Loss G.723.1 + VAD Maputo - Mozambique - 14 - 16 April 2013 G.711 with PLC Random Packet Loss G.729A + VAD GSM 06.60 EFR 11 MOS - Speech Quality Measure 5 Excellent Subjective measurement Based on subjective experiments Mean opinion score Costly and time consuming Objective measurement Good correlation with subjective measurement Highly repeatable Real-time 4 Good 3 Fair 2 Poor MOS 1 Bad Maputo - Mozambique - 14 - 16 April 2013 12 QoS Voice Testing (1) Active voice quality measurement Active voice quality measurement techniques, also known as intrusive models, require a test call to be made over the network. A comparison of reference and degraded signals produces a quality score based on MOS. This type of measurement is useful for the preinstallation testing of a system as well as network optimization. Passive voice quality measurement Common to all communication technologies are Passive voice quality measurement. Passive voice quality measurement is also known as a non-intrusive measurement. These models monitor live network traffic and again measure the voice quality on the MOS scale. Passive measurement is ideal for the testing of systems already in use 13 Maputo - Mozambique - 14 - 16 April 2013 13 QoS Voice Testing (2) PSQM ITU-T Rec. P.861 - designed for codec evaluation. Assesses error loudness, noise disturbance and asymmetry to predict a PSQM value Withdrawn February 2001 PAMS - developed for real world networks Assesses time aligned, level aligned, spectrally weighted error surface PESQ© - ITU-T Rec. P.862 Perceptual Evaluation of Speech Quality Designed for network avaluation, using specific scale PESQ© - ITU-T Rec. P862.1 (PESQ extension from Nov.2003) Linear mapping to P.800 MOS scale 14 Maputo - Mozambique - 14 - 16 April 2013 14 QoS Voice Testing (3) PESQ© - ITU-T Rec. P862.3 [2007] (Implementation guide, Methods for objective and subjective assessment of quality) POLQA – ITU-T Rec. P.863 [2011] 3SQM, perceptual single-sided speech quality measure (non-intrusive) according to ITU-T rec. P.563 [2004] 15 Maputo - Mozambique - 14 - 16 April 2013 15 The instance of media-information quality assessment methods comparison Accuracy High Good Average Method type High PESQ, POLQA Active Average P.563 Passive Low E-model Cost Maputo - Mozambique - 14 - 16 April 2013 Passive/ Modelling 16 GUIDANCE ON OBJECTIVES FOR QUALITY RELATED PARAMETERS AT VOIP SEGMENTCONNECTION POINTS RESULTS PUBLISHED IN ETSI TR 102 775 V.1.6.1 Maputo - Mozambique - 14 - 16 April 2013 17 Scope of the development To provide guidance on the quality parameters that need to be considered at the Segment-connection of Voice over IP (VoIP) services and provides guidance on objectives for these parameters. Maputo - Mozambique - 14 - 16 April 2013 18 Reference Configuration NGN Provider A NGN Provider C Total transit segment Regional Metro Transit Segment A1 Transit Segment C1 NNI NNI Regional Access Segment A Transit Segment B1 Access Segment C NGN Provider B UNI UNI CPN User Segment A Maputo - Mozambique - 14 - 16 April 2013 CPN User Segment C 19 Generic Segment-connection Points QoS View Iz/Ic CPN Iz/Ic IP Transit SBC UNI Access Network CPN SBC SBC NGN Interconnection Server or Transit Network SBC NGN UNI Access Network UNI-UNI NGN Functional Archutecture View Non-compatible Control domain IWF Ic Iw Service Control Subsystem Compatible Control domain Service Layer Transport Layer RACS Iz Iz I-BGF SoIx interconnection reference model Maputo - Mozambique - 14 - 16 April 2013 20 End-to-End delay values between originating and terminating Service Provider premises West Europe Vienna West Europe Bern Paris Frankfurt DE - AT (Frankfurt – Vienna) 7 ms CH – DE (Bern – Frankfurt) 8 ms CH - AT (Bern – Vienna) 10 ms FR- AT (Paris -. Vienna) 15 ms North Europe East Europe RU – Vladimir RU – Moskwa SE - Östersund RO – Bucharest HU – Budapest CH - RU (Bern – Vladimir) 23 ms CH - RU (Bern – Moskwa) 22 ms CH-RO CH-GR (Bern – Bucharest) (Bern – 25 ms Athens) 30 ms DE-RO (Frankfurt – DE-GR Bucharest) (Frankfurt – 18 ms Athens) 24 ms DE-HU (Frankfurt – IT-CH Budapest) (Roma – 12 ms Cern) 22 ms DE- RU (FrankfurtMoskwa) 21 ms DE-SE (Frankfurt – Östersund) 12 ms South Europe GR–Athens IT - Roma East Asia South Asia Oceania (CNDongguan) Malaysia - MY Australia -AU Sydney CH – CN (Bern(Dongguan) 150 ms CH- MY 110 ms DE – MY 115- 164 ms DE-CN (Frakfurt – Dongguan) 160 ms DE-AU (Frankfurt – Melburne) 165 ms N. America West Cost Central America South America Africa US Washington DC US Vancouver Panama - PA Mexiko- MEX Brasilia - BR ZA - Cap town CH- US (Bern – Washington) 46 ms CH-US (Bern – Vancouver) 75 ms CH-PA (Bern – Panama) 103 ms CH-BR (Bern – Sao Paulo) 136 ms CH-ZA (Bern - Cape Town) 108 ms DE-US (Frankfurt – Washington) 55 ms DE-US (Frankfurt – Vancouver) 75 ms DE-MEX (Frankfurt – Mexiko City) 75 ms DE-BR DE-ZA (Frankfurt – Cape Town) 90 ms Burkina Fasso DE-AU (Frankfurt – Sydney) 146 ms (Frankfurt – Sao Paulo) 125 ms BE-BF 90 – 130 ms North Europe (SEÖstersund) SE - RU (Östersund – Moskwa) 10 ms SE-RO (Östersund – Bucharest) 30 ms Frankfurt – Roma 13 ms SE-GR (ÖstersundAthens) 42 ms East Europe (HUBudapest) HU- RU (Budapest – Moskwa) 33 ms HU – RO (BudapestBucharest) 14 ms HU – GR HU-CN (Budapest – 166 ms Athens) 20 ms HU-MY 125 ms IT- RU (Roma – Moskwa) 38 ms IT-RO (Roma – Bucharest) 32 ms (IT-GR) Roma – Athens 23 ms IT-MY 150 ms South Europe (IT- Roma) CH-AU (Bern – Sydney) 170 ms N. America East Cost SE-CN 150 ms IT-CN 160 ms Maputo - Mozambique - 14 - 16 April 2013 SE-MY 124 ms SE-AU 171 ms HU-AU 170 ms IT-AU 160 ms SE-US 62 ms HU-US 60 ms IT-US 55 ms SE-US 83 ms SE- PA 84 ms SE-BR 155 ms SE-ZA 87 ms HU-US 100 ms SE-MEX 78 ms HU-PA 95 ms HU-BR 152 ms HU-ZA 100 ms IT-US 95 ms HU- MEX 96 ms IT – PA 104 ms IR-BR 108 ms IT-ZA 95 ms IT- MEX 113 ms 21 Reference Configurations (1) SBC ADM DL CL SBC IP Transit SBC CL DL ADM SBC Backbone TE TE Local exchange Transit exchange EC SBC MGW VoNGN PSTN PSTN/ISDN classic access Configuration TE TE Subscriber line digital junction EC MSAN (MGW) SBC VoNGN PSTN NGN PSTN/ISDN access Configuration Maputo - Mozambique - 14 - 16 April 2013 ADM DL CL TRAU ETH Add-Drop-Multiplexer router Distribution Layer router Core Layer Transcoder and Rate Adaption Ethernet Unit 22 Reference Configurations (2) TE TE IAD DSLAM ETH 2X ADM 4x BRAS / BNG SBC VoNGN PSTN Access DSL Configuration Node B ATM RNC ATM TRAU MGW SBC VoNGN Access configuration from UMTS Release 4 Maputo - Mozambique - 14 - 16 April 2013 23 Delay with regional propagation delay (1 400 km / 7 ms) Uplink / Downlink POTS 256 kbit/s - 256 kbit/s 128 ms R=90 384 kbit/s - 384 kbit/s - 512 kbit/s - 768 kbit/s - 118 ms 113 ms 108 ms R=90 R=90 108 ms 102 ms R=90 R=91 1024 kbit/s - 1152 kbit/s - 1536 kbit/s - 2048 kbit/s - 2304 kbit/s - 3072 kbit/s - 6144 kbit/s - POTS 55 ms 104 ms 103 ms 102 ms 101 ms 101 ms 100 ms 97 ms R=91 82 ms R=91 R=911 R=91 R=91 R=91 R=91 R=91 R=90 R=90 97 ms 95 ms 93 ms 94 ms 92 ms 92 ms 91 ms 91 ms 75 ms R=91 R=91 R=91 R=91 R=80 R=91 R=91 R=91 R=91 Maputo - Mozambique - 14 - 16 April 2013 24 Delay with regional propagation delay (1 400 km / 7 ms) G.711/20 Uplink / Downlink 256 kbit/s - 384 kbit/s - 512 kbit/s 768 kbit/s Uplink / Downlink 1024 kbit/s POTS 256 kbit/s 2048 kbit/s 384 kbit/s GSM 768 kbit/s 92 ms 1024 kbit/s 91 ms 1152 kbit/s 91 ms 1536 kbit/s 91 ms 2048 kbit/s 91 ms 2304 kbit/s 90 ms 3072 kbit/s 90 ms 6144 kbit/s 90 ms 74 ms R=91 R=91 R=91 R=91 R=91 R=91 R=91 R=91 R=91 R=91 90 ms 90 ms 90 ms 89 ms 89 ms 89 ms 89 ms 73 ms - - - 91 ms 256 kbit/s -- 384 kbit/s -- 512 kbit/s -- R=91 kbit/s -- R=91 kbit/s 90 -ms R=91 R=91 R=91 R=91 128 ms 118 ms 113 ms 108 ms 104 ms 103 ms 102 ms 101 ms R=90 - R=90 - R=90 - R=90 - R=90 - R=911 - 88 ms R=91 88 ms R=91 - 108 ms 102 ms 97 ms 95 ms 93 ms 94 ms R=91 92 ms R=90 R=91 R=91 R=91 R=91 R=91 196 ms 194ms 193 ms 193 ms 192 ms R=82 R=82 202 ms R=81 UMTS Rel.4 512 kbit/s 97 ms 207 ms 768 R=82 R=81 201 ms 199 ms R=82 198 ms R=81 157 ms R=81 155 ms R=81 154 ms R=80 LTE 163ms Maputo - Mozambique - 14 - 16 April 2013 1024 - 1152 R=91 kbit/s 89 -ms R=91 1536 R=91 kbit/s 89 -ms 2048 R=91 kbit/s 89 -ms 2304 R=91 kbit/s 89 -ms 3072 6144 POTS POTS R=91 kbit/s 88 -ms R=91 kbit/s 88 -ms R=91 73 55 ms ms R=91 R=91 R=91 R=91 R=91 101 ms 100 ms 97 ms 82 ms 88 ms R=91 88 ms R=91 88 ms R=91 92 ms R=91 91 ms R=91 91 ms R=91 75 ms R=80 R=91 R=91 R=91 R=91 192 ms 192 ms 192 ms 191 ms 191 ms 175 ms R=82 R=82 R=82 R=82 R=82 198 ms 197 ms 197 ms 197 ms 197 ms 196 ms 196 ms R=81 R=81 R=81 R=81 R=81 R=81 R=81 154 ms 154 ms 153 ms 153 ms 153 ms 152 ms 152 ms R=91 R=83 180 ms R=82 136 ms 25 Relation between R-value and user satisfaction R Value MOS CQEN Categories of User Satisfaction Value 94 4,42 93 4,40 92 4,38 Very satisfied (Best) 91 4,36 90 4,34 87 4,195 85 4,18 82 4,09 81 4,06 Satisfied (High) 80 4,03 77 3,85 73 3,74 70 3,60 Some users dissatisfied (Medium) 68 3,50 60 3,10 Many users dissatisfied (Low) 50 2,58 Nearly all users dissatisfied (Poor) MOS = 1 + (0,035) × R + (000 007) × R (R - 60) (100 - R) NOTE 1: Connections with R-values below 50 are not recommended. NOTE 2: Although the trend in transmission planning is to use R-values, equations to convert R-values into other metrics e.g. MOS, % GoB, % PoW, can be found in ITU-T Recommendation G.107 [i.4], annex B. Maputo - Mozambique - 14 - 16 April 2013 26 Guidance on Access Segment Objectives Maputo - Mozambique - 14 - 16 April 2013 27 Maximal IPDV values for xDSL and ETH Access Segment Parameter Value Access Network (sending side) < 35 ms Access Network (receiving < 10 ms (note) side); NOTE: 10 ms are recommended, the maximum IPDV value is 40 ms. Maputo - Mozambique - 14 - 16 April 2013 28 Guidance on Objectives for Total Transit Segments Parameter Value IPDV 10 ms Intra-continent Jitter Value -5 ms per Provider (maximum of 2 involved in the service delivery chain) (see note) IPDV 20 ms Inter-continent Jitter Value -10 ms per Provider (maximum of 2 involved in the service delivery chain) (see note) IPLR 3,0 × 10-4 IPER 3 × 10-5 Ie 0 NOTE: The Jitter Values are based on values contained in the GSMA document IR.3445 [i.15]. Maputo - Mozambique - 14 - 16 April 2013 29 Dependence of DSP/CPU processing time TriplePlay-Results IAD_2_IAD Test requerments : routed IAD-Konfiguration, worst case two TV Streams, Testlabor HSI- Connection and activated WLAN, VP-voice upstream Bandwith 384 kBit/s. Supplier: 1 2 3 4 IAD_2_IAD MOS Value QoS two wire (PSTN) 10 ms packetization 20 ms packetization 4,2 4,2 4,2 4,2 4,0 4,0 4,2 4,1 10 ms packetization 58/29/10 20 ms packetization 66/35/11 86/10/4 95/0/0 111/10/4 114/13/6 63/17/6 66/10/4 Delay / Delay Range/ Std-Dev (each direction max values) Maputo - Mozambique - 14 - 16 April 2013 30 Delay Objectives for BEST (G.109) voice communication quality (R > 90) and Access Network Jitter < 35 ms Maputo - Mozambique - 14 - 16 April 2013 31 Bandwidth calculations and prioritization in VoIP systems The IP delay of VoIP packets over a link transporting Voice and Data depends on following factors: • the instantaneous system load (not the average system load), • the size of the packets (both the size of the RTP packets and IP data packets on the same links), • the manner in which QoS is implemented in the system (a system with priority, such as Diff-Serv, behaves differently than a system with best effort). The delay and jitter increase linearly up to a limit of parallel VoIP channels. Above this limit, the bandwidth utilization and the delay increase exponentially and the VoIP transmissions become unstable. Maputo - Mozambique - 14 - 16 April 2013 33 RTP is transferred preferentially Maputo - Mozambique - 14 - 16 April 2013 34 The maximum link capacity The maximum capacity with Diff-Serv is bandwidth dependent. For example, the utilization for a 386 kbit / s link should not be higher than 85%, a 4 Mbit/s link can be utilized with 96 %. Utilization (ρ1+ ρ2) RHO < 0.96 RHO < 0,95 RHO < 0,89 RHO < 0,89 RHO < 0,85 Tests conditions: Link capacity > 4 Mbit/s 3 Mbit/s 2 - 3 Mbit/s 1 - 2 Mbit/s 0,386 - 1 Mbit/s Data utilization ρ2= 62 %; Data Packet size = 1500 bytes; Codec: G.711 Maputo - Mozambique - 14 - 16 April 2013 35 QoS is implemented by over-dimensioning of the system Without prioritization only 40 % to 80% of the bandwidth can be used depending on the flow characteristics, as can be seen in the following figure: Maputo - Mozambique - 14 - 16 April 2013 36 Any questions ? Contact: Consultant@joachimpomy.de Maputo - Mozambique - 14 - 16 April 2013 37