ITU-T Study Group 12 Performance, QoS and QoE Summary of Results Study Period 2009-2012 Charles Dvorak, SG 12 Chairman Contents Terms of reference Highlights of achievements Proposed Terms of reference (slight mod.) Future work Conclusions Supplemental slides ITU-T Study Group 12 Performance, QoS and QoE International Telecommunication Union 2 SG 12 Terms of Reference Responsible for Recommendations on performance, quality of service (QoS) and quality of experience (QoE) for the full spectrum of terminals, networks and services ranging from speech over fixed circuit-based networks to multimedia applications over networks that are mobile and packet-based. Included in this scope are the operational aspects of performance, QoS and QoE. A special focus is given to interoperability to ensure end-to-end users' satisfaction. Lead SG for QoS and Performance ITU-T Study Group 12 Performance, QoS and QoE International Telecommunication Union 3 Highlights of achievements (I) Smooth integration of QoS-related work moved to SG 12 from SG 2 by WTSA-08 FG on Driver Distraction created and active New Rec. E.803 based on the work of the Regional Group for Africa and the QSDG New Rec. P.1100 and P.1110 based on the work of the FG on Car Communications Six new Rec. consented in two authorized meetings of WP 2/12 chaired by Mr. Adler Three new G.1080 Recs. on IPTV QoS/QoE ITU-T Study Group 12 Performance, QoS and QoE International Telecommunication Union 4 Highlights of achievements (II) Five new Rec. in a new P.1200 Series on the Assessment of A/V Media Streaming Quality New Rec. P.863 on Perceptual Objective Listening Quality Assessment New Rec. Y.1564: Ethernet Serv. Activation Testing--already widely used by industry New Rec. Y.1566 on QoS mapping and Interconnect of Ethernet, IP and MPLS networks New Rec. P.381 on Universal Wired Headset Interface Requirements and Test Methods ITU-T Study Group 12 Performance, QoS and QoE International Telecommunication Union 5 Highlights of achievements (III) New Rec. G.107.1 on the Wideband E-model New Rec. P.1301, rel. to Telepresence QoE New Rec. Y.1565 on Home Networking Performance Parameters New Handbook on Subjective Testing Practical Procedures Revision/updating of many well-known existing Recommendations of SG 12 (e.g., G.107, P.56, P.311, Y.1221, Y.1541, etc.) ITU-T Study Group 12 Performance, QoS and QoE International Telecommunication Union 6 Terms of Reference (proposed) Responsible for Recommendations on performance, quality of service (QoS) and quality of experience (QoE) for the full spectrum of terminals, networks and services ranging from speech over fixed circuit-based networks to multimedia applications over networks that are mobile and packet based. Included in this scope are the operational aspects of performance, QoS and QoE; the end-to-end quality aspects of interoperability; and the development of multimedia quality assessment methodologies, both subjective and objective. Lead SG for Performance, QoS and QoE ITU-T Study Group 12 Performance, QoS and QoE International Telecommunication Union 7 Examples of Future Work QoE of Web-browsing and other apps Framework for invoking diagnostic funct. QoE requirements for telepresence; and telemeeting and conferencing services Models for Client Performance Metrics Multidimensional scaling quality assessment Objective prediction of speech intelligibility Parametric non-intrusive A/V assessment Many new subjective test methods needed ITU-T Study Group 12 Performance, QoS and QoE International Telecommunication Union 8 Conclusion SG 12 works on all performance aspects (terminals, systems, networks, etc.), so the end-to-end view of the user is captured. Meaningful progress by SG 12 will happen in the future because it continues to evolve its work programme to address the performance, QoS and QoE of new technologies, networks and services, such as IPTV, advanced audio, Ethernet, home networking, multimedia, etc. ITU-T Study Group 12 Performance, QoS and QoE International Telecommunication Union 9 Supplemental Slides Management team Study Group Structure General Information Acknowledgements ITU-T Study Group 12 Performance, QoS and QoE International Telecommunication Union 10 Management Team Chair(s) Charles A. Dvorak (USA) Vice-Chairs: Paul Barrett (UK) Vladimir Efimushkin (Russia) Gamal Amin Elsayed (Sudan) Hyung-Soo (Hans) Kim (Korea) Feng Qi (China) Catherine Quinquis (France) Akira Takahashi (Japan) Hassan Talib (Morocco) Catherine Quinquis (France) Klemens P. F. Adler (Germany) Paul Coverdale (China) WP Chairs: TSB Judit Katona Kiss Hiroshi Ota Sarah Scott ITU-T Study Group 12 Performance, QoS and QoE International Telecommunication Union 11 Study Group Structure WP1/12 Terminals & multimedia subjective assessment WP2/12 Objective models & tools for multimedia quality WP3/12 Multimedia QoS and QoE Groups reporting to SG 12: FG on Car Communications FG on Driver Distraction Quality of Service Development Group Regional Group for Africa (on QoS and QoE) ITU-T Study Group 12 Performance, QoS and QoE International Telecommunication Union 12 General Information 43 New/Revised Recommendations approved 17 Questions assigned by WTSA-08 1 New or revised Questions during period 17 Questions proposed for next period 40 Rapporteurs meetings held 347 contributions received 6 SG meetings held Max/Min/Average SG participants: 118/103/111 ITU-T Study Group 12 Performance, QoS and QoE International Telecommunication Union 13 Acknowledgements In any standards development organization, substantial progress occurs because of the right balance of timely technical contributions and trusted, competent leadership. SG 12 is a role model for this statement—because of the Vice-Chairs, the WP chairs, chairs of the Groups that report to SG 12, the rapporteurs, the editors, and the many active participants. Thanks to all they did--and for making it fun! Many talented people on the TSB staff supported us really well. My sincere thanks to all who worked so hard in the background so that we could be successful in our efforts. For their dedication and diligence, special thanks to the TSB staff who were assigned to SG12: Judit Katona Kiss (our recently retired Counsellor), Hiroshi Ota, and Sarah Scott. ITU-T Study Group 12 Performance, QoS and QoE International Telecommunication Union 14