INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO N6301 ISO/IEC JTC 1/SC 29/WG 11 München, March 2004 Source Leonardo Chiariglione, Convenor Title Report of the 68th meeting Status Report of the 68th meeting 1 Opening The 68th WG11 meeting was held at the Technical University of Munich on 2004/03/15-19 at the kind invitation of the German National Body (DIN). 2 Roll call of participants Annex 1 gives the attendance list. 3 Approval of agenda Annex 2 gives the agenda approved. 4 Allocation of contributions Annex 3 gives the list of input contributions 5 Communications from Convenor The Convenor proposed that the management of the Monday Plenary should be changed with matters discussed depending on their belonging to identified categories of activities. This was accepted and N6403 documents the categories and work items belonging to them. This report will be organised accordingly. 6 Report of previous meeting This was approved. 7 Processing of NB Position Papers National Body papers were considered and answers provided where appropriate. 1 8 Work plan 8.1 Media coding 8.1.1 MPEG-2 AAC BW Extensions conformance 8.1.2 AVC Conformance 8.1.3 AVC Fidelity Range Extensions 8.1.4 AVC Fidelity Range Extensions Conformance The following document was approved 6353 Working Draft 1 of Amendment 9 for ISO/IEC 14496-4: AVC Fidelity Range Extensions Conformance 8.1.5 AFX Conformance The following documents were approved 6465 DoC on ISO/IEC 14496-4:200x/FPDAM7 AFX Conformance Ext. 6466 Text of ISO/IEC 14496-4:200x/FDAM7 AFX Conformance Ext. 8.1.6 AFX Extensions The following document was approved 6311 ISO/IEC 14496-16/AMD1 WD 4.0 8.1.7 Audio Lossless Coding The following document was approved 6435 WD3 of Audio Lossless Coding 8.1.8 Audio Scalable Lossless Coding The following document was approved 6437 WD2 of Scalable Lossless Coding 8.1.9 1-bit Audio Lossless Coding The following document was approved 6439 ISO/IEC 14496-3:2001/PDAM 6, Lossless Coding of Oversampled Audio 8.1.10 HE-AAC Conformance The following documents were approved 6461 DoC on ISO/IEC 13818-4:200X/PDAM2 Audio Conformance Ext. 6462 Text of ISO/IEC 13818-4:200X/FPDAM2 Audio Conformance Ext. 6467 Doc on ISO/IEC 14496-4:2003/PDAM8 HE-AAC, ABIFS & SA Conf. 6468 Text of ISO/IEC 14496-4:2003/PDAM8 HE-AAC, ABIFS & SA Conf. 2 8.1.11 SA Conformance 8.1.12 Scalable Video Coding 8.1.13 Streaming Text Format 8.1.14 Spatial Audio Coding The following document was approved 6455 Call for Proposals on Spatial Audio Coding 8.1.15 Video Coding Tool Repository 8.1.16 3D AV Coding The following document was approved 6393 Requirements for Omni-directional AV 0.1 8.2 Composition coding 8.2.1 Audio BIFS Extensions The following documents were approved N6319 DoC on ISO/IEC 14496-11/PDAM3 N6320 Text of ISO/IEC 14496-11/FPDAM3 8.2.2 Audio BIFS Conformance 8.2.3 XMT extensions 8.2.4 Lightweight Scene Representation The following document was approved N6337 CfP on Lightweight Application Scene Representation 8.2.5 Symbolic Music Representation The following document was approved 6457 Draft Call for Proposals for Symbolic Music Representation 8.3 Description coding 8.3.1 Efficient representation of descriptions The following documents were approved N6325 DoC on ISO/IEC 15938-1/FPDAM1 N6326 Text of ISO/IEC 15938-1/FDAM1 8.3.2 Video Descriptors The following document was approved N6367 WD 1.0 of MPEG-7 New Visual Extensions 8.3.3 Audio Descriptors The following document was approved 3 6441 WD 1 of MPEG-7, High-level Descriptors 8.3.4 MDS user preference extensions The following documents were approved 6397 DoC on ISO/IEC 15938-5 PDAM/2 6398 ISO/IEC 15938-5 FPDAM/2 “MDS User Preference Extensions” 8.3.5 MPEG-7 Conformance Extensions 8.3.6 MPEG-7 Profiles The following documents were approved 6385 DoC for ISO/IEC 15938-9 CD 6386 Text of ISO/IEC 15938-9 FCD 8.3.7 Schema definition The following documents were approved 6407 DoC on ISO/IEC 15938-10 CD 6408 ISO/IEC 15938-10 FCD “Schema Definition“ 8.3.8 Extraction and use of MPEG-7 descriptions extensions The following documents were approved N6370 Disposition of Comments on ISO/IEC TR 15938-8/PDAM1 N6371 Text of ISO/IEC TR 15938-8/DAM1 8.4 Systems support 8.4.1 Carriage of ISAN and V-ISAN metadata 8.4.2 New audio profile and level signaling The following documents were approved N6316 DoC on ISO/IEC 13818-1:2000/PDAM5 N6317 Text of ISO/IEC 13818-1:2000/FPDAM5 8.4.3 MPEG-1 Audio access units The following document was approved 6433 Study on ISO/IEC 14496-3:2001/FPDAM 3, MP3 on MP4 8.4.4 Streaming of MPEG-7 descriptions 8.4.5 Timestamps and Audio Codec Behavior 8.5 IPMP 8.5.1 MPEG-2 IPMP-X Conformance 8.5.2 MPEG-4 IPMP-X Conformance The following documents were approved 6463 DoC on ISO/IEC 14496-4:200x/FPDAM4 IPMP Conformance Ext. 4 6464 Text of ISO/IEC 14496-4:200x/FDAM4 IPMP Conformance Ext. 8.5.3 Evaluation Tools for Persistent Association The following documents were approved 6391 DoC on PDTR of ISO/IEC 21000-11 6392 Text of DTR of ISO/IEC 21000-11 8.5.4 MPEG-21 IPMP Framework The following documents were approved 6389 Requirements for MPEG-21 IPMP 6390 Updated Call for Proposals for MPEG-21 Intellectual Property Management and Protection 8.6 Digital Item 8.6.1 Digital Item Declaration The following document was approved 6409 ISO/IEC 21000-2 DID 2nd Edition CD 8.6.2 Digital Item Binarisation The following document was approved N6333 WD1.0 of Text of ISO/IEC 21000-16 8.6.3 DIA Conversions and Permission The following document was approved 6413 MPEG-21 DIA AMD/1 WD v.2 “Conversions and Permissions” 8.6.4 Event Reporting The following document was approved 6419 ISO/IEC 21000-15 WD v.1 “Event Reporting” 8.6.5 MPEG-21 Conformance The following document was approved 6472 WD3.0 of ISO/IEC 21000-14 MPEG-21 Conformance 8.6.6 Vision, technologies and strategy The following documents were approved 6387 DoC on PDTR of ISO/IEC 21000-1 Second Edition 6388 Text of DTR of ISO/IEC 21000-1 Second Edition 8.7 Transport and File Format 8.7.1 ISO File Format extensions The following documents were approved N6322 DoC on ISO/IEC 14496-12/PDAM1 N6323 Text of ISO/IEC 14496-12/FPDAM1 8.7.2 MPEG-21 File Format The following document was approved 5 N6331 Text of ISO/IEC 21000-9 CD 8.8 Multimedia architecture 8.8.1 MPEG-J extension for scene control 8.8.2 MPEG-J extension for rendering 8.8.3 Digital Item Processing 8.8.4 MPEG Multimedia Middleware The following document was approved 6336 Requirements on the MPEG Multimedia Middleware 8.9 Reference implementation 8.9.1 AVC Reference Software 8.9.2 HE-AAC Reference Software 8.9.3 AFX Reference Software 8.9.4 AVC Fidelity Range Extensions Reference Software The following document was approved 6356 Working Draft 1 of Amendment 8 for ISO/IEC 14496-5: AVC Fidelity Range Extensions Reference Software 8.9.5 MPEG-4 Visual Reference Hardware Description The following document was approved N6307 ISO/IEC 14496-9/PDAM of AM 1: Information Technology – Coding of Audio Visual Objects - Part 9: Reference Hardware Description. 8.9.6 MPEG-4 AVC Reference Hardware Description The following document was approved N6308 Request for Reference Hardware Description Extensions 8.9.7 MPEG-7 Reference Software Extensions 8.9.8 MPEG-21 Reference Software The following document was approved 6470 Text of ISO/IEC 21000-8 CD MPEG-21 Reference Software 8.9.9 Test Bed for MPEG-21 Resource Delivery 8.10 Application formats 8.10.1 Music player Application Format The following document was approved 6443 Text of MPEG-A, Music Player Application Format CD 6 8.10.2 Photo album Application Format 8.11 Maintenance 8.11.1 Video coding standards 8.11.2 Audio coding standards 8.11.3 Visual description coding standards 8.11.4 Audio description coding standards 8.11.5 MDS standards 9 Liaison matters The following liaisons were issued N6340 Liaison Statement to the TV-Anytime Forum N6341 Liaison Statement to SMPTE on V/ISAN and ISO 13818-1 DAM4 N6342 Liaison Statement to AVS China N6343 Liaison Statement to ISO TC 46/SC 9 N6344 Liaison Statement to IEEE-LTSC N6345 Liaison Statement to W3C N6346 Liaison Statement to JPEG N6425 Information on MPEG-21 IPMP Call for Proposals 10 Organisation of this meeting 10.1 Tasks for subgroups Tasks were assigned to achieve the goals of the work plan. 10.2 Joint meetings The following joint meetings were held Groups What Req, MDS MPEG-21 Event Rep Req, Sys M3W DMP HOD MDS, Sys MPEG-21 binarisation Aud, Sys Various issues JVT, Sys AVC on MP2 Sys Req, Sys, Vid, Aud MAF JVT, Tst Objective vid qual. measure Req, Sys M3W Req, Sys Laser Req, Sys, Snh MP4 Profiles MDS, Int MPEG-21 Conform MDS, Int MPEG-21 Ref SW Req, Sys IPMP Prof. Vid, ISG Video tools 7 Where MDS Sys 0938 0938 MDS Aud JVT Req JVT Req Req Req MDS MDS Req Vid Day Mon Mon Mon Mon Tue Tue Tue Tue Tue Tue Tue Tue Tue Tue Tue Tue Time 16:00-17:00 17:00-17:30 18:00-19:00 19:00-20:00 09:00-10:00 10:00-12:00 11:30-12:00 12:00-13:00 12:00-12:30 14:00-14:30 14:30-15:30 15:30-16:30 15:30-16:00 16:00-18:00 16:30-17:00 17:00-17:30 Vid, Tst Liaisons Req, MDS, Aud, Vid Req, Mds Req, Aud Vid, Sys Req, Sys Snh, Req Vid, Jvt Sys, Mds Sys, ISG Sys, Req Req, JVT Req, Vid Mds, Int, Snh Error Res. VT MP7 Profiles, MAF MPEG-21 US NB contrib Live Audio Broadcast etc. Layered Video Coding IPMP profile Compressed 3D Profile SVC MP21 FF Laser evaluation Laser Fidelity Range Ext. 3D AV, SVC MPEG-21 ref SW Vid 0938 Plen Plen Aud Vid N0115 N0115 Vid Sys Sys Sys JVT Vid Sys Tue Tue Wed Wed Wed Wed Wed Wed Wed Wed Thu Thu Thu Thu Thu 17:30-18:00 18:00-19:00 11:30-12:30 12:30-13:00 14:00-14:30 14:00-14:30 15:00-16:00 16:00-16:30 17:00-18:30 17:00-18:00 11:00-11:30 12:00-12:30 12:30-13:00 14:00-15:00 15:00-16:00 10.3 Administrative matters 10.3.1 Schedule of future MPEG meetings The following schedule was approved Meeting City Country Yr. Mo. Days th 68 München DE 04 03 15-19 69th Redmond, WA US 04 07 19-23 th 70 Palma de Mallorca ES 04 10 18-22 71st Hong Kong CN 05 01 17-21 nd 72 Busan KR 05 04 18-22 73rd Poznań PL 05 07 25-29 th 74 ? FR 05 10 17-21 th 75 ? ? 06 01 24-28 10.3.2 Promotional activities An ad hoc group with this mandate was established. 11 Planning of future activities The following ad hoc groups were established: 6475 Scene Representation 6474 XML Structure Binarization and Streaming 6380 3DAV Coding 6350 AFX documents, CEs, and software 6422 Core Experiments for MPEG-21 DID 2nd Edition 6423 Core Experiments for MPEG-21 DIP 6424 Core Experiments for MPEG-21 Event Reporting 6379 Core Experiments in Scalable Video Coding 6378 Description Tools for New Visual Extensions 6376 Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance 6377 Maintenance of MPEG-7 Visual related Documents and Reference Software 6476 MPEG Multimedia Middleware 8 6473 6459 6309 6396 6351 6395 6458 6460 6478 6381 6394 MPEG Reference Software MPEG-4 Lossless Audio Coding MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2. MPEG-7 Profiles MPEG-J extensions for rendering Multimedia Application Format (MAF) Spatial Audio Coding Symbolic Music Representation Communicating MPEG to the business Community Video Coding Tools Repository AHG to evaluate responses to the MPEG-21 IPMP CfP 12 Resolutions of this meeting These were approved (N6299) 13 A.O.B There was no other business 14 Closing The meeting closed at 2004/03/19T21:40. 9 Annex 1 Attendance list Last name Hellwagner Kosch Taschwer Timmerer Wan Becker Burnett Taubman Drury Davis De Keukelaere De Wolf Van de Walle Bekaert Bormans Devillers Rogge Salomie Munteanu Schelkens Wang Winger Alberti Mattavelli Zoia Faller Vexo Wuermlin Waschbüsch Di Giacomo Reichel Ziliani Gao Xu He Rusert Wien Crysandt Schneider Feiten List Stepping First name Hermann Harald Mario Christian Ernest Axel Ian David Gerrard Stephen Frederik Koen Rik Jeroen Jan Sylvain Boris Alexandru Adrian Peter Demin Lowell Claudio Marco Giorgio Christof Frederic Stephan Michael Thomas Julien Francesco Wen Jizheng Yun Thomas Mathias Holger Andreas Bernhard Peter Michael Affiliation University Klagenfurt University Klagenfurt University Klagenfurt University Klagenfurt Canon CISRA Enikos/UoW The University of New South Wales TITR / enikos University Of Wollongong Ghent University Ghent University Ghent University Ghent University - LANL IMEC IMEC Metanous V.U.B. Vrije Universiteit Brussel Vrije Universiteit Brussel Communications Research Centre LSI EPFL EPFL EPFL EPFL EPFL-VRLab ETH Zurich ETH Zürich MIRALab, University of Geneva VisioWave VisioWave Institute of Computing Technology (CAS) Microsoft Tsinghua Univ. Aachen University Aachen University Aachen University (RWTH) Coding Technologies Deutsche Telekom, T-Systems Deutsche Telekom, T-Systems FernUniversität Hagen 10 Coun. AT AT AT AT AU AU AU AU AU AU BE BE BE BE BE BE BE BE BE BE CA CA CH CH CH CH CH CH CH CH CH CH CN CN CN DE DE DE DE DE DE DE Wiegand Suehring Fehn Marpe Müller Smolic Schwarz Brandenburg Geiger Gruhne Baum Fuchs Grill Herre Sperschneider Thoma Link Steinmann Stoll Ziegler Oelbaum Wittmann Wedi Benzler Ohm Hanke Bäse Hutter Amon Taddei Timmerman Kofler-Vogt Liebchen Drumm Böhm Schmidt Herpel Graffunder Wolf Rittermann Diepold Oelbaum Zwick Obermeier Herrmann Kaup Edler Thomas Karsten Christoph Detlev Karsten Aljoscha Heiko Karlheinz Ralf Matthias Oliver Harald Bernhard Juergen Ralph Herbert Martin Volker Gerhard Gernot Tobias Steffen Thomas Ulrich Jens-Rainer Konstantin Gero Andreas Peter Herve Benoit Andrea Tilman Helge Johannes Juergen Carsten Andreas Ingo Marco Klaus Tobias Michael Florian Stephan André Bernd Fraunhofer HHI Fraunhofer HHI Fraunhofer HHI Fraunhofer HHI Fraunhofer HHI Fraunhofer HHI Fraunhofer HHI Fraunhofer IDMT Fraunhofer IDMT Fraunhofer IDMT Fraunhofer IIS Fraunhofer IIS Fraunhofer IIS Fraunhofer IIS Fraunhofer IIS Fraunhofer IIS Institut für Rundfunktechnik GmbH Institut für Rundfunktechnik GmbH Institut für Rundfunktechnik GmbH Max-Planck-Institut, Saarbrücken Munich University of Technology Panasonic Panasonic European Labs Robert Bosch GmbH RWTH Aachen RWTH Aachen University Siemens AG Siemens AG Siemens AG Siemens AG Siemens AG Siemens AG Technical University of Berlin Technische Universität Ilmenau Thomson Thomson Thomson T-Systems T-Systems TU Ilmenau TUM-LDV TUM-LDV TUM-LDV TUM-LDV TUM-LIS University of Erlangen University of Hannover 11 DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE DE Ostermann Narroschke Nguyen Kummer-Hardt Gauvin Villegas Morán Burgos Delgado Rodriguez Lugmayr Väänänen Lainema Ridge Nguyen Nuttal Concolato Dufourd Pesquet-Popescu Seyrat Cotarmanach Amonou Daniel Fournier Gicquel Gioia Loras Royan Avaro Benjelloun Touimi Pateux Rault Virette Balter Guillemot Preda Meudic Puig Bottreau Dulong de Rosnay Jung Marc Francois Vieron Nilsson Rowe Casey Jörn Matthias Dieu Thanh Thomas Marc Paulo Francisco Jaime Eva Artur Mauri Jani Justin Hang FrançoisXavier Cyril Jean-Claude Beatrice Claude Alexandre Isabelle Jerome Jérôme Jean-Charles Patrick Frederic Jérôme Olivier Abdellatif Stéphane Jean-Bernard David Raphaèle Christine Marius Bernoit Vincent Vincent Melanie Joel Guez Vucher Edouard Jerome Mike Simon Michael University of Hannover University of Hannover University of Hannover AIO Microgenesis Telefónica I+D Univ. Politécnica Madrid Universitat Pompeu Fabra UPF Nokia Nokia Nokia ALCATEL CISAC DE DE DE ES ES ES ES ES ES FI FI FI FI FR FR ENST ENST ENST EXPWAY France Telecom France Telecom France Telecom France Telecom France Telecom France Telecom France telecom France Telecom France Telecom R&D France Telecom R&D France Telecom R&D France Telecom R&D France Telecom R&D France Telecom RD and IRISA INRIA INT Ircam Ircam IRISA-INRIA Medialive Philips SCPP Thomson Thomson BTexact Technologies Canon Research Centre Europe City University, London FR FR FR FR FR FR FR FR FR FR FR FR FR FR FR FR FR FR FR FR FR FR FR FR FR FR FR FR GB GB GB 12 Kudumakis Jessop Lindsay Cieplinski Miroslaw Teh Grant Harwood Abhayaratne Pearmain Barlas Rump Barney Watt Ahik Birman Gill Desai Chiariglione Davide Piefrancesco Paolo Stefano Cordara Leonardi Kitamura Kazui Murakami Suzuki Ogura Sugihara Kawada Hitoshi Kogure Senoh Takahashi Tanaka Ueno Asai Murakami Nishikawa Yamada Schultz Fujii Tanimoto Yamazawa Panos Paul Adam Leszek Bober Jonathan Kate Don Charit Alan Chris Niels Wragg Simon Achihuo Man Shlomo Aharon Jwalant Leonardo Rogai Bellini Nesi Tubaro Giovanni Riccardo Masatsugu Kimihiko Tomokazu Yoshinori Yukiko Yoshinori Ryoichi Habe Takuyo Takanori Toshiya Naoya Takafumi Kohtaro Tokumichi Hirofumi Yoshihisa Craig Toshiaki Masayuki Kazumasa CRL IFPI Lancaster University Mitsubishi Electric ITE-VIL Mitsubishi Electric ITE-VIL Motorola Nine Tiles Oxford Semiconductor Ltd Queen Mary, University of London Queen Mary, University of London Rightscom Limited Rightscom Limited Universal Music International Universal Music International Quix Technologies GB GB GB GB GB GB GB GB GB GB GB GB GB GB IL Vimatix inc. Zoran Microelectronics Wipro Technologies CEDEO DSI-DISIT-UNIFI DSI-DISIT-UNIFI DSI-DSIT-UNIFI Politecnico di Milano Telecom Italia LAB University of Brescia For more convenient AV life Fujitsu Laboratories Ltd. Hitachi Hitachi, Ltd. IPSJ/ITSCJ Jeita KDDI Kyoto University Matsushita Matsushita Matsushita Matsushita Matsushita Mitsubishi Electric Corporation Mitsubishi Electric Corporation Mitsubishi Electric Corporation Mitsubishi Electric Corporation Multimedia Architectures Nagoya University Nagoya University Nara Institute of Science and Technology IL IL IN IT IT IT IT IT IT IT JP JP JP JP JP JP JP JP JP JP JP JP JP JP JP JP JP JP JP JP JP 13 Nomura Yamada Kimoto Kimata Moriya Sugiura Nakajima Tan Nishi Wu Noguchi Visharam Suzuki Aoki Koike Kambayashi Chujoh Kaneko Oh Kim Sung Chae Dong Wook Cho Jeho Jeong Jeong Kim Kim Seo Song Soojun Hendry Kim Jong-Tae Kim KiSeob Park Sang yong Kim Suh Jeon Lim Jong Jin Toshiyuki Akio Takahiro Hideaki Takehiro Koichi Junichi TK Takashi Zhixiong Yoji Zubair Teruhiko Terumasa Mayumi Toru Takeshi Itaru Weon Geun Hyun Mun Woo Cheol Jong Jin Kang Yongju Nam Senator Seyoon Kyuheon Wook-Joong Jeongil Young Joo Park Munchurl Kim Hyoung Joong Kim Keunsoo Sseo Wonha Doug Byeong Moon YoungKwon Chae NEC NEC NEC Corporation NTT NTT NTT Advanced Technology Corporation NTT Cyber Space Laboratories NTT DoCoMo, Inc. Oki Electric Industry Co., Ltd. Oki Electric Industry Co., Ltd. Sharp Corporation Sony Sony The University of Tokyo The University of Tokyo Toshiba Toshiba Waseda University ETRI Samsung Sejong University ETRI ETRI ETRI ETRI ETRI ETRI ETRI ETRI ETRI Information and Communications University Information and Communications University KAIST Kangwon National University JP JP JP JP JP JP JP JP JP JP JP JP JP JP JP JP JP JP KP KP KP KR KR KR KR KR KR KR KR KR KR KR KR KR KR KR Kangwon National University KBS Korea Telecom Kyung Hee university Kyung Hee University LG Electronics KR KR KR KR KR KR net&tv Inc. KR net&tv Inc. KR 14 Kim Kim Kyun Oh Han Ahn Kim Kim Lee Woo-Jin Kim Lee Ji Byeungwoo Woong Il Rinchul Koenen Bruls van der Meer Oomen Gelissen Vanderschaar van den Heuvel Tokmakoff Perkis Bjontegaard Blaszak Domañski Navarro Ascenso Pereira Kjörling Purnhagen Fröjdh Lin Ong Rahardja Yu Zhengguo Liu Chong Chong Soon Huang Huang Ji Neo Shen Joo Hee Sangwook Kim Sang Eunmi Mahnjin Jeong-Hwan Sang Kyun Woo-Shik Jong Won Han Hae Kwang Yung Kyunghee Jeon Choi Kim Rob Wha Jan A.W.J. Jean H.A. Mihaela Bas Andrew Andrew Gisle Lukasz Marek Antonio João Fernando Kristofer Heiko Per Xiao Ee Ping Susanto Rongshan Li Jing Kok Seng Lim Lee Men Zhongyang Ming Sua Hong Shengmei Samsung Samsung Samsung Samsung Samsung AIT Samsung AIT Samsung AIT Samsung AIT Samsung Electronics Samsung Electronics Sejong University Sejong University SIT SKKU Sung Kyun Kwan University Univ. of Seoul InterTrust Philips Philips Philips PDSL-E Philips Research Philips Research Royal Philips Electronics Telematica Instituut NTNU Tandberg Poznan University of Technology Poznañ University of Technology Aveiro University EST-IT Instituto Superior Técnico Coding Technologies Coding Technologies Ericsson Institute for Infocomm Research Institute for Infocomm Research Institute for Infocomm Research Institute for Infocomm Research Institute for Infocomm Research Panasonic Singapore Laboratories Panasonic Singapore Laboratories Panasonic Singapore Laboratories Panasonic Singapore Laboratories Panasonic Singapore Laboratories Panasonic Singapore Laboratories Panasonic Singapore Laboratories Panasonic Singapore Laboratories 15 KR KR KR KR KR KR KR KR KR KR KR KR KR KR KR KR NL NL NL NL NL NL NL NL NO NO PL PL PT PT PT SE SE SE SG SG SG SG SG SG SG SG SG SG SG SG SG Chen Hang Tung Tsai Chung-Neng Wang Levantovsky Zatsman Singer Quackenbush Cornog Melby Zhong Feng Chi Gandee DeMartini Wang Bossen Vincent Hsueh-Ming Yi-Shin Chun-Jen Allen Vladimir Alex David Schuyler Katie Alan Sheng Wang Bradford Thomas Xin Frank Husak Vinton McMahon Rabbani Topiwala Swaminathan Schirling Smith Ng Haque Chen Nalebuff Sullivan Tescher Bourges-Sevenier Chiang Vetro Sun Luthra Narasimhan Russel Chang Fenimore Chau Powell Lu Tao Sagetong Reznik Walter Mark Tom Majid Pankaj Kumar Peter John R. Kia Munsi Fang-Chu Martha Gary Andrew Mikael Tihao Anthony Huifang Ajay Sam Chris Wo Charles Kwok Ged Jiuhuai Chen Phoom Yuriy US National Chiao Tung Univ. US National Taiwan University US National Chiao Tung Univ. US National Chiao Tung Univ./ITRI US Agfa Monotype Corp. US Analog Devices, Inc US Apple US Audio Research Labs US Avid Technology US Brigham Young University US Broadcom Corp US Conexant Systems, Inc. US ContentGuard, Inc. US ContentGuard, Inc. US ContentGuard, Inc. US DoCoMo Communications Laboratories USA, US Inc. Dolby Labs US Dolby Labs US Dolby Labs US Eastman Kodak US FastVDO US Hughes Electronics US IBM Research US IBM T. J. Watson Research Center US ICSRiM University of Leeds UK US Intel Corporation US ITRI US Microsoft US Microsoft US Microsoft US Mindego Inc. US Mitsubishi Electric US Mitsubishi Electric US Mitsubishi Electric Research Labs US Motorola US Motorola US MPA US NIST US NIST US NJR Corporation US NTT DoCoMo, Inc. US Panasonic US Panasonic Hollywood Lab US Qualcomm Incorporated US RealNetworks, Inc. US 16 Block Woods Gordon Sun Lei Symes Visharam Tabatabai Chen Swaminathan Fernandes Boyce Tourapis Gomila Yu Chung Steyn Bruce John Stephen Shijun Shawmin Peter Mohammed Zubair Ali George Viswanathan Felix Jill Alexis Michael Cristina Haoping Wilson Dr. Jacques Recording Industry Association of America Rensselaer Polytech Sand Video Sharp Labs of America Sharp Labs of America SMPTE Sony US US US US US US US Sony STMicroelectronics Sun Microsystems Inc. Texas Instruments Thomson Thomson US US US US US US Thomson Thomson Xilinx Monash South Africa US US US ZA 17 Annex 2 Agenda 1. 2. 3. 4. 5. 6. 7. 8. 1. 8.1 1.1. 1.2. 1.3. 1.4. 1.5. 1.6. 1.7. 1.8. 1.9. 1.10. 1.11. 1.12. 1.13. 1.14. 1.15. 1.16. 8.2 2.1. 2.2. 2.3. 2.4. 2.5. 8.3 3.1. 3.2. 3.3. 3.4. 3.5. 3.6. 3.7. 3.8. 8.4 4.1. Agenda item Opening Roll call of participants Approval of agenda Allocation of contributions Communications from Convenor Report of previous meeting Processing of NB Position Papers Work plan Media coding MPEG-2 AAC BW Extensions conformance AVC Conformance AVC Fidelity Range Extensions AVC Fidelity Range Extensions Conformance AFX Conformance AFX Extensions Audio Lossless Coding Audio Scalable Lossless Coding 1-bit Audio Lossless Coding HE-AAC Conformance SA Conformance Scalable Video Coding Streaming Text Format Spatial Audio Coding Video Coding Tool Repository 3D AV Coding Composition coding Audio BIFS Extensions Audio BIFS Conformance XMT extensions Lightweight Scene Representation Symbolic Music Representation Description coding Efficient representation of descriptions Video Descriptors Audio Descriptors MDS user preference extensions MPEG-7 Conformance Extensions MPEG-7 Profiles Schema definition Extraction and use of MPEG-7 descriptions extensions Systems support Carriage of ISAN and V-ISAN metadata 18 4.2. 4.3. 4.4. 4.5. 8.5 5.1. 5.2. 5.3. 5.4. 8.6 6.1. 6.2. 6.3. 6.4. 6.5. 6.6. 8.7 7.1. 7.2. 8.8 8.1. 8.2. 8.2. 8.3. 8.9 9.1. 9.2. 9.3. 9.4. 9.5. 9.6. 9.7. 9.8. 9.9. 8.10 10.1. 10.2. 8.11 11.1 11.2 11.1 11.2 11.3 9. 10. 10.1 10.2 New audio profile and level signaling MPEG-1 Audio access units Streaming of MPEG-7 descriptions Timestamps and Audio Codec Behavior IPMP MPEG-2 IPMP-X Conformance MPEG-4 IPMP-X Conformance Evaluation Tools for Persistent Association MPEG-21 IPMP Framework Digital Item Digital Item Declaration Digital Item Binarisation DIA Conversions and Permission Event Reporting MPEG-21 Conformance Vision, technologies and strategy Transport and File Format ISO File Format extensions MPEG-21 File Format Multimedia architecture MPEG-J extension for scene control MPEG-J extension for rendering Digital Item Processing MPEG Multimedia Middleware Reference implementation AVC Reference Software HE-AAC Reference Software AFX Reference Software AVC Fidelity Range Extensions Reference Software MPEG-4 Visual Reference Hardware Description MPEG-4 AVC Reference Hardware Description MPEG-7 Reference Software Extensions MPEG-21 Reference Software Test Bed for MPEG-21 Resource Delivery Application formats Music player Application Format Photo album Application Format Maintenance Video coding standards Audio coding standards Visual description coding standards Audio description coding standards MDS standards Liaison matters Organisation of this meeting Tasks for subgroups Joint meetings 19 11. 11.1 11.2 12. 13. 14. 15. Administrative matters Schedule of future MPEG meetings Promotional activities Planning of future activities Resolutions of this meeting A.O.B Closing 20 Annex 3 Input document list No. Authors Title 1045 Wo Chang 6 Document Register for SC29/WG11 Meeting Munich, DE 1045 Robert Turney 7 Marco Mattavelli AHG on MPEG-4 Part 9 Reference Hardware Description Phase 1 and 2 Marius Preda 1045 Mahnjin Han 8 Mike Bourges-Sevenier AHG on AFX documents editing and Core Experiments 1045 Mahnjin Han 9 Patrick Gioia AHG on AFX Conformance 1046 Jens Spille 0 AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4 Ralph Sperschneider 1046 on behalf of the AHG on 1 MPEG-4 Audio Conformance Report of the AHG on MPEG-4 Audio Conformance Ralph Sperschneider Heiko Purnhagen 1046 on behalf of the AHG on 2 MPEG-2 AAC and MPEG-4 Audio Text and Software Report of the AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software 1046 W. Oomen 3 AHG on MPEG-4 Audio Extensions 1 and 2 1046 Tilman Liebchen 4 AHG on MPEG-4 Audio Lossless Coding 1046 Matthias Gruhne 5 AHG on MPEG-7 Audio 1046 Paolo Nesi 6 Giorgio Zoia AHG on Music Notation Requirements 1046 Schuyler Quackenbush 7 AHG on Timestamps and Audio Codec Behavior 1046 Schuyler Quackenbush 8 AHG on Audio Explorations Myriam Amielh Gerrard Drury 1046 Sylvain Devillers 9 Yongju Cho Craig Brown AHG on MPEG 21 Media Locators Xin Wang 1047 Jaime Delgado 0 Chris Barlas AHG on MPEG-21 REL and RDD Reference Software Anthony Vetro 1047 Christian Timmerer 1 Sylvain Devillers Thomas DeMartini AHG on DIA Editing 21 Jorg Heuer 1047 Debargha Mukherjee 2 Sylvain Devillers Christian Timmerer AHG on Bit-stream Adaptation in Constrained and Streaming Environments Christian Timmerer 1047 Gerrard Drury 3 Frederik De Keukelaere AHG on MPEG-21 DIA Reference Software Gerrard Drury 1047 Frederik De Keukelaere 4 Munchurl Kim AHG on MPEG-21 DIP Reference Software Gerrard Drury 1047 Rik Van de Walle 5 Munchurl Kim AHG on Editing and Core Experiments for DIP T. Chiang 1047 Yi-Shin Tung 6 Chung-Neng Wang AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance 1047 Miroslaw Bober 7 Sang-Kyun Kim AHG on Visual Descriptors and Visual-only Description Schemes in MPEG-7 A. Yamada 1047 S. K. Kim 8 L. Cieplinski AHG on Editing MPEG-7 Visual related Documents 1047 Aljoscha Smolic 9 Hideaki Kimata AHG on 3DAV Coding Mihaela van der Schaar A. Becker 1048 J. Ridge 0 C.J. Tsai Vittorio Baroncini AHG on Scalable Video Coding Claude Seyrat 1048 Ali Tabatabai 1 Itaru Kaneko AHG on MPEG-7 Systems Jean-Claude Dufourd 1048 Yuval Fisher 2 Juergen Schmidt AHG on MPEG-4 Scene Representation 1048 Dave Singer 3 AHG on MPEG File format 1048 Mikael Bourges-Sevenier 4 Vishy Swaminathan AHG on MPEG-J Extensions 1048 Jean-Claude Dufourd 5 AHG on Reference Software Chun-Jen Tsai 1048 Mihaela van der Shaar 6 Young-Kwon Lim Doug Young Suh AHG on MPEG Multimedia Test Bed Thomas DeMartini 1048 Sylvain Devillers 7 Frederik De Keukelaere Gerrard Drury AHG on MPEG-21 Conformance 1048 Kohtaro Asai 8 AHG on Intra-only Coding in MPEG 22 Simon Watt 1048 Bas van den Heuvel 9 Craig Schultz AHG to complete requirements for MPEG-21 IPMP Artur Lugmayr 1049 Abdellatif Benjelloun Touimi 0 Jong-Nam Kim Itaru Kaneko AHG on study of MPEG-21 and broadcasting 1049 Brad Gandee 1 Chris Barlas AHG on Profiles and Extensions for the MPEG-21 REL 1049 Wo Chang 2 Masanori Sano AHG on MPEG-7 Interoperability and Profiling 1049 Wo Chang 3 Olivier Avaro AHG on Multimedia Application Format (MAF) 1049 FX Nuttall 4 Andrew Tokmakoff AHG on MPEG-21 Event Reporting 1049 Craig Schultz 5 Discussion on MPEG-21 IPMP Requirements 1049 SC 24 via SC 29 Secretariat 6 ISO/IEC FCD 19774: Information technology -- Computer graphics and image processing -- Humanoid animation (HAnim) [SC 29 N 5756] 1049 TVA via SC 29 Secretariat 7 Liaison Statement from the TV-Anytime Forum [SC 29 N 5757] 1049 Cieplinski 8 UK NB comments on Text of ISO/IEC 15938-8/PDAM1 1049 Cieplinski 9 UK NB comments on Text of ISO/IEC CD 15938-10 1050 Cieplinski 0 UK NB comments on Text of ISO/IEC 15938-10 CD 1050 TVA via SC 29 Secretariat 1 Liaison Statement from the TV-Anytime Forum [SC 29 N 5789] Bhavan Gandhi Peter van Beek 1050 John R. Smith 2 Alan K. Melby Elisha Berns Terms and Definitions for MPEG-7 Profiles 1050 Alan K. Melby 3 John R Smith Proposal for logical media locator for MPEG 7&21 1050 SC 29 Secretariat 4 Summary of Voting on ISO/IEC 13818-1:2000/PDAM 4 [SC 29 N 5808] 1050 SC 29 Secretariat 5 Summary of Voting on ISO/IEC TR 144967:2002/Amd.1/DCOR 1 [SC 29 N 5909] 1050 SC 29 Secretariat 6 Summary of Voting on ISO/IEC 14496-2:200X/DCOR 1 [SC 29 N 5910] 1050 SC 29 Secretariat 7 Summary of Voting on ISO/IEC CD 15938-10 [SC 29 N 5911] 1050 ITU-T SG 16 via SC 29 8 Secretariat Liaison Statement from ITU-T SG 16 on Audio Information [SC 29 N 5813] 1050 ITU-T SG 16 via SC 29 Liaison Statement from ITU-T SG 16 [SC 29 N 5814] 23 9 Secretariat 1051 Ryoichi Kawada 0 Comments to MPEG 3DAV activities 1051 George Chen 1 ST dataset for 3DAV EE2 1051 George Chen 2 Using inter-view prediction for multi-view video compression 1051 George Chen 3 Response to 3DAV CfC 1051 SC 29 Secretariat 4 Summary of Voting on ISO/IEC TR 15938-8/PDAM 1 [SC 29 N 5820] 1051 Ken-ichiro Yamamoto 5 Comments to MPEG 3DAV activities 1051 Thomas DeMartini 6 Suggested Edits for Digital Item Adaptation Amendment 1 Working Draft 1.0 Yi-Shin Tung 1051 Chung-Neng Wang 7 Tihao Chiang Jens-Rainer Ohm MPEG-4 Visual: List of Problems Reported, v.11.1 1051 IDF via SC 29 Secretariat 8 IDF's Response to Evaluation Criteria for Appointing JTC 1 RA of ISO/IEC 21000-6 [SC 29 N 5825] 1051 Helge Drumm 9 CE Shadow Algorithm 1052 Ali Tabatabai 0 Comments to MPEG on 3DAV activities Xin Wang 1052 Venugopal Venkatraman 1 Frederik De Keukelaere Rik Van de Walle Simple Integration Reference Software for MPEG-21 REL and DID 1052 Hideyuki Kanayama 2 Comments to MPEG 3DAV activities 1052 Paul Schumacher 3 Robert Turney HDL Virtual Socket Platform Rev 1.0 for MPEG-4 Part 9 1052 Doug Young Suh 4 Seung Ho Park Inter-block shuffling FGS 1052 ITTF via SC 29 Secretariat 5 Table of Replies on ISO/IEC FDIS 21000-5 [SC 29 N 5832] 1052 ITTF via SC 29 Secretariat 6 Table of Replies on ISO/IEC 14496-2:200X/FDAM 1 [SC 29 N 5833] 1052 ITTF via SC 29 Secretariat 7 Table of Replies on ISO/IEC 14496-4:200X/FDAM 3 [SC 29 N 5834] 1052 SC 29 Secretariat 8 Summary of Voting on ISO/IEC 15938-5/PDAM 2 [SC 29 N 5835] 1052 Niels Rump for the UKNB 9 UKNB Position on Document Deadlines 1053 Jean Gelissen 0 MPEG Multimedia Middleware: Context and Objective (Update) 24 1053 Hui Zhang 1 MPEG-7 Visual part of eXperimentation Model Version 19.0 Hui Zhang 1053 Duck Hoon Kim 2 In Kyu Park Release of Perceptual 3D Shape (P3DS) XM software 1053 Ryoichi Kawada 3 KDDI multiview video sequences for MPEG 3DAV use Vieron Francois 1053 Bottreau 4 Guillemot Boisson Marquant Discussion on some CFP requirements and proposal for core experiments Demin Wang 1053 Liang Zhang 5 Andre Vincent Curved Wavelet Coding for Scalable Video Coding 1053 Wo Chang 6 Multimedia Application Format (MAF) Overview Document 1053 Béatrice Pesquet-Popescu 7 Grégoire Pau Response to the CfP on Scalable Video Coding : Motioncompensated scalable subband video codec with optimized temporal prediction and update operators 1053 Béatrice Pesquet-Popescu 8 Christophe Tillier Response to the CfP on Scalable Video Coding : Motioncompensated triadic temporal scalable codec 1053 3GPP via SC 29 Secretariat 9 Liaison Statement from 3GPP [SC 29 N 5842] 1054 SC 29 Secretariat 0 Summary of Voting on ISO/IEC 144963:2001/Amd.1:2003/DCOR 1 [SC 29 N 5843] 1054 SC 29 Secretariat 1 Summary of Voting on ISO/IEC 13818-7:2003/DCOR 1 [SC 29 N 5844] 1054 SC 29 Secretariat 2 Summary of Voting on ISO/IEC 14496-3:2001/DCOR 2 [SC 29 N 5845] 1054 SC 29 Secretariat 3 Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 7 1054 SC 29 Secretariat 4 Summary of Voting on ISO/IEC 13818-1:2000/PDAM 5 1054 SC 29 Secretariat 5 Summary of Voting on ISO/IEC 14496-4:200X/PDAM 8 1054 SC 29 Secretariat 6 Summary of Voting on ISO/IEC 14496-11/PDAM 3 1054 SC 29 Secretariat 7 Summary of Voting on ISO/IEC 14496-12/PDAM 1 & ISO/IEC 15444-12/PDAM 1 1054 SC 29 Secretariat 8 Summary of Voting on ISO/IEC PDTR 21000-1 [2nd Edition] 1054 SC 29 Secretariat 9 Summary of Voting on ISO/IEC PDTR 21000-11 1055 SC 29 Secretariat 0 Summary of Voting on ISO/IEC 13818-4:200X/PDAM 2 1055 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-10/DCOR 1 25 1 1055 ITTF via SC 29 Secretariat 2 Table of Replies on ISO/IEC FDIS 14496-15 1055 Morimura 3 Comments to MPEG 3DAV activities 1055 David Singer 4 Handling Audio Pre-roll in MPEG-4 1055 A. G. Tescher for USNB 5 USNB Contribution: ISO/IEC 14496-12 modifications Filippo Chiariglione Panos Kudumakis 1055 Yona Sadigurshi 6 Robert Noah Kevin Murray Markus Berg Comments on MPEG-21 IPMP Requirements 1055 A. G. Tescher for USNB 7 USNB Contribution: ISO/IEC 14496-11 issues 1055 A. G. Tescher for USNB 8 USNB Contribution: “Audio Type” Issues 1055 A. G. Tescher for USNB 9 USNB Contribution: MPEG-7 profiles 1056 A. G. Tescher for USNB 0 USNB Contribution: Demographic Information 1056 A. G. Tescher for USNB 1 USNB Contribution: MPEG-21 Media Locators 1056 A. G. Tescher for USNB 2 USNB Contribution: 14-bit sample depth support 1056 Artur Lugmayr 3 MPEG-21 in Broadcasting Use-Case: Metadata Filtering (refinement 1) 1056 Artur Lugmayr 4 Xiao Duan MPEG-21 for the exchange of personal profiles between embedded devices 1056 Okui 5 Comments to MPEG on 3DAV activities IST-SCHEMA Vasileios Mezaris 1056 Yiannis Kompatsiaris 6 Stephan Herrmann Josep Casas Experimental results for a Search & Retrieval System using MPEG-7 still image descriptors 1056 Singapore National Body 7 SgNB Comment on the Collaborative Phase of the Audio Scalable Lossless(SLS) Coding Work Item. 1056 Jerome Barthelemy 8 Benoit Meudic Proposed MPEG 7 audio tools 1056 Jens-Rainer Ohm 9 Registered Responses to the CfP on Scalable Video Coding 1057 Shinjun Lee 0 Mahnjin Han Improvement of PointTexture Compression in Depth ImageBased Representation (DIBR) 1057 Gyeong Ja Jang 1 Shinjun Lee Proposal of XMT-A specifications for PointTexture Compression 26 James D. K. Kim Mahnjin Han Thomas DeMartini 1057 Vishy Swaminathan 2 Anthony Vetro Preliminary Comments on DIP CD Eva Rodriguez 1057 Jaime Delgado 3 Silvia Llorente DMAG REL Interpretation Conformance 1057 Eva Rodriguez 4 Jaime Delgado DMAG REL License Interpretation using RDD term genealogy – Implementation using Web Services Victor Torres 1057 Jaime Delgado 5 Eva Rodriguez Contribution to DID/REL/RDD reference software: DMAG REL License Interpretation within DID using RDD term genealogy 1057 Systems Group 6 MPEG IPMP Introduction Jaime Delgado Eva Rodriguez 1057 Silvia Llorente 7 Roberto Garcia Victor Torres Status of DMAG Reference Software for MPEG-21 REL/RDD/DID 1057 Takehiro Moriya 8 Proposed draft for WD 3 of ISO/IEC 14496-3:2001/AMD 4, Audio Lossless Coding (ALS) Stephan Wuermlin Matthias Zwicker 1057 Michael Waschbuesch 9 Markus Gross Hanspeter Pfister Results on Core Experiment on Point based Rendering for MPEG-4 AFX Stephan Wuermlin 1058 Michael Waschbuesch 0 Markus Gross ETH-REAL: A real-world test data set for 3DAV EE2 Michael Waschbuesch Stephan Wuermlin 1058 Edouard Lamboray 1 Markus Gross Hanspeter Pfister Average Coding of Free-viewpoint Video in MPEG-4 James D. K. Kim 1058 Jeong-Hwan Ahn 2 Sang Oak Woo Proposal for Real-Time Water Simulation Jeong-Hwan Ahn 1058 James D. K. Kim 3 Sang Oak Woo Proposal for Cloth Animation Michael Ransburg 1058 Christian Timmerer 4 Hermann Hellwagner Status Report and Improvements of the MPEG-21 DIA Reference Software 1058 Christian Timmerer 5 Hermann Hellwagner Comments on MPEG-21 DIP CD Christian Timmerer 1058 Hermann Hellwagner 6 on behalf of the ANB Austrian NB comments on PDTR 21000-1 2nd Edition 1058 Gregoire Pau MPEG-7 BiM Reference Software Status 27 7 Claude Seyrat Filippo Chiariglione 1058 Panos Kudumakis 8 Pascal Nourry Comments on MPEG-2/4 IPMP Extensions Yiannis Andreopoulos Fabio Verdicchio 1058 Joeri Barbarien 9 Adrian Munteanu Mihaela van der Schaar Peter Schelkens Response to Call for Proposals on Scalable Video Coding Technology (proposal 21 - tool) 1059 Vladimir Levantovsky 0 Proposed modifications for implementation of MPEG-4 font compression and streaming 1059 Bruls Jan van der Meer 1 Rational for heterogeneous layered video support in MPEG2 Systems (as in M10359) 1059 van der Meer Fons Bruls 2 Proposal for MPEG-2 System amendment to support heterogeneous layered video 1059 Gyeong Ja Jang 3 James D. K. Kim Implementation the Reference software of AFX Encoder and User Guide Sung Won Park Jong Woo Won 1059 Sun young Lee 4 Yong Ho Cho Euee S.Jang Wook Joong Kim Panoramic Video Coding Results 1059 Akio Yamada 5 Sang-Kyun Kim MPEG-7 Visual XM Document version 19.1 1059 Akio Yamada 6 Sang-Kyun Kim Second Editor's Study on ISO/IEC TR 15938-8/PDAM1 1059 Akio Yamada 7 Report on progress of VCE-1 1059 Akio Yamada 8 Comments on MPEG 3D-AV Standardization Activities 1059 Takeshi Nakamura 9 Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition Toshio Miki 1060 Tsutomu Horikoshi 0 C.S. Boon In Response to ”Call for Comments on 3DAV” 1060 SC 29 Secretariat 1 Late Vote on ISO/IEC 14496-3:2001/Amd.1:2003/DCOR 1 [SC 29 N 5849] 1060 SC 29 Secretariat 2 Late Vote on ISO/IEC 13818-7:2003/DCOR 1 [SC 29 N 5851] 1060 SC 29 Secretariat 3 Late Vote on ISO/IEC 14496-3:2001/DCOR 2 [SC 29 N 5852] Tomokazu Murakami 1060 Masahiro Kageyama 4 Yo-ichi Horii Comments to MPEG on 3DAV activities Myriam Amielh 1060 On behalf of the AhG for 5 MPEG-21 Medialocs Suggested updates to the definitions of a DID fragment in DID v.2 28 1060 Tilman Liebchen 6 Patrick Runge Verification Report on MPEG-4 ALS Core Experiment 3 (Coding of Audio in Floating-Point Format) 1060 Tilman Liebchen 7 Takehiro Moriya Proposed Core Experiment for Improved Coding of Random Access Frames in MPEG-4 ALS 1060 Singapore National Body 8 SgNB Comment on AVC Fidelity Range Extension 1060 Frederik De Keukelaere 9 Rik Van de Walle Contribution to DID 2nd Edition reference software 1061 Frederik De Keukelaere 0 Rik Van de Walle Contribution to DII reference software Frederik De Keukelaere 1061 Jeroen Bekaert 1 Rik Van de Walle Comments on ISO/IEC 21000-2 DID 2nd Edition WD v.2 1061 David Singer 2 URL Forms for Container Files 1061 Chris Barlas 3 RDD Registration Authority - Rightscom submission 1061 Holger Crysandt 4 Cross check results of the Audio Pattern Description Schema Jérôme Caporossi 1061 Melanie Dulong de Rosnay 5 Daniela Parayre Pierre Sarda Proposed requirement for MPEG-21 IPMP 1061 Marc Gauvin 6 Melanie Dulong de Rosnay The Notion of Underlying Work within MPEG 21 Bernhard Grill Johannes Hilpert 1061 Manfred Lutzky 7 Martin Weishart Ernst F. Schroeder MPEG-1/2 Audio Layer 3 For Low And High Sampling Rates Youngjoo Song 1061 Kyunghee Ji 8 FX Nuttall Andrew Tokmakoff Proposed MPEG-21 Event Reporting Data Structure as Digital Item Kyunghee Ji 1061 Nammee Moon 9 Youngjoo Song Jinwoo Hong Proposed Definition on Delivery Time and Recipient of MPEG-21 Event Reporting 1062 Simon Watt 0 CRF Liaison to MPEG Jeroen Bekaert Frederik De Keukelaere 1062 Robbie De Sutter 1 Rik Van de Walle on behalf of the Belgian NB BNB Comments on ISO/IEC 21000-10 CD Part 10: Digital Item Processing 1062 Giorgio Zoia 2 James Ingram A New Application Scenario for Music Notation in MPEG 1062 Hanspeter Pfister 3 Anthony Vetro Response to the Call for Comments on 3DAV 29 Huifang Sun Hanspeter Pfister 1062 Anthony Vetro 4 Huifang Sun 3D TV System Xin Wang 1062 Thomas DeMartini 5 Brad Gandee Comments on Requirements for MPEG-21 IPMP and Reference Model Lukasz Blaszak 1062 Marek Domanski 6 Rafal Lange Adam Luczak Scalable AVC Codec 1062 Jeongil Seo 7 Jerome Daniel CE Report on AdvancedAcousticScene node for MPEG-4 Audio BIFS version 3 Thomas DeMartini 1062 Venugopal Venkatraman 8 TJ Pannu Xin Wang Contribution to MPEG-21 REL Interpretation Conformance Test Cases 1062 Kate Grant 9 Requirements for conversion descriptions in a live radio broadcasting environment Munchurl Kim (ICU) 1063 Hendry (ICU) 0 Keonsoo Park (KBS) Huang Zhongyang (PSL) CE reports on DIBO explorations Wook-Joong Kim 1063 Euee. S. Jang 1 et al. A response to the call for comments on 3DAV Wook-Joong Kim 1063 Euee. S. Jang 2 et al. B-map method for the partial decoding and rendering of panoramic video Merrill Weiss 1063 Oliver Morgan 3 Peter Symes SMPTE Liaison to MPEG on V/ISAN and ISO 13818-1 DAM4 1063 Etsuko Sugimoto 4 Proposed Corrigendum to ISO/IEC 14496-4:200X Senator Jeong Ji-Hyun Park 1063 Yeon-Jeong Jeong 5 Weon-Guen Oh Chang-Yeol Lee Response to the CfP on Event Reporting; Proposed Event Reporting Language Gernot Ziegler 1063 Hendrik Lensch 6 Marcus Magnor Multi-Video Compression in Texture Space 1063 Yuriy Reznik 7 Comments on MPEG-4 ALS CE3 reference software 1063 Yuriy Reznik 8 Proposed CE on Coding of LPC Coefficients in MPEG-4 ALS 1063 Sang-Kyun Kim 9 Introduction report: The emerge of MS Longhorn 1064 Sang-Kyun Kim Initial report on Visual tools and DS for images or photos 30 0 Seungji Yang Yong Man Ro libraries (VCE-1) Eunmi Oh 1064 Jung-Hoe Kim 1 Miao Lei SangWook Kim Report on MPEG-4 SLS Core Experiment 3 (Contextdependent entropy coding) Eunmi Oh 1064 Miyoung Kim 2 SangWook Kim MPEG-4 BSAC multi-channel support 1064 Ernest Wan 3 Myriam Amielh Two Proposed DIBOs for handeling a DID Anchor 1064 Stephen Davis 4 Ian Burnett Binarisation of MPEG-21 DIDs Yongju Cho Youngkwon Lim 1064 Hyung-Joong Kim 5 Moon-Sup Song Jinwoo Hong Jinwoong Kim Proposed Resource Reference Box for media resource referencing Itaru Kaneko (Waseda) 1064 Mika Onishi Neergaard 6 (MMG) MMG-Waseda proposal onIssues in binary coding(binaization) of MPEG-21 DID Itaru Kaneko (Waseda) Osama K Alshaykh (Packet Video) 1064 Junya Tsutsumi (HI) 7 Mark Callow (HI) Jiro Katto (Waseda) Daisuke Inoue (Waseda)<B HI Corp., Waseda Univ. and Packet Video’s Response to Call for Proposal (SC29 WG11 N 6095) 1064 Wo Chang 8 Preliminary FCD on MPEG-7 Profile 1064 Hideaki Kimata 9 JNB comments on MPEG 3DAV Takuyo Kogure 1065 CS Lim 0 Toshiya Takahashi Taka Senoh Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition 1065 Hideaki Kimata 1 Comments to MPEG 3DAV activities 1065 Hideaki Kimata 2 Preliminary results on inter-view coding for the dense Ray Space representation (3DAV EE2.2.1) Mayumi Koike 1065 Takuyo Kogure 3 Terumasa Aoki Profiling Consideration for MPEG-4 IPMP Paolo Nesi 1065 Pierfrancesco Bellini 4 Giorgio Zoia Jerome Barthelemy Music Notation Technical Requirements and Integration in MPEG-4 1065 Marius Preda 5 Francoise Preteux MorphShape Node Implementation in Reference Software 31 Frederic Vexo Marius Preda 1065 Francoise Preteux 6 Frederic Vexo BBA stream update for morphing-based virtual character animation 1065 Titus Zaharia 7 Francoise Preteux Comparative study for 3D and 2D/3D Shape Descriptors 1065 Akira Morishita 8 Yuzo Hirayama Response to the Call for Comments on 3DAV 1065 IEC TC 100 via SC 29 9 Secretariat IEC CDV 62297-1: Triggering messages for broadcast applications -- Part 1: Format [SC 29 N 5856] 1066 IEC TC 100 via SC 29 0 Secretariat IEC CDV 62297-2: Triggering messages for broadcast applications -- Part 2: Transport [SC 29 N 5857] Paolo Nesi 1066 Pierfrancesco Bellini 1 Giorgio Zoia Jerome Barthelemy Proceedings of AHG on Music Notation Requirements 1066 Shlomo Birman 2 Yorame Elichai SynthesizedTexture Implementation in IM1 1066 Oliver Baum 3 Jürgen Schmidt Comments on 3DAV Report regarding 3D Audio 1066 chen 4 chiu bit reordering in SLS enhancement layer 1066 Steliaros K Grant 5 UKNB comment on Graphics API 1066 Marco Rittermann 6 Response to the Call for Comments on 3DAV 1066 Kazumasa Yamazawa 7 Proposal of Application Format for Omni-directional Video 1066 Masayuki Tanimoto 8 Toshiaki Fujii Comparison of Temporal and Spatial Predictions for Dynamic Ray-Space Coding Andreas Dantele 1066 Marco Rittermann 9 Christian Weigel Response to the Call for Comments on 3DAV 1067 Masayuki Tanimoto 0 Toshiaki Fujii Data Compression and Interpolation of Spherical Ray-Space 1067 JNB 1 JNB Comment on MPEG-4 AVC Fidelity Range Extension 1067 Murray K Grant 2 UKNB Position paper on CVS Server 1067 Aljoscha Smolic 3 Response on Call for Comments on 3DAV Aljoscha Smolic 1067 Sebastian Heymann 4 Karsten Mueller Yong Guo Demonstration of a MPEG-4 Complient System for Omnidirectional Video 1067 Rump 5 Overview of responses to N6278 : MPEG-21 Event Reporting Call for Proposals 32 Aljoscha Smolic Karsten Mueller 1067 Philipp Merkle 6 Tobias Rein Peter Eisert Thomas Wiegand Results for EE2 on Model Reconstruction Free Viewpoint Video 1067 Kohtaro Asai 7 Response to the Call for Comments on 3DAV 1067 Kristofer Kjörling 8 Proposed additions to the ISO/IEC 13818-4:200X/PDAM2 (Audio Conformance) document in order to specify SBR conformance for MPEG-2. 1067 Kristofer Kjörling 9 Andreas Schneider Additions to, and clarifications of MPEG-4 SBR conformance. 1068 Kristofer Kjörling 0 Proposed corrections and additions to the present ISO/IEC 14496-4:2001/AMD1:2003/Dcor1. 1068 Rongshan Yu 1 Crosscheck for Samsung’s Proposal on Context-Dependent Entropy Coding for MPEG Audio SLS Rongshan Yu 1068 Xiao Lin 2 Susanto Rahardja Haibin Huang Proposed WD2 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS) Rongshan Yu 1068 Xiao Lin 3 Susanto Rahardja Haibin Huang Proposed Core Experiment for Improving Coding Efficiency of MPEG-4 Audio Scalable Coding (SLS) Jean-Claude Dufourd 1068 Olivier Avaro 4 Cyril Concolato Support of SVG1.2 in LASER 1068 Jean-Claude Dufourd 5 Olivier Avaro Test Data set Description for LASER Evaluation 1068 Jean-Claude Dufourd 6 Olivier Avaro Additional Requirements for LASER 1068 Olivier Avaro 7 Jean-Claude Dufourd Statement of Support for LASER 1068 Olivier Avaro 8 Jean-Claude Dufourd Proposed coordination between MPEG and W3C on LASER 1068 Olivier Avaro 9 Jean-Claude Dufourd Evaluation Software Requirements for LASER Karsten Müller Aljoscha Smolic 1069 Hanspeter Pfister 0 Stephan Würmlin Matthias Zwicker Proposal of 3D Camera Calibration Parameters for MPEG-4 AFX Karsten Müller 1069 Aljoscha Smolic 1 Thobias Rein View-Dependent Multi-Texturing for MPEG-4 AFX, Syntax and Semantics Specification 1069 Heiko Purnhagen 2 Kristofer Kjörling Information on HE-AAC decoder delay and timestamps 1069 Heiko Purnhagen Comments on Draft Call for Proposals on Spatial Audio 33 3 Kristofer Kjörling Coding 1069 Heiko Purnhagen 4 Martin Wolters Proposed clarifications of AAC conformance testing Andreas Hutter 1069 Daniel Peintner 5 Joerg Heuer Algorithms in BiM Version 2 Reference Software Jérôme Royan 1069 Christian Bouville 6 Patrick Gioia Proposal of new requirements for streaming geo-visual contents 1069 Mariam Kimiaei-Asadi 7 Jean-Claude Dufourd Proposal to Digital Item Adaptation Amendment 1 on Conversion Descriptors and Transmoding 1069 Mariam Kimiaei-Asadi 8 Jean-Claude Dufourd Contribution to Digital Item Adaptation Amendment 1 on Transcoding and Transforming Conversion Descriptors 1069 Melanie Dulong de Rosnay 9 FNB comments on Text of ISO/IEC 21000-1 2nd ed. PDTR 1070 Ralph Sperschneider 0 Status on MPEG-4 Audio Conformance 1070 Ralph Sperschneider 1 Proposed addition to ISO/IEC 14496-3:2001/Cor.2 Roberto Garcia 1070 Jaime Delgado 2 Eva Rodriguez Isabel Gallego MPEG REL and RDD Ontologies API Roberto Garcia 1070 Jaime Delgado 3 Isabel Gallego RELOntos (REL Ontologies) 1070 Patrick Gioia 4 Proposal for Compressed 3D Profile 1070 Abdellatif Benjelloun Touimi 5 Usage Scenarios Analysis for MPEG-21 in Broadcasting 1070 Hanke 6 Spatial Highpass Transition Filtering for Interframe Wavelet Video Coding Raphaèle Balter 1070 Patrick Gioia 7 Luce Morin Preliminary tests and evidences for EE on 3D model-based movie streaming 1070 Bober 8 Suggestions on experimental methodology in CE on Visual tools and DS for images or photos libraries (VCE-1). 1070 Bober 9 Report on progress of VCE-1 1071 Ralf Geiger 0 Markus Schmidt Cross-Check Report for MPEG-4 SLS Core Experiment 2 (Improved Coding Efficiency) Ralf Geiger 1071 Markus Schmidt 1 Jürgen Herre Proposed Core Experiment on MPEG-4 SLS 1071 Thomas Rusert 2 Layered Motion Vector Coding for Improved Spatial Scalability in Interframe Wavelet Video Coding 1071 Juergen Herre 3 Evaluation of Spatial Audio Coding Schemes: Performance Criteria and Test Methods 34 1071 Holger Crysandt 4 (Lossy) DescriptorModel compression 1071 S. R. Quackenbush 5 Audio Subgroup Report for the 67th MPEG Meeting Charith Abhayaratne 1071 Nikola Sprljan 6 Marta Mrak Ebroul Izquierdo Response to the SVC CfP: A spatial decomposition tool for improved spatial resolution scalability in video coding Andrea Kofler-Vogt; 1071 Joerg Heuer; 7 Andreas Hutter; Harald Kosch; Report on CE (Indexing) Christian Timmerer Hermann Hellwagner 1071 Jörg Heuer 8 Claude Seyrat Andreas Hutter BinaryXML – A Comparison of Existing XML Compression Techniques Thomas Di Giacomo 1071 Chris Joslin 9 Marius Preda Proposal for MassSpring Node for Animation 1072 S. R. Quackenbush 0 Cross-check on I2R’s Proposed Core Experiment 1072 Takhiro Moriya 1 Comments on Lossless Coding of Audio in Floating-Point Format 1072 Debargha Mukherjee 2 Sam Liu Proposal to support AdaptationQoS adaptation in DIA for multi-step adaptation Chung-Neng Wang 1072 Tihao Chiang 3 Huifang Sun Text of DTR 14496-7 Fifth Edition Hsiang-Chun Huang Wen-Hsiao Peng 1072 Yao-Chung Lin 4 Chung-Neng Wang Tihao Chiang Hsueh-Ming Hang Update of the Response to Cfp on Scalable Video Coding Technology: Proposal S07 -- A Robust Scalable Video Coding Technique 1072 3D Consortium via SC 29 5 Secretariat Liaison Statement from 3D Consortium [SC 29 N 5858] 1072 Ji Ming 6 Study Text of ISO/IEC 14496-4:2002/FPDAM4 (MPEG-4 IPMPX Conformance) 1072 Korea National Body (KNB) 7 KNB comment on 15938-5 PDAM2 : ContentCS extension 1072 Claude Seyrat 8 Editors study of the ISO/IEC 15938-1/FPDAM 1072 Claude Seyrat 9 Cédric Thiénot MPEG-7 Systems extensions: Results of Mini-Experiment #2 1073 Marius PREDA 0 Francoise Preteux Extensibility feature of the BBA stream. Corrigendum Proposal 1073 Chris Barlas 1 ISO/IEC 21000-6 : Proposal for Corrigendum 35 1073 Yiliang Bao none Marta 2 Karczewicz Scalable video coder with AVC-like properties 1073 Mikael Bourges-Sevenier 3 Aaron E. Walsh X3D Interactive profile, bitstream exchange update 36 Annex 4 Output document list Number Source Title 6298 Convener List of Documents from the Munich, DE Meeting 6299 Convener Resolutions of the Munich, DE Meeting 6300 Convener List of AHGs Established at the 68th Meeting in Munich, DE 6301 Convener Report of the 68th Meeting in Munich, DE 6302 Convener Guidelines for Electronic Distribution of MPEG and WG 11 Documents 6303 Convener Press Release of the 68th Meeting in Munich, DE 6304 HoD Meeting Notice of the 69th Meeting in Redmond, WA (US) 6305 HoD Guide for WG 11 Meeting Hosts 6306 HoD MPEG 101 6307 ISG ISO/IEC 14496-9/PDAM of AM 1: Information Technology – Coding of Audio Visual Objects - Part 9: Reference Hardware Description. 6308 ISG Request for Reference Hardware Description Extensions 6309 Convener 6310 SNHC AFX CE description 6311 SNHC ISO/IEC 14496-16/AMD1 WD 4.0 6312 SNHC AFX VM 14.0 6313 SNHC AFX 14496-16/DCOR1 6314 Systems DoC on ISO/IEC 13818-1:2000/PDAM4 6315 Systems Text of ISO/IEC 13818-1:2000/FPDAM4 6316 Systems DoC on ISO/IEC 13818-1:2000/PDAM5 6317 Systems Text of ISO/IEC 13818-1:2000/FPDAM5 6318 Systems Text of ISO/IEC 14496-1/DCOR3 6319 Systems DoC on ISO/IEC 14496-11/PDAM3 6320 Systems Text of ISO/IEC 14496-11/FPDAM3 6321 Systems Text of ISO/IEC 14496-11/COR2 6322 Systems DoC on ISO/IEC 14496-12/PDAM1 6323 Systems Text of ISO/IEC 14496-12/FPDAM1 6324 Systems Study Text of ISO/IEC 14496-17/FCD 6325 Systems DoC on ISO/IEC 15938-1/FPDAM1 AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2. 37 6326 Systems Text of ISO/IEC 15938-1/FDAM1 6327 Systems DoC on ISO/IEC 15938-1/DCOR1 6328 Systems Text of ISO/IEC 15938-1/COR1 6329 Systems Core Experiments for Systems Extensions 6330 Systems MPEG-7 Systems reference software work plan 6331 Systems Text of ISO/IEC 21000-9 CD 6332 Systems Technology under consideration for 21000-9 6333 Systems WD1.0 of Text of ISO/IEC 21000-16 6334 Systems Core Experiment on MPEG-21 Binarization 6335 Systems MPEG Multimedia Middleware Context and Objectives 6336 Systems Requirements on the MPEG Multimedia Middleware 6337 Systems CfP on Lightweight Application Scene Representation 6338 Systems MPEG IPMP Extensions Overview 6339 Systems Call for Registration Authority for IPMP_Tool_Id 6340 Liaison Liaison Statement to the TV-Anytime Forum 6341 Liaison Liaison Statement to SMPTE on V/ISAN and ISO 13818-1 DAM4 6342 Liaison Liaison Statement to AVS China 6343 Liaison Liaison Statement to ISO TC 46/SC 9 6344 Liaison Liaison Statement to IEEE-LTSC 6345 Liaison Liaison Statement to W3C 6346 Liaison Liaison Statement to JPEG 6347 Liaison Statement of benefits from establishing a Class C liaison with AVS China 6348 Liaison Responses to NB Comments 6349 Liaison List of WG11 Liaisons 6350 Convener AHG on AFX documents, CEs, and software 6351 Convener AHG on MPEG-J extensions for rendering 6352 JVT Request for Amendment 9 for ISO/IEC 14496-4: AVC Fidelity Range Extensions Conformance 6353 JVT Working Draft 1 of Amendment 9 for ISO/IEC 14496-4: AVC Fidelity Range Extensions Conformance 6354 JVT Study of FPDAM Text for AVC Conformance Amendment 6355 JVT Request for Amendment 8 for ISO/IEC 14496-5: AVC Fidelity Range Extensions Reference Software 6356 JVT Working Draft 1 of Amendment 8 for ISO/IEC 14496-5: AVC Fidelity Range Extensions Reference Software 38 6357 JVT Disposition of Comments on ISO/IEC 14496-10:2003/DCOR 1 6358 JVT Text of ISO/IEC 14496-10:2003/COR 1 6359 JVT Text of ISO/IEC 14496-10:2004 (second edition) 6360 JVT Study of FPDAM Text for AVC Professional Extensions Amendment 6361 Video Disposition of Comments on ISO/IEC 14496-2:2004 DCOR 1 6362 Video Text of ISO/IEC 14496-2:2004 COR 1 6363 Video MPEG-4 Visual: List of Problems Reported version 12.0 6364 Video WD 1.0 of 14496-4 Visual Bitstreams Conformance Corrigendum 6365 Video Text of 14496-7:200X (second edition) 6366 Video Request for 15938-3 Amd.2 (New Visual Extensions) 6367 Video WD 1.0 of MPEG-7 New Visual Extensions 6368 Video MPEG-7 Visual XM Document version 20.0 6369 Video Description of Core Experiments for MPEG-7 Visual Extensions 6370 Video Disposition of Comments on ISO/IEC TR 15938-8/PDAM1 6371 Video Text of ISO/IEC TR 15938-8/DAM1 6372 Video Scalable Video Model Version 1.0 6373 Video Description of Core Experiments in MPEG-21 Scalable Video Coding 6374 Video Draft Call for Evidence on Multiple View Video Coding 6375 Video Study of Video Coding Tools Repository 6376 Convener AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance 6377 Convener AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software 6378 Convener AHG on Description Tools for New Visual Extensions 6379 Convener AHG on Core Experiments in Scalable Video Coding 6380 Convener AHG on 3DAV Coding 6381 Convener AHG on Video Coding Tools Repository 6382 Test Results of the MPEG-4 Error Resilient Simple Scalable Profile Verification Test 6383 Test Subjective test results for the CfP on Scalable Video Coding Technology 6384 Requirements MPEG-2/4 Profiles under Consideration 6385 Requirements DoC for ISO/IEC 15938-9 CD 6386 Requirements Text of ISO/IEC 15938-9 FCD 6387 Requirements DoC on PDTR of ISO/IEC 21000-1 Second Edition 39 6388 Requirements Text of DTR of ISO/IEC 21000-1 Second Edition 6389 Requirements Requirements for MPEG-21 IPMP 6390 Requirements Updated Call for Proposals for MPEG-21 Intellectual Property Management and Protection 6391 Requirements DoC on PDTR of ISO/IEC 21000-11 6392 Requirements Text of DTR of ISO/IEC 21000-11 6393 Requirements Requirements for Omni-directional AV 0.1 6394 Convener AHG to evaluate responses to the MPEG-21 IPMP CfP 6395 Convener AHG on Multimedia Application Format (MAF) 6396 Convener AHG on MPEG-7 Profiles 6397 MDS DoC on ISO/IEC 15938-5 PDAM/2 6398 MDS ISO/IEC 15938-5 FPDAM/2 “MDS User Preference Extensions” 6399 MDS MPEG-7 MDS XM v.19 6400 Convener Terms of Reference 6401 Convener MPEG Standards 6402 Convener Table of unpublished standards at FDIS level 6403 Convener Work plan and time line 6404 Convener Work item assignment 6405 Convener List of patent statements received 6406 MDS ISO/IEC 15938-5 DCOR/1 6407 MDS DoC on ISO/IEC 15938-10 CD 6408 MDS ISO/IEC 15938-10 FCD “Schema Definition“ 6409 MDS ISO/IEC 21000-2 DID 2nd Edition CD 6410 MDS Work plan for Core Experiment on Media Locators 6411 MDS MPEG-21 REL/RDD Software Implementation Plan v.6 6412 MDS ISO/IEC 21000-6 COR/1 WD v.1 6413 MDS MPEG-21 DIA AMD/1 WD v.2 “Conversions and Permissions” 6414 MDS MPEG-21 DIA Software Implementation Plan v.7 6415 MDS ISO/IEC 21000-10 Study of CD “Digital Item Processing” 6416 MDS Study of Draft Comments on Digital Item Processing CD 6417 MDS MPEG-21 DIP Software Implementation Plan v.2 6418 MDS Work plan for Core Experiment on DIBOs for REL 6419 MDS ISO/IEC 21000-15 WD v.1 “Event Reporting” 6420 MDS Request for Subdivision to ISO/IEC 21000 for “Event Reporting” 6421 MDS Work plan for Core Experiment on Event Reporting 40 6422 Convener AHG on Core Experiments for MPEG-21 DID 2nd Edition 6423 Convener AHG on Core Experiments for MPEG-21 DIP 6424 Convener AHG on Core Experiments for MPEG-21 Event Reporting 6425 Liaison Information on MPEG-21 IPMP Call for Proposals 6426 Audio DoC on ISO/IEC 13818-7:2003/DCOR 1:2004, AAC 6427 Audio Text of ISO/IEC 13818-7:2003/COR 1:2004, AAC 6428 Audio Text of ISO/IEC 13818-7:2004, AAC Third Edition 6429 Audio DoC on ISO/IEC 14496-3:2001/DCOR 2 6430 Audio Text of ISO/IEC 14496-3:2001/COR 2, Misc. Corrections 6431 Audio DoC on ISO/IEC 14496-3:2001/AMD 1:2003/DCOR 1:2004 6432 Audio Text of ISO/IEC 14496-3:2001/AMD 1:2003/COR 1:2004, Bandwidth Extension 6433 Audio Study on ISO/IEC 14496-3:2001/FPDAM 3, MP3 on MP4 6434 Audio Request for Amendment: ISO/IEC 14496-3:2001/AMD 4, Audio Lossless Coding 6435 Audio WD3 of Audio Lossless Coding 6436 Audio Request for Amendment: ISO/IEC 14496-3:2001/AMD 5, Scalable Lossless Coding 6437 Audio WD2 of Scalable Lossless Coding 6438 Audio Request for Amendment: ISO/IEC 14496-3:2001/AMD 6, Lossless Coding of Oversampled Audio 6439 Audio ISO/IEC 14496-3:2001/PDAM Oversampled Audio 6440 Audio Request for Amendment: ISO/IEC 15938-4:2002/AMD 2, Highlevel Descriptors 6441 Audio WD1 of MPEG-7, High-level Descriptors 6442 Audio Request for New Work Item on MPEG-A 6443 Audio Text of MPEG-A Part 1, Music Player Application Format 6444 Audio Proposed High-Sampling Rate for MPEG-2 Layer III 6445 Audio Proposed Enhancements to MPEG-4 BSAC multi-channel 6446 Audio Work plan for Verification Test of MPEG-4 Parametric Audio Coding 6447 Audio Work plan for Audio Lossless Coding (ALS) 6448 Audio Work plan for Scalable Lossless Coding (SLS) 6449 Audio Study on Timestamps and Audio Codec Behavior 6450 Audio Work plan for Audio Contribution to MPEG-4 Conf. Bandwidth Extension 6451 Audio Status of MPEG-4 Audio Conformance 41 6, Lossless Coding of 6452 Audio Status of MPEG-7 Audio Contribution to XM and Conformance 6453 Audio Work plan for Audio Rhythmic Pattern CE 6454 Audio Work plan for Instrumentation and Weighted Scale Type CE 6455 Audio Call for Proposals on Spatial Audio Coding 6456 Audio Draft Evaluation Procedures for Spatial Audio Coding 6457 Audio Draft Call for Proposals for Symbolic Music Representation 6458 Convener AHG on Spatial Audio Coding 6459 Convener AHG on MPEG-4 Lossless Audio Coding 6460 Convener AHG on Symbolic Music Representation 6461 Integration DoC on ISO/IEC 13818-4:200X/PDAM2 Audio Conformance Ext. 6462 Integration Text of ISO/IEC 13818-4:200X/FPDAM2 Audio Conformance Ext. 6463 Integration DoC on ISO/IEC 14496-4:2003/FPDAM4 IPMP Conformance Ext. 6464 Integration Text of ISO/IEC 14496-4:2003/FDAM4 IPMP Conformance Ext. 6465 Integration DoC on ISO/IEC 14496-4:2003/FPDAM7 AFX Conformance Ext. 6466 Integration Text of ISO/IEC 14496-4:2003/FDAM7 AFX Conformance Ext. 6467 Integration Doc on ISO/IEC 14496-4:2003/PDAM8 HE-AAC, ABIFS & SA Conf. 6468 Integration Text of ISO/IEC 14496-4:2003/PDAM8 HE-AAC, ABIFS & SA Conf. 6469 Integration WD of ISO/IEC 14496-4:2003/AMD9 AVC PE Conformance 6470 Integration Text of ISO/IEC 21000-8 CD MPEG-21 Reference Software 6471 Integration Study of ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource Delivery 6472 Integration WD3.0 of ISO/IEC 21000-14 MPEG-21 Conformance 6473 Convener AHG on MPEG Reference Software 6474 Convener AHG Group on XML Structure Binarization and Streaming 6475 Convener AHG Group on Scene Representation 6476 Convener AHG on MPEG Multimedia Middleware 6477 Requirements Multimedia Applications Overview 6478 Convener 6479 Systems 6480 SNHC AHG on the Communicating MPEG to the business Community Request for subdivision 21000-16 of MPEG-21 Binary Format Request for subdivision 14496-21 of MPEG-4, MPEG-J extensions for rendering 42 43 Annex 5 Report of Requirements meeting Source: Rob Koenen, InterTrust Technologies NB: this report does not duplicate the resolutions, but rather complement them. This implies that not all output documents and not all Ad Hoc Groups are explicitly listed in the report below. Agenda 9:00-13:00 13:00-14:00 14:00-15:30 16:00-17:00 17:00-17:30 17:30-18:00 09:00-09:30 09:30-10:30 11:00-12:00 12:00-13:00 13:00-14:00 14:00-14:30 Monday opening plenary meeting Lunch (ends one hour after plenary ends) MPEG-21 Requirements Plenary; tasks for the week (we will not go over all contributions on detail) MPEG-21 Part 11 DTR 10549 Summary of Voting on ISO/IEC PDTR 21000-11 - SC 29 Secretariat MPEG-21 IPMP Requirements 10495 Discussion on MPEG-21 IPMP Requirements - Craig Schultz 10556 Comments on MPEG-21 IPMP Requirements – F. Chiariglione, et.al. 10615 Proposed requirement for MPEG-21 IPMP - Caporossi, et.al. 10625 Comments on Reqs for MPEG-21 IPMP and Reference Model - Xin Wang, et.al. 10489 AHG to complete requirements for MPEG-21 IPMP - Watt, Van den Heuvel, Schultz MPEG-21 Event Reporting – Joint with MDS 10618 Proposed MPEG-21 ER Data Structure as Digital Item - Youngjoo Song, et.al. 10619 Proposed Definition on Delivery Time,Recipient of MPEG-21 ER - Kyunghee Ji, et.al. 10635 Response to the CfP on ER ; Proposed E Language - Senator Jeong, et.al. 10675 Overview of responses to N6278: MPEG-21 Event Reporting Call for Proposals Rump 10494 AHG on MPEG-21 Event Reporting - FX Nuttall, Andrew Tokmakoff M3W – Joint with Systems 10530 MPEG Multimedia Middleware: Context and Objective (Update) - Jean Gelissen MPEG-21 IPMP Status update Plen N1070 MDS Z995 Sys N1070 Tuesday Intra-only coding in MPEG N0115 10488 AHG on Intra-only Coding in MPEG - Kohtaro Asai Broadcasting in MPEG-21 10629 Reqs for conversion descriptions in a live radio broadcasting environment - Grant 10563 MPEG-21 in Broadcasting Use-Case: Metadata Filtering (refinement 1) - Artur Lugmayr N0115 10564 MPEG-21 for exchange of personal profiles between embedded devicesLugmayr, Duan 10705 Usage Scenarios Analysis for MPEG-21 in Broadcasting - Abdellatif Benjelloun Touimi MPEG-21 Requirements – General MPEG-21 Profiles 10491 AHG on Profiles and Extensions for the MPEG-21 REL - Gandee, Chris Barlas N1070 General 10616 The Notion of Underlying Work within MPEG 21 - Gauvin, Dulong de Rosnay Issues referred to Requirements Group by MPEG-21 IPMP AHG MAF – joint with Systems, Audio and Video 10493 AHG on Multimedia Application Format (MAF) - Wo Chang, Olivier Avaro Sys 10536 Multimedia Application Format (MAF) Overview Document - Wo Chang Lunch M3W – Joint with Systems, ISG Sys 44 10530 14:30-15:30 15:30-16:30 17:00-17:30 17:30-18:00 09:00-11:00 11:30-12:30 12:30-13:00 13:00-14:00 14:00-14:30 14:30-15:00 15:00-16:00 16:00-16:30 16:30-17:00 17:00-18:00 MPEG Multimedia Middleware: Context and Objective (Update) - Jean Gelissen LASER – Joint with Systems 10686 Additional Requirements for LASER - Jean-Claude Dufourd, Olivier Avaro 10687 Statement of Support for LASER - Olivier Avaro, Jean-Claude Dufourd 10688 Proposed coordination between MPEG and W3C on LASER - Avaro, Dufourd 10689 Evaluation Software Requirements for LASER - Olivier Avaro, Jean-Claude Dufourd MPEG-4 Profiles – Joint with SNHC, Systems 10647 HI Corp., Waseda Univ. and Packet Video’s Response to CfP (N 6095) –Kaneko et.al. 10696 Proposal of new requirements for streaming geo-visual contents - Jérôme Royan, et.al. 10733 X3D Interactive profile, bitstream exchange update - Bourges-Sevenier, Walsh MPEG-21 PDTR 10548 Summary of Voting on ISO/IEC PDTR 21000-1 [2nd Edition] - SC 29 Secretariat (including JNB, USNB and UKNB comments) 10586 Austrian NB comments on PDTR 21000-1 2nd Edition - Timmerer, Hellwagner, for ANB 10699 FNB comments on Text of ISO/IEC 21000-1 2nd ed.– M. Dulong de Rosnay, on beh… MPEG-21 IPMP Requirements Document Status update Wednesday Plenary meeting MPEG-7 Profiling and MAF (Joint with MDS, Systems, Video, Audio) 10559 USNB Contribution: MPEG-7 profiles - A. G. Tescher for USNB 10492 AHG on MPEG-7 Interoperability and Profiling - Wo Chang, Masanori Sano 10648 Preliminary FCD on MPEG-7 Profile - Wo Chang 10502 Terms and Definitions for MPEG-7 Profiles – Bhavan Gandhi, e.al. Withdrawn Several – joint with MDS 10560 USNB Contribution: Demographic Information - A. G. Tescher for USNB 10561 USNB Contribution: MPEG-21 Media Locators - A. G. Tescher for USNB Lunch Joint with Audio Intra-only coding in MPEG 10488 AHG on Intra-only Coding in MPEG - Kohtaro Asai Joint with Systems on MPEG-4 IPMP 10653 Profiling Consideration for MPEG-4 IPMP - Mayumi Koike et.al. 10734 Profiling Consideration for MPEG-2/4 IPMP - Ji Ming Joint with SNHC 10704 Proposal for Compressed 3D Profile - Patrick Gioia MPEG-21 Persistent Association PDTR Approving the DTR MPEG-21 IPMP Status update Thursday MPEG-21 part 1 PDTR Joint with Systems on Laser Joint with JVT Lunch Joint with Video on 3DAV and SVC MPEG-21 and Broadcast Requirements Plenary MPEG-21 IPMP Requirements and 16:00-18:00 parts 1 PDTR Final Approval parts 11 PDTR Final Approval 11:00-12:00 12:00-12:30 12:30-13:00 13:00-14:00 14:00-15:00 15:00-15:30 Friday Concluding Several Audio Calls 08:30-08:45 Symbolic Music Representation Draft CfP and Requirements Spatial Audio Coding Concluding MPEG-4 08:45-09:00 MPEG-4 Profiles under Consideration document 45 Sys Sys N1070 N1070 Plen Plen Plen Aud N0115 N0115 N0115 N1070 N1070 N0115 N1090 3999 N1080 N0115 N1070 N1070 N1070 SNHC AMD with X3D Profile LASER Requirements/CfP Concluding MPEG-7 09:00-9:45 Profiles DoC Profiles FCD N1070 Concluding Explorations 9:45-10:00 M3W MAF Requirements 3DAV 10:00-12:00 12:30-14:00 14:00-22:10 N1070 Concluding MPEG-21 MPEG-21 IPMP Requirements document MPEG-21 part 1 v.2 PDTR DoC for 210001-1 PDTR MPEG-21 part 11 DoC MPEG-21 part 11 DTR Lunch Plenary meeting N1070 Plen Explorations, General Multimedia Application Formats 10493 AHG on Multimedia Application Format (MAF) - Wo Chang, Olivier Avaro 10536 Multimedia Application Format (MAF) Overview Document - Wo Chang The Overview of the Multimedia Application Formats was updated; it now contains a set of requirements for these Formats and no longer highly detailed technical descriptions. A request for a new Project was issued. MAF’s will form a new set of MPEG Standards. 3DAV Requirements met jointly with the Video Group to discuss 3DAV. The response to the Call for Comments resulted in two activities. On Multiview Coding, a Call for Evidence is being readied. It was issued in draft form at this meeting. On Omni-directional AV, a Draft Requirements Document was produced that summarizes the requirements for the work on a Multimedia Application Format for this application. Requirements for Audio still need to be added. M3W 10530 MPEG Multimedia Middleware: Context and Objective (Update) - Jean Gelissen. M3W was discussed in joint meetings with Systems. A new Context and Objectives Document was released, and a start of a Requirements Document for M3W was published as well. Intra-only in MPEG 10488 AHG on Intra-only Coding in MPEG - Kohtaro Asai The intra-only work, while progress is being made, has not yet been able to expand its support basis. In joint meeting with Video, it was agreed to continue the effort in the context of the video tool repository, which would start with collecting all intra coding tools from across the MPEG standards. The option of an intra-only Profile across all MPEG standards was discussed, and considered of interest. The continued need for getting more active participants in this activity was also noted. 46 Spatial Audio Coding A Call for Proposals for spatial audio coding was discussed in joint meetings with the Audio Group. The Requirements Group approved the requirements in the call and the call was subsequently published. Music Notation Also in a joint meeting with the Audio Group, the Draft Call for Proposals for Symbolic Music Notation was discussed and refined. The plan is to issue this call at the next meeting. MPEG-4 (and a bit of MPEG-2) Systems (Part 1) 10653 Profiling Consideration for MPEG-4 IPMP - Mayumi Koike et.al. 10734 Profiling Consideration for MPEG-2/4 IPMP - Ji Ming In a joint meeting with the Systems Group, the request to add Profiles to IPMP-X was discussed. The proposal is for both the MPEG-2 and MPEG-4 standards, and the Profile would be identical for both. A Simple (or “lightweight”) Profile would be useful for mobile devices and a Core Profile would be suited for Set Top Box-like devices. The proposals were added to the Profiles under Consideration Document, with the aim to expose them to other potentially interested parties and to allow these parties to express their interest at the next meeting. The meaning of ‘support’ was clarified in the opening sections of the Profiles under Consideration document. The meeting discussed how to move this forward rapidly. If enough support is expressed at the next meeting, the required Amendments could go straight to CD. It is now up to the proponents to gather such support. AVC (part 10) In a joint meeting with the Joint Video, Profiles for the AVC Fidelity Extensions were discussed. In the Study of the Amendment, the following profiles are mentioned: 4:2:2/8-bit 4:2:0/10-bit 4:2:2/10-bit 4:4:4/12-bit The Requirements Group expressed some concern that this may be a bit much for the extension, but agreed to adding this proposal to the Study at this point. The possibility of a 14 bit Profile is submitted to NB’s for their consideration. Systems- and SNHC-related Profiles (Notably part 11) 10696 Proposal of new requirements for streaming geo-visual contents - Jérôme Royan, et.al. In a joint meeting with SNHC and Systems, the requirements for MPEG standardization stemming from the streaming of geo-visual contents were discussed. It was concluded that MPEG is not the right place to standardize geo-spatial coordinate systems, but that application developers can combine existing standards for geo-spatial coordinate systems with MPEG tools. The standardization of a 3D representation suitable for representing buildings in this application can be considered in MPEG. SNHC will, for the moment, further discuss the issue. 47 10733 X3D Interactive profile, bitstream exchange update - Bourges-Sevenier, Walsh The Requirements Group was happy to learn that the bitstream requirements for this profile have been met, and recommended its adoption in AMD1 to part 16 of MPEG-4 (AFX Extensions), at the next meeting and depending on NB requests for doing so. Scene Representation API 10647 HI Corp., Waseda Univ. and Packet Video’s Response to CfP (N 6095) –Kaneko et.al. The response of the response to the Call for Proposals was discussed in a joint meeting with SNHC and Systems. The conclusion was that existing standards (JSR184), to a large extent, may pose a solution, and that MPEG work should build on them. The SNHC group further discussed the matter. 10225 AHG on MPEG-4 Scene Representation - Jean-Claude Dufourd, Yuval Fisher, Juergen Schmidt 10686 Additional Requirements for LASER - Jean-Claude Dufourd, Olivier Avaro 10687 Statement of Support for LASER - Olivier Avaro, Jean-Claude Dufourd 10688 Proposed coordination between MPEG and W3C on LASER - Avaro, Dufourd 10689 Evaluation Software Requirements for LASER - Olivier Avaro, Jean-Claude Dufourd In a joint meeting with the Systems Group, the LASeR Requirements and CfP were edited and approved. Please see the Systems report for further details. Scene Description (part 11) 10704 Proposal for Compressed 3D Profile - Patrick Gioia Small updates to the Compressed 3D Profile were proposed and accepted into the Profiles under Consideration Document. MPEG-7 Profiles and Levels (part 9) 10559 USNB Contribution: MPEG-7 profiles - A. G. Tescher for USNB 10492 AHG on MPEG-7 Interoperability and Profiling - Wo Chang, Masanori Sano 10648 Preliminary FCD on MPEG-7 Profile - Wo Chang All of the suggestions on MPEG-7 Profiles by National Bodies were reviewed and accepted. Due to partial availability of the editor during the meeting, editing could not be finalized and a one-month editing period was agreed. In the discussion, the following conclusions were reached: The USNB suggested that use of BiM and size of access units would be Level issues, but the meeting concluded that they might well be better placed in a Systems Profile dimension. This dimension would be orthogonal to the Description Profiles dimension. WG11 should keep the notion of Description Profile because it is likely there will also be (a) Systems Profile(s) MPEG will adopt, as a guiding principle, that a Profile should use the same Schema for all its Levels. It is not completely ruled out that there may be exceptions, but they will be discussed on an individual basis and only made in exceptional circumstances 48 resulting in minor changes to the schema. This means that in principle, all the Levels shall conform to the Profile Schema. Every Profile has its own Level definitions. Nothing in the Levels of one Profile will necessarily mean something for another Profile (although they may be harmonized) On the definition of Levels, the following was noted: o Cardinality, which seems a Level issue but could change the Schema, doesn’t really provide control over the size of the description. “Size of Description” could be a valid Level variable, however. o Related to the previous point, some Level variables may not be able to be validated using the Schema itself, such as the size or the depth of the description. Still, these could be relevant Level variables, and they can be easily checked for conformance. o It should be possible to change the range of attributes in a Level definition. MPEG-21 General Profiles 10491 AHG on Profiles and Extensions for the MPEG-21 REL - Gandee, Chris Barlas The assumption in the profiling work was the timely availability of relevant OMA specs. As these weren’t available, no simple Profile could be defined based on them. It was decided that there be no continuation of this AHG for now, until more information is available or other contributions on required profiles are brought to MPEG. MPEG-21 in Broadcasting 10629 Requirements for conversion descriptions in a live radio broadcasting environment Grant 10563 MPEG-21 in Broadcasting Use-Case: Metadata Filtering (refinement 1) - Artur Lugmayr 10564 MPEG-21 for exchange of personal profiles between embedded devices- Lugmayr, Duan 10705 Usage Scenarios Analysis for MPEG-21 in Broadcasting - Abdellatif Benjelloun Touimi The Requirements group hosted two sessions on the role of MPEG-21 in Broadcasting. It was concluded that the current activity lacked a clear problem definition and a coherent view on the role that MPEG-21 could play in broadcasting, possibly because the participation of direct stakeholders appeared minimal. The Requirements Group appreciated the efforts of the people that participated in the activity, but decided that the activity be closed for the time being, but the Group is open to new contributions. Any new or continued activity in the realm of MPEG21 in broadcasting will be reviewed in the light of submissions received at the next meeting. There must be a clear vision for a role of MPEG-21 in broadcast applications, a coherent view of the contribution of MPEG, and a well-defined statement of what MPEG needs to standardize. In addition, there must be people with knowledge of and interest in the broadcast world to carry out the work. 49 Vision, Strategy and Technologies Technical Report (Part 1) and related 10616 The Notion of Underlying Work within MPEG 21 - Gauvin, Dulong de Rosnay 10548 Summary of Voting on ISO/IEC PDTR 21000-1 [2nd Edition] - SC 29 Secretariat (including JNB, USNB and UKNB comments) 10586 Austrian NB comments on PDTR 21000-1 2nd Edition - Timmerer, Hellwagner, for ANB 10699 FNB comments on Text of ISO/IEC 21000-1 2nd ed.– M. Dulong de Rosnay, on beh… N1070 The comments to the PDTR were taken into account in producing the DTR. While not all comments could be implemented as suggested, all National Bodies were happy with the result and those that had voted ‘No’ changed their votes ‘Yes’. Digital Item Declaration (Part 2) 10561 USNB Contribution: MPEG-21 Media Locators - A. G. Tescher for USNB The conclusion of a joint meeting with MDS on this issue was that a Core Experiment would need to be drafted to come to a decision in this matter. The Core Experiment was further defined in the MDS Group. IPMP (part 4) 10495 Discussion on MPEG-21 IPMP Requirements - Craig Schultz 10556 Comments on MPEG-21 IPMP Requirements – F. Chiariglione, et.al. 10615 Proposed requirement for MPEG-21 IPMP - Caporossi, et.al. 10625 Comments on Reqs for MPEG-21 IPMP and Reference Model - Xin Wang, et.al. 10489 AHG to complete requirements for MPEG-21 IPMP - Watt, Van den Heuvel, Schultz Extensive editing resulted in a much-improved specification of the requirements for IPMP. To reduce travel for delegates, it was decided to not have a separate evaluation meeting in June, but rather do a 3-day pre-meeting before the 69th meeting. This also led to extending the deadline of submission to 25 June. The Requirements Group regrets losing Bas van den Heuvel as a very active participant and co-chair of Ad-Hoc Groups and Break-out Groups. DIA (part 7) 10560 USNB Contribution: Demographic Information - A. G. Tescher for USNB The Requirements Group notes that the request is in line with similar requests from other NB’s at previous meetings, and that earlier concerns seem to have given way to recognizing the use of supporting this information. WG11 will allow such attributes to be adopted in the MPEG-21 DIA Standard. Persistent Association (part 11) 10549 Summary of Voting on ISO/IEC PDTR 21000-11 - SC 29 Secretariat The comments to the PDTR were taken into account in producing the DTR. While the Requirements Group would be happy to address Video in the DTR, there have simply not been enough contributions to implement the suggestion. WG11 is ready to create a second version of the PDTR, if enough video experts commit to seeing it through. All National Bodies were happy with the result and those that had voted ‘No’ changed their votes ‘Yes’. Event Reporting 10618 Proposed MPEG-21 ER Data Structure as Digital Item - Youngjoo Song, et.al. 50 10619 10635 10675 Rump 10494 Proposed Definition on Delivery Time,Recipient of MPEG-21 ER - Kyunghee Ji, et.al. Response to the CfP on ER ; Proposed E Language - Senator Jeong, et.al. Overview of responses to N6278: MPEG-21 Event Reporting Call for Proposals AHG on MPEG-21 Event Reporting - FX Nuttall, Andrew Tokmakoff The event reporting work was handed off to the MDS Group. It looks like proposals have been received to fulfill the majority of the required functionality. 51 Annex 6 Report of Systems meeting Source: Title: Status: Editor: Systems Chair and Break-out group Chairs Systems Meeting Report Draft Olivier Avaro (France Telecom R&D) Contributors: Olivier Avaro (France Telecom R&D), Claude Seyrat (Expway), Oliver Baum (Fraunhofer IIS), David Singer (Apple) Overview The main outputs of the meeting from the Systems Sub-group perspective are: No. N6314 N6315 N6316 N6317 N6318 N6319 N6320 N6321 N6322 N6323 N6324 N6325 N6326 N6327 N6328 N6329 N6330 Nxxxx N6331 N6332 Title 13818-1:2000/Amd.4 Metadata Application Format CP DoC on ISO/IEC 13818-1:2000/PDAM4 Text of ISO/IEC 13818-1:2000/FPDAM4 13818-1:2000/Amd.5 New Audio P&L Signaling DoC on ISO/IEC 13818-1:2000/PDAM5 Text of ISO/IEC 13818-1:2000/FPDAM5 14496-1 :2003/Cor Items for Corrections Text of ISO/IEC 14496-1/DCOR3 14496-11 :2003/Amd.3 Audio BIFS Extensions DoC on ISO/IEC 14496-11/PDAM3 Text of ISO/IEC 14496-11/FPDAM3 14496-11:2003/Amd.4 XMT and MPEG-J Extensions Text of ISO/IEC 14496-11/COR2 14496-12:2003/Amd.1 ISO File Format Extensions DoC on ISO/IEC 14496-12/PDAM1 Text of ISO/IEC 14496-12/FPDAM1 14496-17 Streaming Text Format Study Text of ISO/IEC 14496-17/FCD 15938-1 Systems DoC on ISO/IEC 15938-1/FPDAM1 Text of ISO/IEC 15938-1/FDAM1 DoC on ISO/IEC 15938-1/DCOR1 Text of ISO/IEC 15938-1/COR1 Core Experiments for Systems Extensions MPEG-7 Systems reference software workplan 21000-9 MPEG-21 File Format Request of ISO/IEC 21000-9 Text of ISO/IEC 21000-9/CD Technology under consideration for 21000-9 21000-16 MPEG-21 Binary Format 52 TBP Available No No 04/03/19 04/03/19 No No 04/03/19 04/03/19 No 04/03/19 No No 04/03/19 04/03/19 No 04/03/19 No Yes 04/03/26 04/03/19 Yes 04/03/26 No No No No No No 04/03/19 04/04/19 04/03/19 04/03/19 04/03/19 04/03/19 No No No 04/04/03 04/04/03 04/03/19 N6333 WD1.0 of Text of ISO/IEC 21000-16 N6334 Core Experiment on MPEG-21 Binarization Explorations and Support N6335 MPEG Multimedia Middleware Context and Objectives N6336 Requirements on the MPEG Multimedia Middleware N6337 CfP on Lightweight Application Scene Representation N6338 MPEG IPMP Extensions Overview N6339 Call for Registration Authority for IPMP_Tool_Id No No 04/03/19 04/03/19 No No No Yes No 04/03/19 04/03/19 04/03/19 04/03/19 04/03/19 General issues General The meeting report from Waikaloa has been approved. M10576: MPEG IPMP Introduction from Panasonic. Slides presenting the MPEG-4 and MPEG-2 IPMP (background, technology, …). For information. M10588: Cancelled. M10557: The Systems subgroup thanks the USNB for pointing the mistake made on the edition of Text of ISO/IEC 14496-11/COR1. An updated version of this document has been sent to the secretariat implementing the decisions made by the Systems subgroup. M10590: Proposed modifications for implementation of MPEG-4 font compression and streaming. Request for new handler for font compression and streaming. This will be handled by the RA for 4CC and OTI. List of standards under development Pr 2 Pt 1 2 1 4 4 1 11 4 4 11 11 4 12 4 4 17 20 Edit. Project Description CfP 2000 Amd.4 Metadata Application Format CP 2000 Amd.5 New Audio Profile and Level Sig. 2003 Cor.3 AFX Code table correction 2003 Cor.2 Valuator/AFX related correction 2003 Amd.3 Audio BIFS Extensions 2003 Amd.4 XMT and MPEG-J Extensions 2003 Amd.1 ISO File Format Extensions 2003 1st Ed. Streaming Text Format 2004 1st Ed. Lightweight Application 04/03 Scene 53 WD CD FCD FDIS 03/10 04/03 04/07 03/10 03/12 04/03 04/07 04/03 04/03 04/07 04/07 03/10 03/12 04/03 04/07 03/10 03/12 04/07 05/01 03/10 03/12 04/03 04/07 03/03 03/07 03/12 04/07 04/07 04/10 05/03 21 21 9 16 200x 1st Ed. 200x 1st Ed. File Format Binary Format 03/12 04/03 04/07 05/01 04/03 04/07 04/10 05/03 Demonstrations None. FAQ The FAQ were updated as needed. AOB None. MPEG-2 Systems (13818-1) 13818-1:2000 Amd.4 Topics 1. ISAN and VISAN Signaling. Contributions M10633: See liaison. M10738: See liaison. M10504: See DoC and Amd. Text. 13818-1:2000 Amd.5 Topics 1. 2. New Audio Profile and Level Indication; Audio_Type Table split for ISO reserved and User Private Contributions M10558: See DoC and audio report. M10544: See DoC and Amd. Text. MPEG-4 Systems (14496-1) 14496-1:2003 Cor. 3 M10391: (From Hawaii). Proposed addition to BBA stream in the AFX code table. The table will be shifted to the AFX specification (by corrigendum of ISO/IEC 14496-1 and amendment of ISO/IEC 14496-16). MPEG-4 Scene Description (14496-11) 54 14496-11:2003 Cor. 2 Topics 1. Miscellaneous Corrigenda Item. Contributions Items added to the current corrigendum : remove unimplemented technology from SNHC from the Node Coding table. M10570: Improvment of point texture compression. Requires extensions of the bitwrapper node. Expose lack of extensibility for the bitwrapper node. Decision to develop a more general and future proof solutions for technology that will use the bitwrapper functionnality. 14496-11:2003 Amd.3 Topics 1. 2. 3. 4. Advanced Audio Buffer Node; AudioChannelConfig; Pre-defined effects using ExterProto; Support for Ambisonic. Contributions Scene Description M10627: See Audio report. M10546: See DoC et Amd. text. 14496-11:2003 Amd.4 Topics 1. 2. XMT Extensions; MPEG-J Extensions. Contributions Scene Description None. ISO File Format (14496-12) 14496-12:2003 Amd.1 Topics 1. 2. Support for Static Metadata; Support for IPMP at the File Format Level. 55 Contributions Extensions of the ISO File Format M10554, M10692: Handling Audio Pre-roll in MPEG-4. Information on HE-AAC decoder delay and timestamps. Continue documentation of the understanding of these complex issues. No action requested by Systems prior Audio has addressed the issue at the codec level. M10547, M10555, M10612: All comments were addressed. See DoC and specification. Detailed discussions are documented below. On the technology under consideration, we agree to simplify it to a flat structure, no mention of coding systems (e.g. SMIL etc.) and then consider the residual as to whether it should be included; no conclusion was reached on this question. The residual technology is: a) b) c) d) the progressive download information chunking (extents) of resources start-location OR the in-line meta-data ability to attach name, type, encoding, and protection info to resources. The editors are instructed to insert an annex into the amendment documenting the RA, if approval of the RA is achieved in a suitable time-frame. In systems plenary we learned that the secretariat can insert the contact information into the annex once the RA is approved (even after document approval). On the technology under consideration, the plenary instructed the editors to integrate the technologies directly relevant to the immediate use cases: MPEG-7 and MPEG-21, and make no mention of SMIL. Those technologies are the initial resource location, progressive download information, chunking (dividing into extents) of resources, and providing a name, type, encoding, and protection information for resources. On the 3GPP2 RA question, the RA is directed to note on the RA/sample-entry table that the appropriate specs must be consulted for when each may be used for any given codec. The RA is also instructed to go back and allocate OTI for all codecs used in the family that have a sample-entry code. On the constraint_flag, more detail was received into the plenary from the absent author, and it will be retained with more explanation into the next text. The editors are instructed to produce sufficient text for the JPEG meeting in Madrid, to enable balloting immediately after. Balloting will close after Seattle, however, NB comment is earnestly desired before the meeting. Streaming Text (14496-17) Topics 1. Coded Representation of Text Stream. 56 Contributions None: Specification has been reviewed and a study was produced. Discussion : Text positionning wrt Video. Support on character sets. Use of text profiles in text streams. To be further studied in the Scene AHG. LASeR (14496-20) Topics 1. Lightweight Application Scene Representation Contributions M10685: Test Data set Description for LASER Evaluation. Discussed. Taken as a basis to finalize the CfP on Laser. M10686: Additional Requirements for LASER. Proposition discussed and CfP has been updated accordingly. M10687: Statement of Support for LASER. Additionnal companies supporting the development of LASER. For information. M10688: Proposed coordination between MPEG and W3C on LASER. Agreement on the proposed process within the Systems group. Further discussed within Liaison. Cf. Liaison statement to W3C. M10684: Support of SVG1.2 in LASER. Integrated in the CfP to indicate the minimal set of functionality required based on the SVG1.2 specification. M10689: Evaluation Software Requirements for LASER. Shall have an implementation and be implementable on some plate-forme. Joint meeting with ISG. Results implemented in CfP. MPEG-7 Systems (15938-1) General M10492, M10559, M10648, M10502 : MPEG-7 Profiles Definition. Cf. Req. Report. M10717 - Report on CE (Indexing) The contribution presents results of the indexing CE. A first attempt to compare them to the TV-Anytime has been done, however evaluation criterion are not clear enough. The core experiment related to indexing mechanism will be continued and evaluation criteria have been clarified. Other items No contributions have been made about the copy command CE since several meetings. The Core Experiment will not continue. 57 15938-1/Cor1 Topics 1. Miscellaneous corrections to MPEG-7 Systems. Contributions M10728 - Editors study of the ISO/IEC 15938-1/FPDAM & COR The contribution presents a new study of FPDAM & DCOR. This document will be used as the basis of the Amd and the cor. 15938-1/Amd 1 Topics 1. 2. 3. Schema Transmission; Optimised codecs; Insertion of elements. Contributions M10587 - MPEG-7 BiM Reference Software Status The contribution presents the status of the BiM reference software which nows integrates every tool defined in the amendment. M10695 – Report on CE on MPEG-7 Systems Extensions: Extended Type Codes The contribution presents a comparison between different type code allocation strategy. It demonstrates compression improvement compared to AdvancedTypeCode (global code) strategy. However the complexity of the method raised complexity concerns. The proposal is not accepted. M10729 - MPEG-7 Systems extensions: Results of Mini-Experiment #2 The contribution presents a general review of the schema transmission issues and proposes several solutions and improvements to the FPDAM. This contribution has been used to solve the issues raised at the 67th meeting by NBs. MPEG-21 File Format (21000-9) 21000-9 Topics 1. MPEG-21 File Format Contributions The following points were discussed and approved : Make the moov atom optional, i.e. derive the M21 file format from techs in the ISO base, but not require all that it requires. 58 Have both binary and textual handler types: m21b, m21t. The chunking/interleave may be appropriate for binarized/interleaved digital items. The CD text should have some worked examples, with diagrams etc. Simple case, more complex cases and so on, including URL forms. We need comment on whether the protection structures proposed for the amendment are needed or appropriate in the MPEG-21 use case. M10645: We agree that it is necessary that we get the right indirections in place to enable the right flexibility. But the proposal as presented suggests re-writing the DID as it is packaged, and we desire that we do not have to do that in the general case, so that for example signing etc. remain valid. It seems that the file-entry structures serve a similar function, but allow the DID to be packaged without re-writing. There may be value in having fragment identifiers outside the DID etc. but it’s not entirely clear whether the fragment identifier should or should not remain within the XML; we really need to see why it is an advantage to move the fragment identifier out of the XML into the resource directory. It may allow some editing of the external resource (editing that required the fragment identifier to change) without changing the DID (e.g. when a scene of a movie was referred to, and the resource re-packaged so that the scene is substituted for the entire movie, obviating the need for a fragment, but there was no consensus that this was even desirable). This contribution will be documented as a technology under consideration in the next document, requesting comment, MPEG-21 Binary Format (21000-16) 21000-16 Topics 1. Binarization of MPEG-21 Data Contributions M10718 - BinaryXML - A Comparison of Existing XML Compression Techniques The contribution shows figure on DIA compression and compared several compression techniques on qualitative and quantitative measures. It appears that BiM has unique features (progressive transmission & direct data access). The contribution recommends to adapt BiM in order to improve compression of large, highly repetitive documents. Proposal of backward compatible extensions of BiM with specific codecs. M10644 - Binarisation of MPEG-21 DIDs The contribution shows figure on DID compression and compared several compression techniques. BiM is leading followed by XMill. Proposal to improve efficiency for MPEG-21 specifics. Progressive transmission is required for large DID. However several items should be addressed by BiM to fully satisfy DID compression requirements. The encoding of any wildcard (with no schema & according to external attributes “mimeType”) should be improved and the issue of properly dividing DID should be addressed (is signalling of DID validity required?). 59 M10646 - MMG-Waseda proposal on Issues in binary coding(binarization) of MPEG-21 DID The contribution presents MPEG-21 use cases in highly constrained environment (targeting mobile environment). The contribution presents the notion of domain dependent coding which could have the following positive impact on DID decoding: Easy mapping of DID to relational database, More compressed DID & Small footprint decoder. While the benefits are clear, technical more work has to be done. Proposed to perform Core Experiment on MPEG21 binarization. Decision: There is now a critical mass of people interested in MPEG-21 binarization enabling MPEG to start a work item on the topic. This will lead to the production of: A new part of MPEG-21 describing how BiM is used in the MPEG-21 specific context. This will be part 16 of MPEG-21; Possible amendments of MPEG-7 Systems to accommodate MPEG-21 specifics. BiM will be used as a starting point. Next Steps: Issue Working Draft 1.0 of ISO/IEC 21000-16. Define and execute core experiment to further evaluate the need of BiM extensions to cover MPEG-21 requirements. Exploratory Activities MPEG-2 Exploratory Activities Topics 1. Scalability at the Systems Level. Contributions M10592, M10591 : Rational and Proposal for MPEG-2 System amendment to support heterogeneous layered video. Similar features are under consideration by the Video subgroup but the timeline is less aggressive than the proposed amedment of the MPEG-2 Systems specification. Liaison to possible clients of this technology (DVB) to get their feed-back on the appropriate time-to-market for such technology. See liaison to DVB. MPEG-4 Exploratory activity Topics 1. 2. MPEG-J Extensions Others Contributions Others M10696: Proposal of new requirements for streaming geo-visual contents. See Req. report. 60 MPEG-21 Exploratory Activities Topics 1. Architecture Contributions None. Multimedia Application Formats Topics 1. 2. 3. Application specific format framework; Usage of MP3 in MP4 with metadata; Usage of JPEG in MP4 with metadata. Contributions M10536: Multimedia Application Format (MAF) Overview Document. Review of the document. Review list of open issues Relation with MPEG-21: MPEG-21 is structure (not metadata). MPEG-21 File Format will build on top of the ISO Base File Format. What is done in MAF can then be re-used within the context of the MPEG-21 File Format. Issue on file format overhead: Overhead of the file format could be an issue for small sized media + metadata (ex:images thumbnail). Image does not need a movie atom which represents a large part of the overhead. So this should not be an issue. Multimedia Middleware Topics 1. 2. 3. Use cases; Middleware Architecture; Multimedia APIs. Contributions M10530: MPEG Multimedia Middleware: Context and Objective (Update). Document updated and reviewed. 61 Latest References and Publication Status Pr 2 2 2 2 2 2 2 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 4 Pt 1 1 1 1 1 1 11 1 1 1 1 1 1 1 1 1 1 1 1 1 6 8 11 11 11 Standard ISO/IEC 13818-1/Amd.7 ISO/IEC 13818-1:2000 (MPEG-2 Systems 2nd Edition) ISO/IEC 13818-1:2000/COR1 (FlexMux Descr.) ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) + COR2 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2) ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-2) ISO/IEC 13818-1:2003 (IPMP on 2) ISO/IEC 14496-1 (MPEG-4 Systems 1st Ed.) ISO/IEC 14496-1/Amd.1 (MP4, MPEG-J) ISO/IEC 14496-1/Cor.1 ISO/IEC 14496-1:2001 (MPEG-4 Systems 2nd Ed.) ISO/IEC 14496-1:2001/Amd.1 (Flextime) ISO/IEC 14496-1:2001/Cor.1 ISO/IEC 14496-1:2001/Cor.2 ISO/IEC 14496-1:2001/Amd.2 (Textual Format) ISO/IEC 14496-1:2001/Amd.3 (IPMP Extensions) ISO/IEC 14496-1:2001/Amd.4 (SL Extension) ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) ISO/IEC 14496-1:2001/Amd.7 (AVC on 4) ISO/IEC 14496-1:2001/Amd.8 (ObjectType Code Points) ISO/IEC 14496-6:2000 ISO/IEC 14496-8 (MPEG-4 on IP Framework) ISO/IEC 14496-11 (MPEG-4 Scene Description) ISO/IEC 14496-11/Amd.1 (AFX) ISO/IEC 14496-11/Cor.1 No. Issue 00/12 01/01 Pisa 03/07 Trondheim 03/03 Pattaya 03/07 Trondheim 03/03 Pattaya N3844 N5867 N5604 N5771 N5607 01/07/20 02/10/26 02/03 N5277 N5976 N6202 02/10 Shanghai 03/10 Brisbanne 03/12 Hawaii N4712 N5279 N5480 N6203 02/03 Jeju 02/10 Shanghai 02/10 Awaji 03/12 Hawaii 62 Status Published Published Published Published Published FDAM Published Published Published Published Published Published FDAM FDAM FDAM FDAM Published FDIS FDAM FDAM Published FDIS FDIS AMD COR Doc. with 2000/12 2000/12 2002/03 2003/12 2004/03 ITTF 2003/12 1999/12 2001/11 2001/11 2001/11 2002/10 SC29 SC29 SC29 ITTF 2003/12 SC29 SC29 SC29 2000/12 SC29 SC29 SC29 SC29 Purpose FDAM 04/04/26 FDAM 04/03/22 Final Text Editing FDAM to be issued FDAM to be issued FDIS 04/04/12 Final Text Editing By 05/01/05 By 05/01/05 4 4 11 12 ISO/IEC 14496-11/Amd.2 (Advanced Text and Graphics) ISO/IEC 14496-12 (ISO Base Media File Format) N6205 N5295 03/12 Hawaii 02/10 Shanghai 4 4 4 4 4 7 7 7 7 13 14 15 18 19 1 1 1 2 ISO/IEC 14496-13 (IPMP-X) ISO/IEC 14496-14 (MP4 File Format) ISO/IEC 14496-15 (AVC File Format) ISO/IEC 14496-18 (Font Compression and Streaming) ISO/IEC 14496-19 (Synthesized Texture Stream) ISO/IEC 15938-1 (MPEG-7 Systems) ISO/IEC 15938-1/Amd.1 (MPEG-7 Systems Extensions) ISO/IEC 15938-1/Cor.1 (MPEG-7 Systems Corrigedum) ISO/IEC 15938-2 (MPEG-7 DDL) N5284 N5298 N5780 N6215 N6217 N4285 N6326 N6328 N4288 02/10 Shanghai 02/10 Shanghai 03/07 Trondheim 03/12 Hawaii 03/12 Hawaii 01/07 Sydney 04/03 Munich 04/03 Munich 01/07 Sydney 63 FDAM IS SC29 ITTF FDIS 2004/01 FDIS FDIS FDIS Published FDAM COR Published ITTF Published ITTF ITTF ITTF 2002/07 Editor SC29 2002/02 By 05/01/05 To be published 03/12 Ballot to be issued FDIS by 04/05/11 FDIS to be issued Resolutions of Systems Cf. WG11 resolution. 64 List of reviewed contribution N° 1049 2 1050 2 1050 4 Title Authors AHG on MPEG-7 Interoperability and Profiling Wo Chang et al. Terms and Definitions for MPEG-7 Profiles Bhavan Gandhi et al. Summary of Voting on ISO/IEC 13818-1:2000/PDAM 4 [SC 29 N SC 29 Secretariat 5808] 1053 MPEG Multimedia Middleware: Context and Objective (Update) Jean Gelissen 0 1053 0 1053 6 1053 9 1054 4 1054 6 1054 7 MPEG Multimedia Middleware: Context and Objective (Update) Jean Gelissen Multimedia Application Format (MAF) Overview Document Wo Chang Liaison Statement from 3GPP [SC 29 N 5842] 3GPP Summary of Voting on ISO/IEC 13818-1:2000/PDAM 5 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/PDAM 3 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-12/PDAM 1 & ISO/IEC SC 29 Secretariat 15444-12/PDAM 1 1055 Handling Audio Pre-roll in MPEG-4 David Singer 4 1055 USNB Contribution: ISO/IEC 14496-12 modifications 5 1055 USNB Contribution: ISO/IEC 14496-11 issues 7 1055 USNB Contribution: “Audio Type” Issues 8 1055 USNB Contribution: MPEG-7 profiles 9 1057 MPEG IPMP Introduction 6 1058 MPEG-7 BiM Reference Software Status 7 1058 Comments on MPEG-2/4 IPMP Extensions 8 1059 Proposed modifications for implementation of MPEG-4 font 0 compression and streaming 1059 Rational for heterogeneous layered video support in MPEG-2 1 Systems (as in M10359) 1059 Rational for heterogeneous layered video support in MPEG-2 1 Systems (as in M10359) 1059 Proposal for MPEG-2 System amendment to support heterogeneous 2 layered video 1059 Proposal for MPEG-2 System amendment to support heterogeneous 2 layered video 1061 URL Forms for Container Files 2 65 A. G. Tescher USNB A. G. Tescher USNB A. G. Tescher USNB A. G. Tescher USNB Systems Group for for for for Gregoire Pau et al. Filippo Chiariglione et al. Vladimir Levantovsky Bruls & Jan van der Meer Bruls & Jan van der Meer Van der Meer Fons Bruls Van der Meer Fons Bruls David Singer N° 1062 7 1063 3 1064 4 1064 5 1064 6 Title CE Report on AdvancedAcousticScene node for MPEG-4 Audio BIFS version 3 Jeongil Seo et. Authors SMPTE Liaison to MPEG on V/ISAN and ISO 13818-1 DAM4 Merrill Weiss et al. Binarisation of MPEG-21 DIDs Stephen Davis et al. Proposed Resource Reference Box for media resource referencing Yongju Cho et al. MMG-Waseda proposal onIssues in binary coding(binaization) of Itaru Kaneko et al. MPEG-21 DID 1064 Preliminary FCD on MPEG-7 Profile Wo Chang 8 1065 3 1066 5 1068 4 1068 4 1068 4 1068 5 1068 5 1068 5 1068 6 1068 7 1068 8 1068 9 1068 9 1069 2 1069 5 1069 6 1071 7 Profiling Consideration for MPEG-4 IPMP Mayumi Koike et al. UKNB comment on Graphics API Steliaros K Grant Support of SVG1.2 in LASER JC Dufourd et al. Support of SVG1.2 in LASER JC Dufourd et al. Support of SVG1.2 in LASER JC Dufourd et al. Test Data set Description for LASER Evaluation JC Dufourd et al. Test Data set Description for LASER Evaluation JC Dufourd et al. Test Data set Description for LASER Evaluation JC Dufourd et al. Additional Requirements for LASER JC Dufourd Statement of Support for LASER Olivier Avaro et al. Proposed coordination between MPEG and W3C on LASER Olivier Avaro et al. Evaluation Software Requirements for LASER JC Dufourd et al. Evaluation Software Requirements for LASER JC Dufourd et al. Information on HE-AAC decoder delay and timestamps Heiko Purnhagen Algorithms in BiM Version 2 Reference Software Andreas Hutter et al. Proposal of new requirements for streaming geo-visual contents Jérôme Royan et al. Report on CE (Indexing) Editors study of the ISO/IEC 15938-1/FPDAM Andrea Kofler-Vogt et al. Christian Timmerer et al. Claude Seyrat MPEG-7 Systems extensions: Results of Mini-Experiment #2 Claude Seyrat et al. Profiling Consideration for MPEG-2/4 IPMP Ji-Ming et al. 1071 BinaryXML – A Comparison of Existing XML Compression Techniques 8 1072 8 1072 9 1073 4 1073 8 Liaison from TC46/SC9 66 Annex 7 Report of MDS meeting Contact (MPEG Multimedia Description Schemes Sub-group Chair): John R. Smith IBM T. J. Watson Research Center 19 Skyline Drive Hawthorne, NY 10532 USA jrsmith@watson.ibm.com The MPEG Multimedia Description Schemes (MDS) sub-group’s activities included work items for MPEG-7 and MPEG-21 standards as shown in Figure 1. The primary work items for the week included the following: MPEG-7: o MPEG-7 Extensions (Part 5): Review NB comments on MDS AMD/2 Review proposals on MDS AMD/2 MPEG-7 MDS AMD/2 FPDAM MPEG-7 MDS COR/1 DCOR o MPEG-7 Conformance (Part 7): AMD/1 (Version 2 bitstreams) Study of FPDAM o MPEG-7 Schema Definition (Part 10): Review NB Comments on Schema Definition CD MPEG-7 Schema Definition FCD MPEG-21: o MPEG-21 Digital Item Declaration (Part 2): Review proposals on location schemes, binarization, comments MPEG-21 DID 2nd Ed CD o MPEG-21 Rights Data Dictionary Review responses from RA information request MPEG-21 RDD COR/1 WD o MPEG-21 Digital Item Adaptation (Part 7): MPEG-21 DIA AMD/1 WD v.2 o MPEG-21 Reference SW (Part 8): Review AHG report, SW contributions MPEG-21 Ref. SW CD 67 o MPEG-21 Digital Item Processing (Part 10): Review preliminary comments, AHG report, CE results MPEG-21 DIP Study of CD o MPEG-21 Conformance (Part 14): Review AHG report and proposals MPEG-21 Conformance CD o MPEG-21 Event Reporting (Part 15): Review results from CfP MPEG-21 Event Reporting WD MPEG-7 v.1: • MDS (FDIS) • Profiles • Schema Def. (FCD) MPEG-7 v.2: • MDS AMD/2 (FPDAM) • MDS Cor/1 (DCOR) • Conf. Ext. (Study of FPDAM) MPEG-21: • DID 2nd Ed (CD) • REL (“Profiles”) • RDD (“RA”, COR/1) • DIA AMD/1 (WD v2) • DIP (Study of CD) • Ref SW (CD) • Conformance (CD) • Event Reporting (WD) Figure 1. Overview of MPEG Multimedia Description Schemes Sub-Group work items for 68th Munich meeting. MPEG Multimedia Description Schemes (MDS) Group activities Num . Contributions Agenda, Goals and Issues for the Week for Multimedia Description Schemes (MDS) Sub-Group Agenda, Goals and Issues for the Week for Multimedia Description Schemes (MDS) Group John R. Smith 68 During the kick-off session, the workplan for the week for MPEG-7 and MPEG-21 development was discussed and approved. Furthermore, the following points were discussed: Organization of work into main MDS track with BoGs (REL/RDD/DIA/DIP) o All work held in main MDS track except where indicated for specific Break-out Groups (BoG) Scheduling of MDS sub-group plenary meetings for Wednesday and Thursday Plan for MPEG-7 Multimedia Description Schemes AMD/2 and COR/1 Plan for MPEG-21 Digital Item Declaration Plan for MPEG-21 Rights Expression Language Plan for MPEG-21 Rights Data Dictionary Plan for MPEG-21 Digital Item Adaptation Plan for software development for MPEG-21 REL, RDD, DIA Schedule of joint meetings Joint Meetings (as of Monday): MPEG-7: o Wed (11h30 - 12h00): MDS Requirements (with Requirements) o Wed (12h00 - 13h00): MPEG-7 Profiles (with Requirements, Systems, Audio, Video) MPEG-21: o Mon (16h00 - 17h00): MPEG-21 Event Reporting (with Requirements) o Tues (09h00 - 10h00): MPEG-21 Binarization (with Systems) o Tues (15h30 - 16h00): MPEG-21 Conformance (with Integration) o Tues (16h00 - 17h00): MPEG-21 REL/RDD SW (with Integration) o Tues (17h00 - 18h00): MPEG-21 DID/DIA/DIP SW (with Integration) Break-out Groups: Event Reporting BoG (created at kick-off meeting): o Mandates: Create initial draft of architecture combining elements from ER proposals Map to requirements and identify gaps and areas needing expertise from other parts of MPEG-21 (eg., REL+RDD) Create initial plan for evaluation / core experiments AHG + CE (need to create CE workplan document) Prepare request for subdivision Planning for two passes of WD, going to CD in 10/2004 o Time/place: Tues 09:00—12:00, Room Z947 69 Tues 14:00—18:00, Room Z947 Wed 11:00—13:00, Room Z947 DIP BoG: o Mandates: Define RequestResourceAuthorization using REL/RDD interfaces (rename DIBO) Develop consistent strategy for get object interface to DID, statements, and embedded info; consider ExtractDIAXDI specifically Explore solutions for playing of fragment Make recommendation on defining DIBOs vs. DIML object methods Review draft NB comments, discussing with NB representatives, and create draft disposition Create draft of study document with revisions corresponding to draft dispositions o Time/place: Tues 18:00—20:00 Wed 11:00—13:00 Wed 14:00—15:30, Room Z947 Thurs 10:00—13:00, Room Z947 Thurs 14:00—16:00, Room Z947 Review of AHG resolutions and action points: Doc No. Contribution Source Myriam Amielh, Gerrard Drury, Sylvain Devillers, Yongju Cho, AHG on 10469 Craig Brown Locators 70 MPEG 21 Media Results: Requirements text already finalized in Hawaii Discussion on XPointer, hierarchical reference Updates to DID proposing changes Questions: How are media locators relevant for file format? Media locator references within file. Actions: New contribution on logical media locator (m10503) Submit updates to DID Discuss & refine design principals Discuss candidate technologies Harmonize various schemes Joint meeting with file format and MPEG-7 MDS Keep alive to complete mandate 2 Xin Wang, Jaime Delgado , Chris AHG on MPEG-21 REL and RDD 10470 Barlas Reference Software Results: 8 input documents Initial set of conformance test cases Integration SW REL/RDD with DID Ontology for REL/RD Actions: Discuss content of REL/RDD reference SW suite (how do DIA and DIP work with REL/RDD?); collection of tools AHG on Profiles and Extensions 10491 Brad Gandee, Chris Barlas for the MPEG-21 REL Actions: Activity is important, but there has been little traction with industry; suggest to suspend exploration of profiles temporarily and consider something like CE to produce report on hypothetical profiles Anthony Vetro, Christian Timmerer, Sylvain Devillers, 10471 Thomas DeMartini AHG on DIA Editing 71 Results: AMD.8 done FDIS submitted to SC29 Maintain schema and examples Editor’s input on WD of AMD.1 Three input contributions; some partially in response to CfC Questions: What is content of AM document? What tools should be kept as under consideration in AM? Actions: Add time to schedule to go through AM contents and remove tools that are no longer under consideration Jorg Heuer, Debargha Mukherjee, AHG on Bit-stream Adaptation Sylvain Devillers, Christian in Constrained and Streaming 10472 Timmerer Environments Results: Evaluation criteria How to improve BSD framework performance for low complexity and streaming environments Approach 1: BSDL + STX to support streams (stream of SAX events) Approach 2:gBSD + XSLT (could require AMD to BSDLink) Evaluation has difficulties because of comparing Java and C++ Questions: Questions were raised about investigation and how it is relevant for standardization? This is exploration activity leading to standardization; Actions: Plan to continue work – AHG may not be necessary; time-frame still being clarified, but work should continue to July 2004-Dec 2004. Clarify the goals of this work leading towards some kind of standardization Christian Timmerer, Gerrard AHG on MPEG-21 DIA 10473 Drury , Frederik De Keukelaere Reference Software Results: Updated SW modules (3); care needs to be taken with CVS. Questions: What is XMLPULL? Actions: Keep this activity alive (could be through joint AHG) Review contributions and update SW plan Gerrard Drury, Frederik De AHG on MPEG-21 DIP 10474 Keukelaere, Munchurl Kim Reference Software 72 Results: Contributions will be uploaded Questions: How close to a common code base Actions: Common code base from existing contributions Update plan; update SW to be compliant with DIP CD Gerrard Drury, Rik Van de Walle, AHG on Editing and Core 10475 Munchurl Kim Experiments for DIP Results: Editing of CD; draft comments Questions: Relationship to REL Actions: Present results of DIBO explorations (RequestResourceAuthorization) to IPMP – needs more discussion Produce Study Thomas DeMartini, Sylvain Devillers, Frederik De Keukelaere, 10487 Gerrard Drury AHG on MPEG-21 Conformance Results: Two contributions relate to REL conformance, see: W10628: Contribution to MPEG-21 REL Interpretation Conformance Test Cases W10573: DMAG REL Interpretation Conformance Actions: AHG recommends launching more complete activity on MPEG-21 Conformance MPEG-21 Event Reporting with Requirements Doc No. Contribution Source AHG on MPEG-21 Event Reporting Overview of responses to N6278 : MPEG-21 Event Reporting Call for Proposals 10494 FX Nuttall, Andrew Tokmakoff 10675 Niels Rump 73 Results: Received responses to call (from 67th meeting) Believe have a good basis for “global” architecture that can produce a structure for ER (XML fields) ER represented as DIs (can inherit properties) Basis architecture – syntax description of some elements How to generate event report requests (ER requests)? Event analyzer Generate event report (XML data structure)? How to describe event, need very precise semantics of events Questions: Do we have complete starting point Will new semantics need to be defined for RDD? Can possibly be based on initial set of verbs in RDD? Actions: Plan for week to produce WD 1.0 Define architecture Identify where further expertise is needed ER requirements related to other parts should go to Requirements document Proposed MPEG-21 Event Youngjoo Song, Kyunghee Ji, FX Reporting Data Structure as 10618 Nuttall, Andrew Tokmakoff Digital Item 74 Results: Data structure for event reporting requests and messages represented as Digital Items (req. 2.2.17) Initially proposed at 66th meeting ERR (request) peer ER o What (eg., id) o Condition (eg., play has occurred) o ToWhom (recipient) o Delivery output o Descriptor ER Message o ER description data o Requested action o Source o Descriptor Questions: How to represent that address of recipient? Do protocols/messaging/communications need to be standardized here? Either protocols should not be part of this or should be defined at different level of standard Recommendations: Starting point for formation of ER messages Proposed Definition on Delivery Kyunghee Ji, Nammee Moon, Time and Recipient of MPEG-21 10619 Youngjoo Song, Jinwoo Hong Event Reporting Senator Jeong, Ji-Hyun Park, Response to the CfP on Event Yeon-Jeong Jeong, Weon-Guen Reporting; Proposed Event 10635 Oh, Chang-Yeol Lee Reporting Language MPEG-21 DID Binarization with Systems: Doc No. Contribution Christian Timmerer, Hermann Hellwagner, Jörg Heuer, Claude 10718 Seyrat, Andreas Hutter 75 Source BinaryXML – A Comparison of Existing XML Compression Techniques Results: Experiments of compressing gBSD using a variety of compression techniques. (gBSD describes the high-level structure of a resource – layers, headers, etc.) Encoders that take advantage of redundancy perform better on larger size input BiM performs best on small source data BiM also seems to have best functionality in compressed domain, eg., binary access, streaming Questions: May be a special case of source data for MPEG-21, which is bitstream syntax description – this experiment is specific to BSDs Actions: Next step use to use version 2 of BiM codec Try on larger set of source data and other parts of MPEG-21 Proponents interest continue experiments MMG-Waseda proposal onIssues in binary Itaru Kaneko (Waseda) , Mika coding(binaization) of MPEG-21 10646 Onishi Neergaard (MMG) DID Results: Domain independent encoding Questions: Why coding directly from RDB Actions: Collect test data Consider RDB mapping Identify various dimensions of evaluation criteria 10644 Stephen Davis, Ian Burnett Binarisation of MPEG-21 DIDs 76 Results: Consider standard set of codec when embedded data or XML with no schema, eg., base64 codec, or string codec Progressive DIDs – streaming of fragments of DID How to fragment DID – transmission order? How to keep DID valid? Could use signaling to indicate when DID becomes valid in case of progressive delivery Questions: Is there anything special about MPEG-21 (DID and BSD) that requires changes to BiM? Actions: MPEG-7 systems should be investigated to see whether it completely addresses requirements for DID fragmentation and progressive delivery Make output document – new part of MPEG-21, possible amendment of MPEG-7 systems MPEG-21 Responses to Call for RDD Registration Authority: Doc No. Contribution Source IDF's Response to Evaluation Criteria for Appointing JTC 1 RA of ISO/IEC 21000-6 [SC 29 N 5825] RDD Registration Authority Rightscom submission 10518 IDF via SC 29 Secretariat 10613 Chris Barlas Results: Received two responses to call for RA for RDD in Hawaii meeting Requested more information from candidates DOI with Rightscom as subcontractor has responded with more information Resulted in one withdrawal (Rightscom) and one response (IDF w. Rightscom) Actions: Evaluated response and recommend selection of IDF for RA MPEG-21 RDD Extensions: Doc No. Contribution Source 77 ISO/IEC 21000-6 : Proposal for Corrigendum 10731 Chris Barlas Results: Found error to figure 1 – not consistent with Table 1. Also, mistake in way Figure 1 is referred to as normative Actions: Create RDD COR/1 WD at this meeting with this correction MPEG-21 DIA AMD/1: Doc No. Contribution Source Suggested Edits for Digital Item Adaptation Amendment 1 Working Draft 1.0 10516 Thomas DeMartini Results: Edits to text for DIA AMD/1 Questions: Questions about ##any for conversions Actions: Adopt to DIA AMD/1 WD Requirements for conversion descriptions in a live radio 10629 Kate Grant broadcasting environment 78 Results: Report on some requirements for conversions in live radio broadcasting Questions: Use as response to call for conversion operators? Actions: Example conversions from audio domain have been provided Use these examples (audio, JC) to validate the DIA conversions framework Also use these as example representations or classification schemes for the framework Some difficulties have been recognized for validating the framework given that conversion composite is not adequate for expressing arbitrary assembly of conversion operators? Response to call was not adequate to understand the wide range of conversions and requirements for expressing them Create a new call – ask for more information; create template Target specific industries – broadcasters, (check list of MPEG liaisons), DANAE, Melisa Gather the set of conversions already under investigation internally in MPEG, and use them to validate the DIA conversions framework – these conversions should be implemented and the descriptors should be generic by abstracting out the essential parts (eg., minimal set of required parameters) Next steps: Agree to standardize conversion description framework as normative Agree to develop set of conversions / conversion parameters conforming to framework and incorporate as informative examples but later consider adopting common elements as normative Agree to validate the conversion description framework using conversions and conversion parameters that are from genuine use cases and industry practices Validation includes working out relationship with RDD Agree to produce examples of expressing conversion descriptions and mapping/specialization in RDD Proposal to Digital Item Adaptation Amendment 1 on Mariam Kimiaei-Asadi, Jean- Conversion Descriptors and 10697 Claude Dufourd Transmoding Contribution to Digital Item Adaptation Amendment 1 on Mariam Kimiaei-Asadi, Jean- Transcoding and Transforming 10698 Claude Dufourd Conversion Descriptors 79 Actions: Jean-Claude to work with Thomas to revise the definition of conversion descriptor framework Proposal to support AdaptationQoS adaptation in 10722 Debargha Mukherjee, Sam Liu DIA for multi-step adaptation Actions: Not presented because authors could not attend 68th meeting. Will be submitted again to 69th meeting, which will be attending by authors. MPEG-21 DIP: Doc No. Contribution Source Munchurl Kim (ICU), Hendry (ICU), Keonsoo Park (KBS), Huang CE reports on DIBO 10630 Zhongyang explorations Results: Propose DIBO for RequestResourceAuthorization Propose DIBO for ExtractDIAXDI Questions: Relationship to REL and IPMP – RequestResourceAuthorization DIBO may be part of solution for IPMP requirements Actions: Postpone decision on RequestResourceAuthorization DIBO until more discussion on Reference SW, REL, IPMP ExtractDIAXDI is one example of get object type of interface for DID, DIA, etc. There are NB comments related to this; Wait until discussing NB comments before deciding direction Two Proposed DIBOs for 10643 Ernest Wan, Myriam Amielh handeling a DID Anchor Results: PlayFragment DIBO, GetFragmentArguments DIBO Questions: What is relationship with fragment part of URI? Could this be implemented by including fragment resource Actions: Discuss in BoG; CE? Thomas DeMartini, Vishy Preliminary Comments on DIP 10572 Swaminathan , Anthony Vetro CD Actions: Review and dispose in BoG 80 Christian Timmerer, Hermann 10585 Hellwagner Actions: Review and dispose in BoG Jeroen Bekaert, Frederik De Keukelaere, Robbie De Sutter, Rik Van de Walle, on behalf of the 10621 Belgian NB Actions: Review and dispose in BoG Munchurl Kim (ICU), Hendry (ICU), Keonsoo Park (KBS), Huang 10630 Zhongyang Actions: Review and dispose in BoG Comments on MPEG-21 DIP CD BNB Comments on ISO/IEC 21000-10 CD Part 10: Digital Item Processing CE reports explorations on DIBO MPEG-21 Conformance: Doc No. Contribution Source Thomas DeMartini, Sylvain Devillers, Frederik De Keukelaere, 10487 Gerrard Drury AHG on MPEG-21 Conformance Eva Rodriguez, Jaime Delgado, DMAG REL Interpretation 10573 Silvia Llorente Conformance Thomas DeMartini, Venugopal Contribution to MPEG-21 REL Venkatraman , TJ Pannu , Xin Interpretation Conformance 10628 Wang Test Cases Actions: Do not promote Conformance WD to CD Achieve a stable definition of “description” conformance for DID, DIA and REL Scope of “interpretation” or “engine” conformance still needs to be clarified within larger context of MPEG-21 architecture Questions on liability of conformance specification. MPEG-21 REL/RDD Ref. SW with Integration: Doc No. Contribution Xin Wang, Venugopal Venkatraman, Frederik De Keukelaere, Rik Van 10521 de Walle 81 Source Simple Integration Reference Software for MPEG-21 REL and DID DMAG REL License Interpretation using RDD term genealogy – Implementation using Web Services Contribution to DID/REL/RDD reference software: DMAG REL License Interpretation within DID using RDD term genealogy Status of DMAG Reference Software for MPEG-21 REL/RDD/DID MPEG REL and RDD Ontologies API 10574 Eva Rodriguez, Jaime Delgado 10575 10577 10702 Victor Torres, Jaime Delgado, Eva Rodriguez Jaime Delgado, Eva Rodriguez, Silvia Llorente, Roberto Garcia, Victor Torres Roberto Garcia, Jaime Delgado, Eva Rodriguez, Isabel Gallego Roberto Garcia, Jaime Delgado, Isabel Gallego RELOntos (REL Ontologies) 10703 Actions: Adopt Six SW contributions of REL/RDD for MPEG-21 Ref. SW MPEG-21 Location Schemes: Doc No. Contribution Source Myriam Amielh, Gerrard Drury, Sylvain Devillers, Yongju Cho , AHG on MPEG 21 Media 10469 Craig Brown Locators Suggested updates to the Myriam Amielh, On behalf of the definitions of a DID fragment 10605 AhG for MPEG-21 Medialocs in DID v.2 Questions: What inconsistency is fixed by proposed changes? Presumes that fragment attribute is solution for full media locator functionality Actions: Do not adopt at present Consider for next steps for media locating -- CE? Proposal for logical media 10503 Alan K. Melby, John R Smith locator for MPEG 7&21 82 Results: Proposal of logical media locator for MPEG-7 syntax, which provides functionality Questions: Make this DID relevant, eg., locating with DID elements Need clear definition of logical unit locator – to be worked on off-line Actions: Consider in context of MPEG-7 USNB Contribution: MPEG-21 10561 A. G. Tescher for USNB Media Locators Results: Response to USNB: WG11 thanks USNB for contribution on MPEG-21 Media Locators. WG11 has established a core experiment on media locators that will evaluate candidate technologies for MPEG-21 addressing schemes, including solutions based on MPEG-7 Media Locators. The results of this core experiment will be reported in the 69th meeting. An alternative non-amendment approach to track numbers for 10747 Adam Lindsay MAF Results: Proposal to address locating of logical units using existing MPEG-7 tools – SemanticStateDS, since it provides name-value pairs Provides also a classification scheme for logical unit types Questions: Don’t we also need classification scheme that is specific to media rather than something generic Generic classification scheme is comparable with DID MPEG-21 DID 2nd Edition: Doc No. Contribution Source Frederik De Keukelaere, Jeroen Comments on ISO/IEC 21000-2 10611 Bekaert, Rik Van de Walle DID 2nd Ed WD v.2 Results: Proposing some revisions to DID spec to update some attributes Accepting most changes – minor clarifications Not accepting some for which the semantics of original definitions is changing – will be further studied. Actions: Comments for which there was agreement will be adopted to DID CD v.2 Comments for which more work needs to be done will be further investigated and will be reconsidered at next meeting 83 MPEG-7 Extensions: Doc No. Contribution Source (Lossy) compression DescriptorModel 10714 Holger Crysandt Actions: Needs to be further explored in context of audio and visual applications Adopt to XM to allow further study Summary of Voting on ISO/IEC 15938-5/PDAM 2 [SC 29 N 10528 SC 29 Secretariat 5835] KNB comment on 15938-5 10727 Korea National Body (KNB) PDAM2 : ContentCS extension Results: Reviewed and disposed of NB comments Results reflected in DoC Proposal for logical media 10503 Alan K. Melby, John R Smith locator for MPEG 7&21 Topic: Proposal to extend MPEG-7 media locator functionality to address logical units, eg., title, chapter, section, etc. This functionality is currently missing from MPEG-7 and is needed in order to be able to map ID3 music tags to MPEG-7. This is required for new MPEG work item on music file format. Results: Adopt to MPEG-7 XM to allow further experiments Actions: Examine in core experiment along with applicability to MPEG-21 addressing scheme requirements MPEG-7 Multimedia Description Schemes (MDS) Liaison Matters: Doc No. Contribution Source Liaison Statement from the TVAnytime Forum [SC 29 N 5789] 10501 TVA via SC 29 Secretariat 84 Actions: Send MPEG-7 MDS User Preference Extensions FPDAM/2 – (1) point out that new User Preference types are being developed in MPEg-7, and (2) new ContentCS may provide input for TVAnytime MediaType CS. Send MPEG-7 Profiles FCD and MPEG-7 MDS DCOR/1 – (1) point out that MPEG is defining profiles, including User Description profile and (2) MPEG-7 is adding signaling mechanism for profiles and levels to MPEG-7 MDS MPEG-7 Schema Definition: Doc No. Contribution Source Summary of Voting on ISO/IEC 15938-7/PDAM 1 [SC 29 N 5656] 10253 SC 29 Secretariat, Results: Reviewed NB comments on Schema Definition Results reflected in DoC MPEG-21 DID/DII/DIA/DIP Ref. SW with Integration: Doc No. Contribution Source Frederik De Keukelaere, Rik Van Contribution to DID 2nd Edition 10609 de Walle reference software Frederik De Keukelaere, Rik Van Contribution to DII reference 10610 de Walle software Status Report and Michael Ransburg, Christian Improvements of the MPEG-21 10584 Timmerer, Hermann Hellwagner DIA Reference Software Examples of Java Native Jeho Nam, Hyuk-Min Kwon, Man- Interface (JNI) for MPEG-21 10739 Bae Kim, Jin-Woo Hong DIA Reference SW Gerrard Drury, Frederik De AHG on MPEG-21 DIP 10474 Keukelaere, Munchurl Kim Reference Software Topic: Reviewed contributions on DID, DII, DIA, DIP reference SW Results: New contributions on DID, DII, DIA including integration of software packages adopted Produce MPEG-21 Ref SW CD with modules for DID, DII, REL/RDD, DIA (not complete integrated MPEG-21 solution) 85 Report of MPEG-21 BoGs: Doc No. Contribution Source Event Reporting BoG Event Reporting BoG Results: Created WD v.1 using three input contributions as basis for initial design ER WD v.1 document structured as follows: o Event Reporting Request Structure o Event Report Structure o Relation to DID Skeleton architecture has been developed and CE will further investigate the detailed definition of the elements based on current contributions DIP BoG DIP BoG Results: Define RequestResourceAuthorization using REL/RDD interfaces (rename DIBO) Develop consistent strategy for get object interface to DID, statements, and embedded info; consider ExtractDIAXDI specifically Explore solutions for playing of fragment Make recommendation on defining DIBOs vs. DIML object methods – O-O implementation will be investigated in period following FCD Review draft NB comments, discussing with NB representatives, and create draft disposition - Create draft of study document with revisions corresponding to draft dispositions Conversion Description Framework Conversion Description BoG Framework BoG Results: Thomas DeMartini to draft Annex to DIA AMD/1 Conclusions: (1) Need to have very clear and precise descriptions of conversions such that they will be mapped to the dictionary (crop) Summary of Results on MPEG Multimedia Description Schemes (MDS) work items: Results on MDS MPEG-7 work items: 1. MPEG-7 MDS (Part 5): Reviewed & disposed of NB comments on MDS AMD/2 86 New contributions on lossy descriptor model and logical unit locator adopted to MPEG-7 MDS eXperimental Model (XM) Output: o DoC on MPEG-7 MDS “User Preference Extensions” PDAM/2 o MPEG-7 MDS “User Preference Extensions” FPDAM/2 o MPEG-7 Multimedia Description Schemes DCOR/1 2. MPEG-7 Schema Definition (Part 10) Reviewed & disposed of NB comments on Schema Definition CD Main action was to synchronize with AMD schemas of parts of MPEG-7 Output: o DoC on MPEG-7 Schema Definition CD o MPEG-7 Schema Definition FCD Results on MDS MPEG-21 work items: 1. Analyzed recommendations of AHGs and Core Experiments. 2. MPEG-21 Part 2 – Digital Item Declaration: MPEG-21 Digital Item Declaration (Part 2): Reviewed proposals for location schemes & other contributions Adopted some improvements for DID 2nd Edition Output: o MPEG-21 DID 2nd Edition CD o Core experiment on MPEG-21 media locators 3. MPEG-21 Rights Data Dictionary (RDD): RDD Registration Authority (RA): Evaluated detailed information response from candidate for RDD RA Recommendation to appoint International DOI Foundation (IDF) as RDD RA Output: o MPEG-21 RDD COR/1 WD (correcting figure) 4. MPEG-21 Part 7 – Digital Item Adaptation: Reviewed contributions for conversion description framework Defining normative conversion description framework in AMD/1 Developing an example informative set of conversions to validate framework and demonstrate mapping & term specialization in RDD Output: o MPEG-21 DIA AMD/1 WD v.2 87 5. MPEG-21 Reference SW (Part 8): Reviewed contributions for MPEG-21 Reference SW Six SW contributions of REL/RDD adopted for Ref. SW New contributions on DID, DII, DIA including integration of software packages also adopted MPEG-21 Ref SW CD contains modules for DID, DII, REL/RDD, DIA (not complete integrated MPEG-21 solution) Output: o MPEG-21 Ref. SW CD & SW Implementation Plans 6. MPEG-21 Part 10 – Digital Item Processing: Released CD in 67th meeting (ballot still open) Reviewed and disposed of most of the 110 draft comments from 3 NBs Reviewed core experiment results and contributions Created core experiment to define DIBOs for REL Outstanding tasks: o Develop consistent approach for access of DID elements and other DID embedded info o Develop solutions for playing of fragment o Evaluate OO- versus procedural-design for DIBOs Output: o Study of Draft Comments on MPEG-21 DIP CD o MPEG-21 DIP Study of CD 7. MPEG-21 Part 15 – Event Reporting: New MPEG-21 work item for MDS group at this meeting Objective: o Event Reporting supports monitoring of events relating to consumption of and interaction with Digital Items by specifying mechanisms to express Event Report Requests (ERR) and Event Reports (ER) o Created initial ER design using three responses to CfP as basis Created ER draft: o Event Reporting Request Structure o Event Report Structure o Relation to DID o Defined core experiments for evaluating detailed definitions (syntax and semantics) for ERR and ER elements Output: o MPEG-21 Event Reporting WD v.1 and “Request for Subdivision” o Core Experiment for Event Reporting 8. Edited and approved output documents (WD, CD, AHGs, new CEs, etc.) 88 89 Resolutions from MDS Subgroup: MPEG-7 related resolutions: Part 5 Multimedia Description Schemes: o The Multimedia Description Schemes subgroup thanks the National Bodies of Japan, Republic of Korea and United States for comments on MPEG-7 MDS User Preference Extensions PDAM/2. All National Bodies have approved the disposition. Part 10 Schema Definition: o The Multimedia Description Schemes subgroup thanks the National Bodies of Great Britain, Japan and United States for comments on MPEG-7 Schema Definition CD. All National Bodies have approved the disposition. MPEG-21 related resolutions: Part 6 Rights Data Dictionary: o WG11 would like to thank International DOI Foundation (IDF) for their interest to serve as the Registration Authority for ISO/IEC 21000-6 and for providing a detailed response to the evaluation criteria developed in 67 th meeting. After careful review, WG11 has determined that IDF is suited to perform the task. WG11 therefore requests the SC29 secretariat to issue the ballot asking for IDF to be appointed Registration Authority for ISO/IEC 21000-6. Part 7 Digital Item Adaptation: o The Multimedia Description Schemes subgroup invites interested parties to continue the work on bitstream adaptation in streaming and constrained environments and to report on this activity and/or prepare a core experiment workplan for 69th MPEG meeting. Part 10 Digital Item Processing: o The Multimedia Description Schemes subgroup reminds proponents of DIP tools that integrated reference software implementations must be provided and that core experiments must be successfully completed in order for promotion of the tools. Part 15 Event Reporting: o The Multimedia Description Schemes subgroup reminds proponents of Event Reporting tools that integrated reference software implementations must be 90 provided and that core experiments must be successfully completed in order for promotion of the tools. 91 List of MDS Output documents: MPEG-7: No. 6397 6398 6399 6406 Title TBP 15938-5 MPEG-7 Multimedia Description Schemes DoC on ISO/IEC 15938-5 PDAM/2 N ISO/IEC 15938-5 FPDAM/2 “MDS User Preference Y Extensions” MPEG-7 MDS XM v.19 N ISO/IEC 15938-5 DCOR/1 N No. Title 15938-10 MPEG-7 Schema definition 6407 DoC on ISO/IEC 15938-10 CD 6408 ISO/IEC 15938-10 FCD “Schema Definition“ Available 04/03/19 04/03/19 04/03/19 04/03/19 TBP Available N Y 04/03/19 04/03/19 TBP Available Y N 04/04/02 04/03/19 MPEG-21: No. Title 21000-2 MPEG-21 Digital Item Declaration 6409 ISO/IEC 21000-2 DID 2nd Edition CD 6410 Workplan for Core Experiment on Media Locators No. Title 21000-3 MPEG-21 Digital Item Identification TBP No. Available Title 21000-5 MPEG-21 Rights Expression Language 6411 MPEG-21 REL/RDD Software Implementation Plan v.6 TBP Available N 04/03/19 No. Title 21000-6 MPEG-21 Rights Data Dictionary 6412 ISO/IEC 21000-6 COR/1 WD v.1 TBP Available N 04/03/19 No. TBP Available N 04/04/19 N 04/03/19 TBP Available Title 21000-7 MPEG-21 Digital Item Adaptation MPEG-21 DIA AMD/1 WD v.2 “Conversions 6413 Permissions” 6414 MPEG-21 DIA Software Implementation Plan v.7 No. Title 92 and 6415 6416 6417 6418 21000-10 MPEG-21 Digital Item Processing ISO/IEC 21000-10 Study of CD “Digital Item Processing” Study of Draft Comments on Digital Item Processing CD MPEG-21 DIP Software Implementation Plan v.2 Workplan for Core Experiment on DIBOs for REL No. N 04/04/02 N N N 04/03/19 04/03/19 04/03/19 Title TBP 21000-15 MPEG-21 Event Reporting 6419 ISO/IEC 21000-15 WD v.1 “Event Reporting” N Request for Subdivision to ISO/IEC 21000 for “Event 6420 N Reporting” 6421 Workplan for Core Experiment on Event Reporting N 93 Available 04/03/19 04/03/19 04/03/19 List of AHGs approved by the MDS group: N6422 Mandates Chairman Co Chair Duration Meetings Reflector N6423 Mandates Chairman Co Chair Duration Meetings Reflector N6424 Mandate: Chairs: Duration: Meetings: Reflector: Subscribe: 14.1.1 AHG on Core Experiments for MPEG-21 DID 2nd Edition 1. Carry out and monitor Core Experiments related to DID. 2. Encourage delivery of reference software contributions by Core Experiment participants. 3. Encourage contributions on improving MPEG-21 DID 2nd Edition CD. Gerrard Drury (gerrardx@xenikos.com) Frederik De Keukaleare (Frederik.DeKeukelaerex@xugent.be) Until the 68th Meeting AHG Meeting to be held on the Sunday prior to 68th meeting. Other business to be conducted by email or phone. mpeg-21-dipx@xuow.edu.au. Please use the prefix [DID] 14.1.2 AHG on Core Experiments for MPEG-21 DIP 1. Carry out and monitor Core Experiments on DIP. 2. Submit contribution to MPEG-21 IPMP CfP based on work conducted in the CE on DIBOs for REL. 3. Encourage delivery of reference software contributions by Core Experiment participants. 4. Encourage contributions on improving MPEG-21 DIP CD. Gerrard Drury (gerrardx@xenikos.com) Frederik De Keukaleare (Frederik.DeKeukelaerex@xugent.be) Munchurl Kim (mkimx@xicu.ac.kr) Until the 69th Meeting AHG Meeting to be held on the Sunday prior to 69th meeting. Other business to be conducted by email or phone. mpeg-21-dipx@xuow.edu.au 14.1.3 AhG on MPEG-21 Event Reporting 1. Produce input for ER WD 2. conduct and report on the Core Experiment. FX Nuttall (fx at nuttall.org) Andrew Tokmakoff (tokmakoff at telin.nl) Until the 68th Meeting A pre-meeting will be held on the Sunday before the Seattle meeting. Other business will be conducted by E-mail or telephone conference. mpeg-21-list at imec.be messages to use the prefix [ER] To subscribe, send an email to owner-mpeg-21-list at imec.be 94 95 MPEG MDS group schedule for 68th meeting: MDS Sub-Group Schedule MPEG MDS Chair: John R. Smith MPEG-7 and MPEG-21 FINAL TITLE ROOM & SOURCE Number Monday Morning (9h00-13h00) MPEG Plenary STD Plenary room Monday Afternoon (14h00-20h00) Kick-off of MPEG MDS activities (14h00-14h30) Agenda, Goals and Issues for the Week for MDS Group Review of AHG resolutions and action points (14h30-16h00) 10469 Myriam Amielh, Gerrard Drury, Sylvain Devillers, Yongju Cho, Craig Brown 10470 Xin Wang, Jaime Delgado , Chris Barlas 10491 Brad Gandee, Chris Barlas Anthony Vetro, Christian Timmerer, Sylvain Devillers, Thomas DeMartini 10471 10472 10473 10474 10475 10487 10630 Jorg Heuer, Debargha Mukherjee, Sylvain Devillers, Christian Timmerer Christian Timmerer, Gerrard Drury , Frederik De Keukelaere Gerrard Drury, Frederik De Keukelaere, Munchurl Kim Gerrard Drury, Rik Van de Walle, Munchurl Kim Thomas DeMartini, Sylvain Devillers, Frederik De Keukelaere, Gerrard Drury Munchurl Kim (ICU), Hendry (ICU), Keonsoo Park (KBS), Huang Zhongyang MPEG-21 Event Reporting with Requirements (16h00 - 17h00) Z995 (MDS Room) ALL John R. Smith Z995 (MDS Room) ALL AHG on MPEG 21 Media Locators AHG on MPEG-21 REL and RDD Reference Software AHG on Profiles and Extensions for the MPEG-21 REL AHG on DIA Editing AHG on Bit-stream Adaptation in Constrained and Streaming Environments AHG on MPEG-21 DIA Reference Software AHG on MPEG-21 DIP Reference Software AHG on Editing and Core Experiments for DIP AHG on MPEG-21 Conformance CE reports on DIBO explorations Z995 (MDS Room) 10494 FX Nuttall, Andrew Tokmakoff 10675 Niels Rump AHG on MPEG-21 Event Reporting Overview of responses to N6278 : MPEG-21 Event Reporting Call for Proposals 10618 Youngjoo Song, Kyunghee Ji, FX Nuttall, Andrew Tokmakoff Proposed MPEG-21 Event Reporting Data Structure as Digital Item 96 MPEG-21 NOTES 10619 10635 Kyunghee Ji, Nammee Moon, Youngjoo Song, Jinwoo Hong Senator Jeong, Ji-Hyun Park, YeonJeong Jeong, Weon-Guen Oh, ChangYeol Lee Define BoGs and Mandates (17h00-17h30) REL, RDD, DIA, BSD, DIP Proposed Definition on Delivery Time and Recipient of MPEG-21 Event Reporting Response to the CfP on Event Reporting; Proposed Event Reporting Language Z995 (MDS Room) BOG Room = N0116 ALL Tuesday Morning (09h00-13h00) MPEG-21 Event Reporting BoG (09h00 - 12h00) Z947 (MDS BoG Room) MPEG-21 MPEG-21 DID Binarization with Systems (09h00 - 10h00) Z995 (MDS Room) MPEG-21 10718 Christian Timmerer, Hermann Hellwagner, Jörg Heuer, Claude Seyrat, Andreas Hutter BinaryXML – A Comparison of Existing XML Compression Techniques 10646 Itaru Kaneko (Waseda) , Mika Onishi Neergaard (MMG) MMG-Waseda proposal onIssues in binary coding(binaization) of MPEG-21 DID 10644 Stephen Davis, Ian Burnett Binarisation of MPEG-21 DIDs MPEG-21 RDD Reg. Authority (10h00 - 10h30) 10518 IDF via SC 29 Secretariat 10613 Chris Barlas MPEG-21 RDD Extensions (10h30 - 11h00) 10731 Chris Barlas MPEG-21 DIA AMD/1 (11h0012h00) 10516 Thomas DeMartini 10629 Kate Grant Z995 (MDS Room) MPEG-21 IDF's Response to Evaluation Criteria for Appointing JTC 1 RA of ISO/IEC 21000-6 [SC 29 N 5825] RDD Registration Authority Rightscom submission Z995 (MDS Room) MPEG-21 ISO/IEC 21000-6 : Proposal for Corrigendum Z995 (MDS Room) Suggested Edits for Digital Item Adaptation Amendment 1 Working Draft 1.0 Requirements for conversion descriptions in a live radio broadcasting environment 97 MPEG-21 10697 Mariam Kimiaei-Asadi, Jean-Claude Dufourd 10698 Mariam Kimiaei-Asadi, Jean-Claude Dufourd 10722 Debargha Mukherjee, Sam Liu Proposal to Digital Item Adaptation Amendment 1 on Conversion Descriptors and Transmoding Contribution to Digital Item Adaptation Amendment 1 on Transcoding and Transforming Conversion Descriptors Proposal to support AdaptationQoS adaptation in DIA for multi-step adaptation Tuesday Afternoon (14h0020h00) MPEG-21 Event Reporting BoG (14h00 - 20h00) Z947 (MDS BoG Room) MPEG-21 MPEG-21 DIP (14h00 - 15h30) Z995 (MDS Room) MPEG-21 10630 10643 10572 10585 10621 Munchurl Kim (ICU), Hendry (ICU), Keonsoo Park (KBS), Huang Zhongyang Ernest Wan, Myriam Amielh Thomas DeMartini, Vishy Swaminathan , Anthony Vetro Christian Timmerer, Hermann Hellwagner Jeroen Bekaert, Frederik De Keukelaere, Robbie De Sutter, Rik Van de Walle, on behalf of the Belgian NB MPEG-21 Conformance (15h30 16h00) with Integration 10573 Thomas DeMartini, Sylvain Devillers, Frederik De Keukelaere, Gerrard Drury Eva Rodriguez, Jaime Delgado, Silvia Llorente 10628 Thomas DeMartini, Venugopal Venkatraman , TJ Pannu , Xin Wang 10487 MPEG-21 REL/RDD Ref. SW with Integration (16h00 - 17h00) CE reports on DIBO explorations Two Proposed DIBOs for handeling a DID Anchor Preliminary Comments on DIP CD Comments on MPEG-21 DIP CD BNB Comments on ISO/IEC 21000-10 CD Part 10: Digital Item Processing Z995 (MDS Room) MPEG-21 AHG on MPEG-21 Conformance DMAG REL Interpretation Conformance Contribution to MPEG-21 REL Interpretation Conformance Test Cases Z995 (MDS Room) 10521 Xin Wang, Venugopal Venkatraman, Frederik De Keukelaere, Rik Van de Walle 10574 Eva Rodriguez, Jaime Delgado 10575 Victor Torres, Jaime Delgado, Eva Rodriguez Simple Integration Reference Software for MPEG-21 REL and DID DMAG REL License Interpretation using RDD term genealogy – Implementation using Web Services Contribution to DID/REL/RDD reference software: DMAG REL License Interpretation within DID using RDD term genealogy 10577 Jaime Delgado, Eva Rodriguez, Silvia Llorente, Roberto Garcia, Victor Torres Status of DMAG Reference Software for MPEG-21 REL/RDD/DID 98 MPEG-21 10702 10703 Roberto Garcia, Jaime Delgado, Eva Rodriguez, Isabel Gallego Roberto Garcia, Jaime Delgado, Isabel Gallego MPEG REL and RDD Ontologies API RELOntos (REL Ontologies) MPEG-21 DIP BoG (18h00 20h00) TBD MPEG-21 MPEG Plenary (9h00-11h30) Plenary room MPEG Plenary MPEG-21 Event Reporting BoG (11h00 - 13h00) Z947 (MDS BoG Room) MPEG-21 MPEG-21 DIP BoG (11h00 13h00) TBD MPEG-21 MPEG-7 Profiles (11h30 - 12h30) with Req., Video, Audio, Systems Plenary Room (Requirements) MPEG-7 10492 Wo Chang, Masanori Sano AHG on MPEG-7 Interoperability and Profiling 10648 Wo Chang Preliminary FCD on MPEG-7 Profile 6162 John R. Smith MPEG-7 MDS COR/1 WD v2.0 MPEG-21 USNB Contributions (12h30 - 13h00) with Requirements 10560 A. G. Tescher for USNB 10561 A. G. Tescher for USNB Plenary Room (Requirements) MPEG-21 USNB Contribution: Demographic Information USNB Contribution: MPEG-21 Media Locators Wednesday Afternoon (14h0017h30) MPEG-21 DIP BoG (14h00 15h30) Z947 (MDS BoG Room) MPEG-21 MPEG-21 Event Reporting (14h30 - 15h30) Z995 (MDS Room) MPEG-21 MPEG-21 Location Schemes (15h30 - 16h30) Z995 (MDS Room) MPEG-21 10469 Myriam Amielh, Gerrard Drury, Sylvain Devillers, Yongju Cho , Craig Brown AHG on MPEG 21 Media Locators 99 10605 Myriam Amielh, On behalf of the AhG for MPEG-21 Medialocs 10503 Alan K. Melby, John R Smith 10561 A. G. Tescher for USNB Suggested updates to the definitions of a DID fragment in DID v.2 Proposal for logical media locator for MPEG 7&21 USNB Contribution: MPEG-21 Media Locators 10747 Adam Lindsay An alternative non-amendment approach to track numbers for MAF MPEG-21 DID 2nd Edition (16h30 - 17h00) 10611 Frederik De Keukelaere, Jeroen Bekaert, Rik Van de Walle 10616 Marc Gauvin, Melanie Dulong de Rosnay Z995 (MDS Room) MPEG-21 Comments on ISO/IEC 21000-2 DID 2nd Ed WD v.2 The Notion of Underlying Work within MPEG 21 MPEG-21 File Format (17h00 18h00) with Systems N1090 (Systems Room) MPEG-21 Plenary MDS and Reports of BoG (18h00 - 18h30) Z995 (MDS Room) MDS Plenary MPEG-21 BoG on DIA Conversion Description Framework (09h00 10h00) Z947 (MDS BoG Room) MPEG-21 MPEG-21 DIP BoG (10h00 13h00) Z947 (MDS BoG Room) MPEG-21 MPEG-21 ER BoG (09h00 13h00) 1601 (MDS BoG Room) MPEG-21 MPEG-7 Extensions (09h00 10h00) Z995 (MDS Room) MPEG-7 MPEG Social Event (18h30 midnight) Thursday Morning (09h00-12h30) 10714 Holger Crysandt 10528 SC 29 Secretariat 10727 Korea National Body (KNB) 10503 Alan K. Melby, John R Smith (Lossy) DescriptorModel compression Summary of Voting on ISO/IEC 15938-5/PDAM 2 [SC 29 N 5835] KNB comment on 15938-5 PDAM2 : ContentCS extension Proposal for logical media locator for MPEG 7&21 100 10560 A. G. Tescher for USNB MPEG-7 MDS Liaison Matters (10h00 - 10h30) 10501 TVA via SC 29 Secretariat MPEG-7 Schema Definition (10h30 - 11h00) 10507 SC 29 Secretariat 10499 Cieplinski MPEG-21 Event Reporting (11h00 - 12h00) USNB Contribution: Demographic Information Z995 (MDS Room) MPEG-21 Liaison Statement from the TVAnytime Forum [SC 29 N 5789] Z995 (MDS Room) MPEG-21 Summary of Voting on ISO/IEC CD 15938-10 [SC 29 N 5911] UK NB comments on Text of ISO/IEC CD 15938-10 Z995 (MDS Room) MPEG-21 MPEG-21 DIP BoG (14h00 16h00) Z947 (MDS BoG Room) MPEG-21 MPEG-21 ER BoG (14h00 16h00) 1601 (MDS BoG Room) MPEG-21 MPEG-21 DID/DII/DIA/DIP Ref. SW with Integration (15h00 16h00) N1090 (Systems Room) MPEG-21 Thursday Afternoon (14h0019h00) 10610 Frederik De Keukelaere, Rik Van de Walle Frederik De Keukelaere, Rik Van de Walle 10584 Michael Ransburg, Christian Timmerer, Hermann Hellwagner 10609 10739 10474 Jeho Nam, Hyuk-Min Kwon, Man-Bae Kim, Jin-Woo Hong Gerrard Drury, Frederik De Keukelaere, Munchurl Kim Plenary MDS and Reports of BoG (16h00 - 17h00) Review of Output documents, AHGs, CEs, DoC, Std (17h0018h00) Contribution to DID 2nd Edition reference software Contribution to DII reference software Status Report and Improvements of the MPEG-21 DIA Reference Software Examples of Java Native Interface (JNI) for MPEG-21 DIA Reference SW AHG on MPEG-21 DIP Reference Software Z995 (MDS Room) Z995 (MDS Room) 101 MDS Plenary Friday Morning (09h00-13h00) Wrapping up (09h00 - 13h00) Approval of resolutions, AHGs and Output documents Z995 (MDS Room) MDS Plenary Plenary room MPEG Plenary Friday Afternoon (14h00-21h00) MPEG Plenary 102 Annex 8 Report of Video meeting Source: Jens-Rainer Ohm, Miroslaw Bober MPEG-4 Corrigendum MPEG-4 Visual Third Edition (14496-2:2004) has been proofread by editors and is now in publication process. COR1 of this edition (N6362+ N6361 DoC) has been finalized in the 68th meeting. By request of NBs in the DCOR ballot, the final text is based on the Study of DCOR (N6163 of 67th meeting), as well as additional comments received by US and Japan NBs. Documents reviewed: 10505 Summary of Voting on ISO/IEC TR 144967:2002/Amd.1/DCOR 1 [SC 29 N 5909] SC 29 Secretariat New Versions of MPEG-4 Visual List of Problems Reported Version 12 of the document "MPEG-4 Visual List of Problems Reported" (N6363) was issued. This contains some minor issues related to text part (14496-2:2004) which in general are of low priority, to be resolved in a later corrigendum. The LPR contains a detailed report on software bug fixing. All known bugs from the MS part of the software are fixed at this time, and the new package is in the process of being published within Amendment 5 of 14496-5:2001. Some problems with the Momusys package remain, but are planned to become fixed in the near future. All problem reports related to Conformance streams have been removed from the document and were considered in the Working Draft of a Conformance Corrigendum (see 1.3). Documents reviewed: 10517 MPEG-4 Visual: List of Problems Reported, v.11.1 Yi-Shin Tung Chung-Neng Wang Tihao Chiang Jens-Rainer Ohm Conformance Corrigendum WD Fixing of Conformance streams being listed as erroneous in the previous List of Problems Reported is at a very early stage. The Video Subgroup presently has not sufficient resources to maintain the conformance streams; more input and expertise is required by the previous contributors of these streams. A first effort in this direction was made by three companies who provided input documents related to fixed conformance streams, and propose to produce a Corrigendum. As only a small percentage of streams that are known to be erroneous were provide, the video subgroup decided to produce a WD for this corrigendum (N6364), which will be updated in the following meetings when more streams will be made available. This corrigendum also includes a number of typo correction, where the names of existing (correct) streams deviate from the names by which they are described in 14496-4. The procedure of this corrigendum is presently planned is as follows: – – A request is made to NIST to provide a CVS repository for all Visual conformance streams, and all bitstreams which are becoming corrected will be collected at this site; The DCOR will be issued October 2004; 103 – – All bitstreams that are not received until then will be removed from conformance part (144964); This implies a follow-up action where the related profiles and levels could be removed from the standard (14496-2). Documents reviewed: 10599 10634 10650 Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition Proposed Corrigendum to ISO/IEC 14496-4:200X Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition Takeshi Nakamura Etsuko Sugimoto Takuyo Kogure CS Lim Toshiya Takahashi Taka Senoh Optimised Reference Software The second edition of 14496-7 (Optimised Reference Software) was provided as input document, reviewed and approved. This integrates the original PDTR text, Amendment 1 and Corrigendum 1 of Amendment 1 into one single document. Documents reviewed: 10505 10723 Summary of Voting on ISO/IEC TR 144967:2002/Amd.1/DCOR 1 [SC 29 N 5909] SC 29 Secretariat Text of DTR 14496-7 Second Edition Chung-Neng Wang Tihao Chiang Huifang Sun AVC In Munich, a JVT meeting took place in parallel with the Video Subgroup. Main topics in MPEG4 part 10 (AVC) were related to the professional extensions amendment (Study text of FPDAM in N6360) and the finalization of Corrigendum 1 (N6358 with DoC N6357). To simplify the processing of documents and readability of standards, the Corrigendum will not be published, but integrated right away into a new edition of 14496-10 (N6359). The video subgroup recommended approval of all the related documents by MPEG. Documents reviewed: 10551 10562 10608 10671 10742 Summary of Voting on ISO/IEC 14496-10/DCOR 1 USNB Contribution: 14-bit sample depth support SgNB Comment on AVC Fidelity Range Extension JNB Comment on MPEG-4 AVC Fidelity Range Extension CANNB Comment on MPEG-4 AVC Fidelity Range Extension SC 29 Secretariat A. G. Tescher for USNB Singapore National Body JNB CANNB Output documents related to MPEG-4 No. Title TBP Available 14496-2 MPEG-4 Visual N6361 Disposition of Comments on ISO/IEC 14496-2:2004 DCOR 1 N6362 Text of ISO/IEC 14496-2:2004 COR 1 N6363 MPEG-4 Visual: List of Problems Reported version 12.0 14496-4 MPEG-4 Conformance 104 N N Y 04/03/19 04/03/19 04/03/19 N6364 WD 1.0 of 14496-4 Visual Bitstreams Conformance Corrigendum Y 04/04/16 Y N N Y 04/04/10 04/04/10 04/04/10 04/05/01 14496-10 Advanced Video Coding N6357 N6358 N6359 N6360 Disposition of Comments on ISO/IEC 14496-10:2003/DCOR 1 Text of ISO/IEC 14496-10:2003/COR 1 Text of ISO/IEC 14496-10:2004 (second edition) Study of FPDAM text for AVC Professional Extension Amendment MPEG-7 MPEG-7 related work in Munich The MPEG-7 breakout group was active during the whole week. Input documents as reviewed are listed in the subsequent table. 10498 UK NB comments on Text of ISO/IEC 15938-8/PDAM1 Cieplinski 10514 Summary of Voting on ISO/IEC TR 15938-8/PDAM 1 [SC 29 N 5820] SC 29 Secretariat 10532 Release of Perceptual 3D Shape (P3DS) XM software 10566 Experimental results for a Search & Retrieval System using MPEG-7 still image descriptors 10595 MPEG-7 Visual XM Document version 19.1 10596 Second Editor's Study on ISO/IEC TR 15938-8/PDAM1 10597 10639 Report on progress of VCE-1 Introduction report: The emerge of MS Longhorn Initial report on Visual tools and DS for images or photos libraries (VCE-1) 10640 10657 Comparative study for 3D and 2D/3D Shape Descriptors 10708 Suggestions on experimental methodology in CE on Visual tools and DS for images or photos libraries (VCE-1). Hui Zhang Duck Hoon Kim In Kyu Park IST-SCHEMA Vasileios Mezaris Yiannis Kompatsiaris Stephan Herrmann Josep Casas Akio Yamada Sang-Kyun Kim Akio Yamada Sang-Kyun Kim Akio Yamada Sang-Kyun Kim Sang-Kyun Kim Titus Zaharia Francoise Preteux Rob O’Callaghan, Miroslaw Bober New interesting applications of MPEG-7 were reported in M10567. It describes retrieval of car components based on 3D shape descriptors. Full demo will be shown during the forthcoming MPEG meeting. M10566 describes strategy on combination and joint use of MPEG-7 descriptors. A request for New Visual Extensions (Amd.2 of 15938-3) was made (N6366). A WD was produced (N6367). This presently includes the new 3D shape descriptor which previously was adopted for XM. In addition to other low-level descriptor elements as required e.g. for photo libraries, Amd.2 will most probably contain higher-level (e.g. semantics of scenes) Visual description tools. Optionally, a Call for such technology could be issued in the future. A new Version (20.0) of MPEG-7 Visual XM was edited (N6368). 105 The text of DAM1 for 15938-8 (Extraction and Usage of MPEG-7 Visual Descriptors Extensions, N6371+N6370 DoC) was issued. The Study of PDAM (N6191 of Waikoloa) was adopted by NB request. Core Experiments will be continued for further testing of new Visual extensions (N6369). Joint meeting on Multimedia Application Formats was held with Requirements, Systems, Audio and MDS. Systems group responded positively to video request to modify the ISO file-format in order to support non-timed metadata with small overhead. Output documents related to MPEG-7 No. Title TBP Available 15938-3 MPEG-7 Visual N6366 N6367 N6368 N6369 Request for 15938-3 Amd.2 (New Visual Extensions) WD 1.0 of MPEG-7 New Visual Extensions MPEG-7 Visual XM Document version 20.0 Description of Core Experiments for MPEG-7 Visual Extensions N N N N 04/03/19 04/04/02 04/03/19 04/03/19 N N 04/04/09 04/04/09 15938-8 Extraction and Use of MPEG-7 Descriptions N6370 Disposition of Comments on ISO/IEC TR 15938-8/PDAM1 N6371 Text of ISO/IEC TR 15938-8/DAM1 MPEG-21 Scalable Video Coding Following the CfP on Scalable Video Coding, a total number of 14 full proposals (complete algorithms submitted for subjective testing) and additional 7 tools proposals have officially been received by the deadline. In addition, 5 technical contributions had been submitted as regular MPEG input documents, which mostly described standalone tools (10524, 10535), additional tools for algorithms submitted (10706, 10712) or concepts for complete algorithms with preliminary results (M10723). A thorough technical analysis was done on all the submissions. The most important properties of the algorithm submissions can be highlighted as follows: S01 (Polytech Milano&TILAB) In-band method with MCTF (overcomplete DWT), MC based on 16x16 blocks, same vector for all wavelet bands. ME is performed within subbands, where e.g. horizontal displacement estimator uses HL, vertical displacement estimator uses LH etc., full search of LL band first to avoid local minima. Hierarchical MC by spatial subdivision and subband subdivision. Scalable coding of motion vectors is also implemented (tree based method related to the different subdivision splittings) S03 (HHI) AVC with MCTF (open loop), deblocking filter only at decoder side (deblocking at analysis affected performance), multi-reference pictures, direct mode slightly modified; residual prediction coding using multiple transforms at encoder (could be avoided). SNR scalability levels are at QP+6 points (half/double quantizer step sizes). Spatial scalability by classical difference pyramid approach, using the AVC interpolation filter. Performance of non-scalable MCTF (with optimization for a certain rate point) usually better than AVC. Prediction of low temporal subbands is used. S05 (Microsoft I: subband) 106 "Barbell lifting", 5/3 filters without specific block structure, barbell function can be integer, interpolation, OBMC …, "energy distributed update" for best reconstruction by inverse motion, different prediction modes, adaptive block size similar to AVC. Multiple motion layers for scalable motion representation. Uses 3D EBCOT, RD optimized bit allocation. SNR scalability by bitplane coding. S06 (Microsoft II: PFGS) AVC as base layer, options are enhancement prediction modes from base layer only, from enhancement layer only or average of both. Enhancement layer prediction can potentially introduce drift. Joint ME for base and enhancement layers, use ABT and CABAC. TS can use either base or enhancement as reference (no drift). SS also uses enhancement-layer prediction. Uses an older version of AVC. At low rates same performance as AVC, deteriorates towards higher rates. Low coding delay. S07 (NCTU I: RFGS) Base layer is AVC compatible, enhancement layer scalable, wavelet transform of residual is used for spatial scalability. Leak and bitplane selection are used for minimization of drift problem. An additional low-rate AVC stream is simulcasted to correct the drift at each 4th frame, this also saves motion vector rate. Both streams are decoded and results added (i.e. 2 AVC decoders are needed). Low coding delay. Useful tools are (also in context of wavelet coding) the intra coding with boundary mirror and the CABAC bitplane coding. S08 (NCTU II: Wavelet) Based on MCTF with Haar filters, but uses the interframe prediction of AVC and CABAC encoding of motion vectors and modes; signaling of connected/unconnected blocks additionally, not only derived from the MVF. Scalable motion representation 1 pel, ½ pel, ¼ pel, and simultaneously refinement of block sizes 16, 8, 4. S09 (NEC) Uses conventional low-pass filter for downsampling, MCTF/EZBC separately at each layer, but skip the spatial lowpass information at the higher spatial resolution; drift compensation applied in the reconstruction of this lowpass signal for higher resolutions from lower resolutions. Finer quantization of low-resolution signal is needed for the higher resolution reconstructions. Estimation and encoding of motion vectors separately for all three layers. S11 (ITRI) Based on MC-EZBC, uses AVC-like intra prediction in the encoding of lowest temporal/spatial subband; saves in average 12% of rate for this part of information. Total bit rate saving is not too high. S13 (Poznan) Classical spatial scalability with interpolation-based prediction from lower layers, independent motion estimation in the layers, encoding of motion vectors in enhancement layer can use baselayer motion vectors. Edge-adaptive interpolation is used. Uses AVC syntax, but in some cases modified semantics for the enhancement layer coders. FGS is introduced by macroblock skipping. This introduces drift, but this is bounded by cyclic introduction of frames which are only predicted from base layer. S15 (RPI) MCTF with color-based ME, directional prediction for I-Blocks, OBMC, P-Block and reverse in addition to connected mode. Scalable motion vectors with motion vector encoding done by CABAC (investigation of contexts). Scalability in accuracy (up to 1/8 pixel) S16 (RWTH Aachen) MCTF with optional 1 level of spatial subband in advance. 5/3 filters with adaptation, quantizers are also adapted according to the switching. RD optimized motion estimation. Motion representation like HVSBM starting from 64x64, encoding by median prediction and CABAC. Proposal does not provide multiple adaptations, is a kind of "scalable simulcast", where the different spatial resolutions are simulcasted. S17 (Samsung) 107 STAR is MCTF with only prediction step, multiple reference frames, allows low delay mode as no update step is used. Closed-loop approach to reduce encoder/decoder mismatch. Low-band correction, which allows to use scalable motion information. Scheme is capable for low delay with loss of less than 1 dB. S18 (Thomson) MCTF using 2 filter types (pixel level, block level), different modes (forward, backward, bidirectional, intra), motion accuracy scalable (up to 1/8 pel for higher rates), slightly higher cost at high rates, but saving approx. 25% at low (QCIF resolution) rates. Coder based on JPEG2000. Switching between different temporal filters (Haar,5/3,truncated 5/3). Cluster proposals around requirements, as delay, multiple adaptations, Proposals for CE: Mode switching, delay, ER, scalable motion, scalable entropy coding S20 (Visiowave) Spatial transform before temporal transform, integer implementation (5/3 spatial wavelet). Uses an UMCTF-like scheme (4 temporal dyadic scalability levels) without update. Uses different GOP sizes for different spatial resolution levels. Motion field is spatially scalable. Could be used in closed loop, compatibility with JPEG2000 "keyframes". Low-delay configuration, no update step. A first clustering of the full algorithm proposals was then made into the following categories: A: AVC based proposals (S03 including AVC+MCTF): S03, S06, S13 B: "t+2d": MCTF 2D Wavelet: S05, S08, S11, S15, S17, S18 C: "2D+t": 2D Wavelet MCTF: S01, S09, S20 D: Scalable Simulcast (of different spatial resolutions): S07, S16 It must be noted however, that the boundaries of these categories cannot be drawn sharply, i.e. some proposals might even fit into different categories. The possibility of performing multiple adaptations of scalable streams (high-to-medium-to-low rates) was considered important to judge the results, such that the simulcast solutions were not fully taken into consideration, Exact weighting in trade-off with other specific requirements (e.g. low delay) was considered very difficult, as it requires a more detailed analysis of different operating modes, which can only be done in Core Experiments. Furthermore, it was emphasized that more background is necessary on detailed requirements of application cases to judge the pros and cons of different approaches on a more profound basis. Formal subjective tests had been performed around two different test scenarios: Test 1: 3 layers of spatial resolution, wider range of bit rate scalability; Test 2: 2 layers of spatial resolution, less wide range of bit rate scalability. Not all proposals had participated in both test scenarios, and this was not mandatory from the CfP conditions. The analysis of test results, which was performed jointly with the Test subgroup, can be summarized as follows: For both test scenarios, scalable coders exist which are close in decoded quality to the singlelayer anchors. The best proposals are within a range of <0.5 MOS deviation from the anchors in average. It should be noted that some scalable approaches performed superior to the single layer anchor at some rate points. Depending on technology, the best operating range is rate dependent. A more simplified grouping of proposals was then done into only 2 categories: Category 1: MCTF/2D Wavelet methods, in particular the t+2d (MCTF before spatial wavelet) methods: These showed best performance in Test 1, and performed reasonably good in Test 2. Category 2: AVC based, in particular on proposal combining AVC+MCTF with a conventional base-layer upsampling: This showed best performance in Test 2, but did not participate Test 1. 108 The results show clear evidence that technology exists which can be used as starting point of SVC standardization, but can be clearly expected to further improve in the process of Core Experiments. In particular, motion-compensated temporal filtering (MCTF) is a common basis used in many (in particular the best-performing) proposals. MCTF establishes a framework beyond the traditional MC prediction techniques of previous standards, which can in fact be seen as a generalization including the traditional MC prediction closed loop, Progressive FGS (closed/open loop combinations) and lifting (prediction/update) based MCTF (fully open loop). Therefore, a first version of the Scalable Video Model (SVM) was drafted (N6372), which is built around this generic MCTF framework. It was decided to test the other elements around this common basis in Core Experiments. A set of Core Experiments (see N6373) was designed for optimization and convergence of different proposals within the two categories listed above. As starting points, the best performing proposals in each category were selected. Core Experiments will be based on two software implementations (one per category). The result of Core Experiments will be used in the July meeting for the decision to adopt one complete codec architecture into the WD 1.0. While a high degree of commonality can be observed about the approaches to achieve efficient temporal and SNR scalability, the best method for the goal of spatial scalability is still open, This will have a high impact on the adoption of the spatial transform for the WD, which could in fact either be a 2D wavelet transform or a block-based transform. Common conditions for the CE were derived from the CfP rate/resolution points. Test 1 (3 layers of spatial scalability) was adopted similarly, but reduced to only 6 different rate points, which appears reasonable as the subjective quality was practically transparent at the 6 Mbit/s, while the lowest rate point in some cases of sequences was even hard to decode by sufficient quality for the single-layer anchor. For Test 2 (2 layers of spatial scalability) test conditions remained unchanged. A methodology was defined jointly with the test group to evaluate selected CE results by expert viewing tests in future meetings. In addition, one CE (CE 3) was defined to explore methodologies which would allow to use objective criteria e.g. based on PSNR at least for optimization of single tools within one scalable algorithm. The following Core Experiments were defined: a) CE 1 (MCTF+2DWT =category 1) 1a: Scalable Motion Information 1b: Spatial Transform & Entropy Coding 1c: Intra Modes 1d: Introduction of a base layer 1e: MCTF with de-blocking b) CE 2 (AVC based/extended =category 2) 2a: Combination of MCTF and MC Prediction 2b: Inter-layer prediction modes and upsampling 2c: Comparison of SNR scalability technologies 2d: Dynamic spatial transforms It is within the mandate of the SVC CE Adhoc group to refine the definitions and conditions of CEs within 3 weeks after the meeting. With A joint meeting was held with the Systems subgroup to review two input documents (M10591, 10592) which proposed to implement Layered Video Coding at the Systems layer of existing MPEG standards, which could e.g. combine decoder outputs from one or two different video coding standards in a traditional layered (base layer upsampling + enhancement difference) approach. This method would however fully be accomodated by the SVM framework (and is a simple case of it). Clearly, it is technically feasible, however the efficiency in terms of 109 compression performance, and the evidence about market needs are not clear. There is no need for any urgent action. A joint meeting was also held with JVT on the different aspects of SVC. This is rather important as certain tendencies of convergence between AVC and SVC can be observed. Single-layer AVC could be very important for usage as base layer in SVC applications, which seems possible in both categories, and is also part of the CE explorations. SVC proposals from category 1 have used some tools (e.g. motion vector encoding, CABAC) from AVC. SVC proposals from category 2 are merely extensions from AVC. The MCTF framework could well be implemented as an extension (though not minor) from AVC motion compensation tools, or also as an evolution or superset of more traditional MC approaches, which have found their most advanced development so far in AVC. Therefore, the MCTF framework seems to be of high interest for both groups. Results of the CfP have shown that MCTF can even increase compression efficiency as compared to single layer coding, but still performs competitive when operated scalable due to the open loop concepts. It is the common opinion of both groups that it is necessary to make the best use of existing technology and avoid divergence of standards. Documents reviewed: a) CfP M10569 /S01 /S02 Registered Responses to the CfP on Scalable Video Coding Fast In-band MCTF with Scalable Motion Vectors Interframe Wavelet Coding with Frame Adaptive Spatial Wavelet Transform /S03 Scalable Extension of H.264/AVC /S04 JVT Compliant Adaptive 3-D FGS (JCAF) Scalable Video Coding /S05 3D Sub-band Video Coding using Barbell lifting /S06 Progressive Fine Granularity Scalable (PFGS) video coding /S07 /S08 /S09 A Robust Scalable Video Coding Technique A Scalable Video Coding Scheme Based on Interframe Wavelet Technique Multi-Resolution Motion-Compensated Temporal Filtering for 3-D Wavelet Coding /S11 A Scalable Video Coding Technology With Intra Prediction /S13 (M10626) Scalable AVC Codec /S14 A method for upsampling, compression and decompression of image and video data /S15 MC-EZBC scalable video coder /S16 RWTH Proposal for Scalable Video Coding Technology /S17 Responses of Call-for-Proposal for Scalable Video Coding Fully scalable video coding based on 2D+t wavelet technology /S18 (M10534) 110 Jens-Rainer Ohm Stefano Tubaro, Giovanni Cordara Wonha Kim, Seyoon Jeong, Kyuheon Kim, Jinwoong Kim Heiko Schwarz, Detlev Marpe, Thomas Wiegand Hayder Radha, Kiran Misra Jizheng Xu, Ruiqin Xiong, Bo Feng, Gary Sullivan, Ming-Chieh Lee, Feng Wu, Shipeng Li Xiaoyan Sun, You Zhou, Yi Wang, Gary Sullivan, Ming-Chieh Lee, Feng Wu, Shipeng Li Hsiang-Chun Huang, Wen-Hsiao Peng, Yao-Chung Lin, ChungNeng Wang, Tihao Chiang, HsuehMing Hang Chia-Yang Tsai, Han-Kuang Hsu, Hsueh-Ming Hang, Tihao Chiang Takahiro Kimoto, Yoshihiro Miyamoto Hsin-Hao Chen, Guo-Zua Wu, YiJung Wang Łukasz Błaszak, Marek Domański, Rafał Lange, Adam Łuczak Yotam Toib, Ran Boneh, Ahik Man Yongjun Wu, Abhijeet Golwelkar, John W. Woods Mathias Wien, Thomas Rusert, Konstantin Hanke Woo-Jin Han J.Vieron, E. François, V. Bottreau, C.Guillemot, G.Marquant, G.Boisson /S20 Low Latency Video Codec Using Inband Prediction and Block Arithemetic /S21 (M10589) Response to Call for Proposals on Scalable Video Coding Technology /S22 (M10537) /S23 (M10538) Motion-compensated scalable subband video codec with optimized temporal prediction and update operators /S24 (M10724) A spatial decomposition tool for improved spatial resolution scalability in video coding M10737 Subjective test results for the CfP on Scalable Video Coding Technology Motion-compensated triadic temporal scalable codec Guillaume Baud, Martin Duvanel, Julien Reichel, Francesco Ziliani Yiannis Andreopoulos, Fabio Verdicchio, Joeri Barbarien, Adrian Munteanu, Mihaela Van der Schaar, Peter Schelkens Béatrice Pesquet-Popescu, Gregoire Pau Béatrice Pesquet-Popescu, Christophe Tillier Charith Abhayaratne, Nikola Sprljan, Marta Mrak, Ebroul Izquierdo Vittorio Baroncini, Tobias Oelbaum b) Technical input 10524 Inter-block shuffling FGS 10535 Curved Wavelet Coding for Scalable Video Coding 10706 10712 10723 Spatial Highpass Transition Filtering for Interframe Wavelet Video Coding Layered Motion Vector Coding for Improved Spatial Scalability in Interframe Wavelet Video Coding Scalable video coder with AVC-like properties Doug Young Suh Seung Ho Park Demin Wang Liang Zhang Andre Vincent Hanke Thomas Rusert Yiliang Bao, Marta Karczewicz c) Systems related 10591 10592 Rational for heterogeneous layered video support in MPEG-2 Systems (as in M10359) Proposal for MPEG-2 System amendment to support heterogeneous layered video Fons Bruls Jan van der Meer Jan van der Meer Fons Bruls Output documents related to MPEG-21 SVC No. Title TBP Available 21000-13 Scalable Video Coding N6372 Scalable Video Model Version 1.0 N Description of Core Experiments in MPEG-21 Scalable Video N N6373 Coding N6383 Subjective test results for the CfP on Scalable Video Coding Y Technology 04/03/19 04/03/19 04/03/19 Explorations 3D AV Coding The main activities in the 3D AV exploration by the beginning of the week were to review progress achieved in the Exploration Experiments (EE), and to summarize the responses received on the Call for Comments (CfC) on 3D AV. For EE1 (omni-directional video), it was proven that fast local decoding (for random access determined by viewpoint request) is possible using tools from existing standards. A method of "B-maps" was further investigated which provides another moderate reduction in bitrate for the random access functionality. It is however consensus in the group that it is not worthwhile 111 presently to take any action in additional standardization for this aspect, as the existing tools are sufficient. For EE2 (free viewpoint adaptation), 3 new sets of test material for "3D-TV" and "cave navigation" scenarios have been made available by participants. New exploration results are reported related to the reconstruction quality achievable by disparity-based view interpolation with and without residual encoding (starts from 200 bits/frame); Switching between inter-view and inter-frame prediction (gain of up to 2 dB over simulcast); Spherical ray space coding; Average Coding from multiple views. 23 responses were received on the CfC and analysed in detail. The high number of responses shows the strong support and industry demand for Free Viewpoint Video as investigated in this exploration. Many responses support the scenarios as described in the existing Applications and Requirements document. Some responses give more concrete application examples that may be planned for future products. Some responses also requests to start a more concrete standardization effort. Relevant application scenarios were identified from the responses which could be used for technology evaluation in a possible future CfP a) 3D TV: Cameras are arranged in an array (e.g. 2x8). View adaptation is done by user interaction or used for presentation on multiview (e.g. autostereoscopic) displays. In this application domain, the main problem is an efficient multiview compression as compared to simulcast b) Interactive view selection: Cameras are distributed around a moving object or a larger scene (e.g. around a sports stadium), and the user is allowed to navigate by selecting preferred viewing position. In both cases, the main issue related to the work of the video group is the efficiency of multiview video representation, which however must not necessarily mean pixel-true representation, but could also include high-quality synthesis of views. In the context of EE1 and the former EE4, it was found that many functionalities of 3DAV can already be achieved using existing standards tools by proper combination. Concrete cases will be studied by the AHG with potential option to define a Multimedia Application Format, following the requirements of Omnidirectional Video. Results from EE2 are not conclusive yet about the maturity of 3DAV technology that might require new tools standardization. This is partially due to the fact that test material that was used earlier (until the Munich meeting) did not cover sufficient realistic application cases. To go one step further in investigating the maturity of 3DAV technology, an MPEG-internal "Draft Call for Evidence" (N6374) is issued instead of re-defining EE2. The expected outcome of this Call is further clarification of maturity of existing solutions and exploration/refinement of testing conditions for a possible follow-up CfP. It was decided that only compression performance of multiview data representations can be evaluated at the moment. The rendering process must be excluded, as this might bias the results or put certain technical solutions in disadvantage. Therefore, technical proposals for exploitation of interframe/inter-view redundancies and compact representation of multiview video data will be compared against simulcast at same data rates. The simulcast anchors will be encoded by AVC, and the comparison in July will be made using a similar expert viewing procedure as described above in the context of the SVC Core Experiments. Documents reviewed: a) Responses to CfC 10510 10513 Comments to MPEG 3DAV activities Response to 3DAV CfC Ryoichi Kawada George Chen 112 10515 10520 10522 10553 10565 10598 Comments to MPEG 3DAV activities Comments to MPEG on 3DAV activities Comments to MPEG 3DAV activities Comments to MPEG 3DAV activities Comments to MPEG on 3DAV activities Comments on MPEG 3D-AV Standardization Activities 10600 In Response to ”Call for Comments on 3DAV” 10604 Comments to MPEG on 3DAV activities 10623 Response to the Call for Comments on 3DAV 10631 A response to the call for comments on 3DAV 10649 10651 JNB comments on MPEG 3DAV Comments to MPEG 3DAV activities 10658 Response to the Call for Comments on 3DAV 10666 Response to the Call for Comments on 3DAV 10669 Response to the Call for Comments on 3DAV 10673 10677 10667 Response on Call for Comments on 3DAV Response to the Call for Comments on 3DAV Proposal of Application Format for Omni-directional Video Ken-ichiro Yamamoto Ali Tabatabai Hideyuki Kanayama Morimura Okui Akio Yamada Toshio Tsutomu C.S. Boon Tomokazu Masahiro Yo-ichi Horii Hanspeter Anthony Huifang Sun Wook-Joong Euee. S. et al. Akira Yuzo Hirayama Marco Rittermann Andreas Marco Christian Weigel Kohtaro Asai Kazumasa Yamazawa b) Technical input 10511 10512 10533 ST dataset for 3DAV EE2 Using inter-view prediction for multi-view video compression KDDI multiview video sequences for MPEG 3DAV use 10581 Average Coding of Free-viewpoint Video in MPEG-4 10594 Panoramic Video Coding Results 10624 3D TV System 10632 B-map method for the partial decoding and rendering of panoramic video 10636 Multi-Video Compression in Texture Space 10652 10668 10670 Preliminary results on inter-view coding for the dense Ray Space representation (3DAV EE2.2.1) Comparison of Temporal and Spatial Predictions for Dynamic Ray-Space Coding Data Compression and Interpolation of Spherical Ray-Space 113 George Chen George Chen Ryoichi Kawada Michael Waschbuesch Stephan Wuermlin Edouard Lamboray Markus Gross Hanspeter Pfister Sung Won Park Jong Woo Won Sun young Lee Yong Ho Cho Euee S.Jang Wook Joong Kim Hanspeter Pfister Anthony Vetro Huifang Sun Wook-Joong Kim Euee. S. Jang et al. Gernot Ziegler Hendrik Lensch Marcus Magnor Masayuki Tanimoto Toshiaki Fujii Masayuki Tanimoto Toshiaki Fujii Miki Horikoshi Murakami Kageyama Pfister Vetro Kim Jang Morishita Dantele Rittermann 10674 Demonstration of a MPEG-4 Compliant System for Omnidirectional Video 10676 Results for EE2 on Model Reconstruction Free Viewpoint Video Aljoscha Smolic Sebastian Heymann Karsten Mueller Yong Guo Aljoscha Smolic Karsten Mueller Philipp Merkle Tobias Rein Peter Eisert Thomas Wiegand Video Coding Tools Repository A new explorational investigation on a possible definition of a Video Coding Tools Repository (VCTR) was started in a breakout group which held two meetings during the week. The background of this activity is as follows: The landscape of media coding usage has changed a lot for the last two decades The traditional One tool=One functionality rule may not always apply, and in fact does not even exist across different MPEG standards, where newer standards may re-define tools from older standards MPEG Video Standards are in competition with non-MPEG standards Similar building blocks are used over different standards, even though with (sometimes) significant differences Building blocks from different standards could be combined The following definition of the repository was made by the breakout group: The repository is a collection of decoding functional units extracted from existing MPEG standards and updated with new tools whose addition has been considered beneficial by MPEG The collection materializes in textual description of different functional units, reference software (and possibly hardware description), and conformance testing tools The repository could be used by adding new functional units or extend the functionalities of the existing functional units to create new profiles of existing standards or new standards; creating combinations of old/new functional units; implementers can integrate multiple decoders; upgrading video decoding capabilities; creating multimedia middleware components. The definition of a functional unit is not the same as tool from existing standard and in most cases is probably more granular. Definition of glue elements may be needed to fit different functional units together. Study of typical functional units was started (e.g. DCT/IDCT, MC, DC/AC prediction). However, even at this level, divergent definitions in different standards can be found, which might make it difficult to achieve a common definition. Much more detail can be found in Study of Video Coding Tools Repository (N6375) Breaking existing standards into pieces that would allow their usage for this purpose might require major re-definitions. This is due to the fact that previous standards definitions such as MPEG-2 and MPEG-4, though formally based of tools, are syntactically similar to structured programming in C syntax instead of taking a clean object-based approach. It was further discussed that intra-only Video Coding could be an interesting example of the Video Coding Tools Repository usage. In previous meetings, interest from industry had been shown to combine intra tools from MPEG standards within standalone profile(s). Furthermore, for intra coding tools, no complicated inter-relationships with prediction loop exists, such that 114 intra coding tools could relatively easy be isolated in terms of syntax, semantics and decoding processes. The technical feasibility of intra-only coding shall therefore further be studied within the work of the AHG on the repository. Output documents related to Explorations No. Title TBP Available 3D AV N6374 Draft Call for Evidence on Multiple View Video N Coding 04/03/19 Video Coding Tools Repository N6375 Study of Video Coding Tools Repository N 04/03/19 AHGs established by the Video Subgroup No. 637 6 637 7 637 8 637 9 638 0 638 1 Title Mtg AHG on Maintenance of MPEG-4 Visual related Documents, Reference N Software and Conformance AHG on Maintenance of MPEG-7 Visual related Documents and Reference N Software AHG on Description Tools for New MPEG-7 Visual Extensions Y AHG on Core Experiments in Scalable Video Coding Y AHG on 3DAV Coding Y AHG on Video Coding Tools Repository Y 115 Annex 9 Report of Audio meeting Source: S. Quackenbush, Chair, Audio Subgroup 1 OPENING OF THE MEETING ........................................................................................................... 118 2 ADMINISTRATIVE MATTERS........................................................................................................... 118 2.1 Approval of previous meeting report .......................................................................................................... 118 2.2 Approval of agenda and allocation of contributions ................................................................................. 118 2.3 Communications from the Chair ................................................................................................................. 118 2.4 Joint meetings ............................................................................................................................................... 118 2.5 Received National Body Comments and Liaison matters ......................................................................... 118 2.6 Task Groups .................................................................................................................................................. 118 3 RECORD OF AHG MEETINGS ......................................................................................................... 119 3.1 MPEG-4 Extension 2, Parametric Audio Coding (Sunday 0900-1030) ................................................... 119 3.2 Audio Exploration (Sunday 1030-1300) ..................................................................................................... 119 3.3 Lossless Audio Coding (Sunday 1400-1700) ............................................................................................... 120 3.3.1 SLS ......................................................................................................................................................... 120 4 RECORD OF AUDIO PLENARY, JOINT MEETINGS AND TASK GROUP ACTIVITIES ................ 121 4.1 Review of AHG reports ................................................................................................................................ 121 4.2 Received national body comments and liaison matters ............................................................................. 121 4.3 Audio plenary discussions ............................................................................................................................ 122 4.3.1 New Test Material .................................................................................................................................. 122 4.3.2 Spatial Audio Coding ............................................................................................................................. 122 4.4 Joint Meetings ............................................................................................................................................... 123 4.4.1 With Systems, Tue 1000-1200 ............................................................................................................... 124 4.4.2 Joint meeting with All on MAF, Tue 1200-1300 .................................................................................... 125 4.4.3 With All on M3W, Tue 1400-1430 ........................................................................................................ 125 116 4.4.4 4.4.5 With MDS, Video on MPEG-7, Wed 1130-1300................................................................................... 125 With Requirements, Wed 1400-1430 ..................................................................................................... 125 4.5 Task Group discussions ................................................................................................................................ 125 4.5.1 MPEG-2 Layer III .................................................................................................................................. 125 4.5.2 MPEG-2/4 Audio.................................................................................................................................... 126 4.5.3 MPEG-4 Lossless Audio Coding ............................................................................................................ 127 4.5.4 MPEG-7 Audio ....................................................................................................................................... 129 4.5.5 Spatial Audio Coding ............................................................................................................................. 129 4.5.6 Symbolic Music Representation ............................................................................................................. 129 5 MEETING DELIVERABLES .............................................................................................................. 129 5.1 Press statement ............................................................................................................................................. 129 5.2 Dispositions of Comments ............................................................................................................................ 129 5.3 Responses to Liaison and NB comments ..................................................................................................... 129 5.4 Recommendations for final plenary ............................................................................................................ 129 5.5 Establishment of Ad-hoc Groups ................................................................................................................ 129 5.6 Approval of output documents .................................................................................................................... 130 6 FUTURE ACTIVITIES ........................................................................................................................ 130 6.1 Schedule of future meetings ......................................................................................................................... 130 6.2 Agenda for next meeting .............................................................................................................................. 130 6.3 All other business .......................................................................................................................................... 130 6.4 Closing of the meeting .................................................................................................................................. 130 ANNEX A PARTICIPANTS................................................................................................................... 131 ANNEX B AGENDA AND SCHEDULE FOR THE 68TH MPEG AUDIO MEETING ............................ 132 ANNEX C TASK GROUPS ................................................................................................................... 138 ANNEX D OUTPUT DOCUMENTS ...................................................................................................... 140 ANNEX E AGENDA FOR THE 69TH MPEG AUDIO MEETING ........................................................... 142 117 Opening of the meeting The MPEG Audio Subgroup meeting was held during the 68th meeting of WG11, March 15-19, München, DE. The list of participants is given in Annex A. Administrative matters Approval of previous meeting report The 67th Audio Subgroup meeting report had been previously distributed by e-mail and was approved. Approval of agenda and allocation of contributions The agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in Annex B. Communications from the Chair The Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary. Joint meetings The joint meetings with Audio over the course of the week are listed here and are reported on below. Groups What Where Day Time Audio, Systems m10554 (Audio Pre-roll) Audio Tue 1000m10692 (Audio timestamps) 1200 m10558 (Audio Type) All m10627 (BIFS) MAF Req All M1530 (M3W) Req MDS, Audio, MPEG-7 Profiles Video Audio, Req M10629 (Req. for Conversation…) Requirements for Spatial Audio Coding, Requirements for Symbolic Music Representation Plen Audio Tue 12001300 Tue 14001430 Wed 11301300 Wed 14001430 Received National Body Comments and Liaison matters The NB Comments and Liaison documents for the meeting that require a response are as shown below. No. Title Response by SgNB Comment on the Collaborative Phase of the Audio Scalable Audio 10567 Lossless(SLS) Coding Work Item. Subgroup Task Groups Task groups were convened for the duration of the MPEG meeting, as shown in Annex C. Results of task group activities are reported below. 118 AhG meetings In order to obtain a compete view of the business of this MPEG meeting, discussion of contributions in AhG meetings are recorded in this section of the Audio report. MPEG-4 Extension 2, Parametric Audio Coding (Sunday 0900-1030) Werner Oomen reported that all aspects of the Extension 2 Final Verification Report (e.g. the open items in N6136), were now resolved. The only exception is to verify that FhG can provide AAC LC reference bitstreams. Audio Exploration (Sunday 1030-1300) Kristofer Kjörling, Coding Technology, presented 1069 3 Comments on Draft Call for Proposals on Spatial Audio Coding Heiko Purnhagen Kristofer Kjörling This proposed that the new work have two separate requirements: Best possible 5.1 presentation Best possible 5.1 presentation that in addition has a high-quality 1- or 2- channel presentation capability. There was a discussion on how to evaluate the stereo downmix. Both Kristofer Kjörling and Werner Oomen, Philips, felt that the stereo downmix should be evaluated as one item amongst a set of 5-channel items. Kristofer Kjörling observed that this technology could be very valuable in conjunction with HE AAC with a total bitrate that is quite low. Hence he recommended that such an operating point be tested in the course of developing the technology. On the other hand, Werner Oomen, Juergen Herre, FhG, and Christof Faller, Agere, agreed that Spatial Coding should be tested using very high coding bitrates. The Chair noted that use cases for the various operating points (tested in the course of developing the technology) need to be clearly stated in some output document. Kristofer Kjörling, Werner Oomen and Juergen Herre all agreed that the backwards-compatible part should be tested and should be taken into account in the course of selection of RM0 and subsequent CE work. Juergen Herre, FhG, presented 1071 3 Evaluation of Spatial Audio Coding Schemes: Performance Criteria and Test Methods Juergen Herre This contribution proposes the following Figures of Merit Performance of 5.1 channel presentation Performance of 2-channel presentation Rate of spatial side information The contribution proposed a number of additional requirements Same technology works for both 1-to-n and 2-to-n channel systems, where the point is that there should be only one technology for these two use cases. There was some discussion as to whether there needs to be both 1- and 2-channel backwards compatibility. Again, these use cases must be clarified and agreed upon. All agree that there should be a single unified architecture, although Werner Oomen and Heiko Purnhagen, Coding Technologies, proposed that the 1 or 2 transmitted channels (1- and 2-channel backwards compatibility) should not be constrained. Stereo backwards compatible – for evaluation purposes, may have common conditions such that the all proponents agree to use a single core codec. Highest possible compression – may wish to let each proponent optimize the core codec to best serve the needs of their technology. 119 The chair noted that we need to carefully specify what is tested and when: Selection of RM0 Evaluation of CE Final Verification of Technology The contribution proposes that The syntax should support all common loudspeaker arrangements. Werner Oomen, Philips, proposed that the technology should be able to encode for one loudspeaker configuration and decode to a different configuration. This could be proposed as an “additional functionality” in the CfP, however there was no discussion as to whether this functionality would be tested. The contribution proposes that The spatial coding technology should be able to be represented at different rates, e.g. responsive to the total bitrate flowing over the channel. The contribution proposes that The downmix be constrained during the course of RM0 selection and possible CE work. This has the benefit of simplifying the test load. Note that one might specify both the downmix module and the core audio codec in the RM0 selection phase. Presentation of the remainder of the contribution (dealing with subjective evaluation methodology for multi-channel signals and first results for a spatial audio coding based system) was deferred to the Audio subgroup meeting. In summary, the presented part of the contribution proposes that If ITU-R downmix is used, then only need to test multi-channel output signals. If encoder-based downmix is used, then need to test both 5.1 and downmix presentations for both 1- and 2- transmitted channels. Juergen Herre would like to see evidence that evaluating a stereo downmix within a 5.1 channel presentation gives meaningful information. The Chair noted that he would like to see this at the July MPEG meeting. Lossless Audio Coding (Sunday 1400-1700) SLS Ralf Geiger, FhG, presented 1071 0 Cross-Check Report for MPEG-4 SLS Core Experiment 2 (Improved Coding Efficiency) Ralf Geiger Markus Schmidt This verified the performance of SLS CE2, in terms of compression ratio, percent improvement in compression ratio and execution time. The CE showed 0.73 percent improvement in compression and 20% improvement in execution time. The cross-check agreed with the proponent report (I2R), so we take this as a verification of the CE. This concludes this CE2. Eunmi Oh, Samsung, presented 1064 1 Report on MPEG-4 SLS Core Experiment 3 (Context-dependent entropy coding) Eunmi Oh Jung-Hoe Kim Miao Lei SangWook Kim Samsung received the optimized RM2 code from I2R on February 6, 2004 and gave the CE3 result to I2R for cross-check on March 2, 2004. Relative to optimized RM2, the CE shows an improvement in compression ratio of 0.5%, and the decoder complexity of CE relative to RM2 is 200 words of tables 120 5%-9% increase in computational complexity. Rongshan Yu, I2R, presented 1068 1 Crosscheck for Samsung’s Proposal on Context-Dependent Entropy Coding for MPEG Audio SLS Rongshan Yu This verified the performance of SLS CE3, in terms of compression ratio, percent improvement in compression ratio and execution time. The CE showed approximately 0.5 percent improvement (depending on the context mode) in compression and 10% increase in execution time. The crosscheck agreed with the proponent report (Samsung), so we take this as a verification of the CE. The sense of the group was that this was a significant improvement in performance and that is should be accepted. However the Chair noted that there is another CE (CE4) that is available for evaluation at this meeting that appears to compete with CE3. Hence a decision on incorporating CE3 technology into the RM was postponed until after CE4 was presented. Rongshan Yu, I2R, presented 1068 3 Proposed Core Experiment for Improving Coding Efficiency of MPEG-4 Audio Scalable Coding (SLS) Rongshan Yu Xiao Lin Susanto Rahardja Haibin Huang Relative to optimized RM2, this CE shows an improvement in compression ratio of 0.8%, and the decoder complexity of CE relative to RM2 is 468 bytes of tables 8% increase in execution time. Discussion followed as to the differences between CE3 (Samsung), and CE4 (I2R). Schuyler Quackenbush, Audio Research Labs, presented 1072 0 Cross-check on I2R’s Proposed Core Experiment S. Quackenbush R. This verified the performance of SLS CE4, in terms of compression ratio, percent improvement in compression ratio and execution time. The CE showed 0.8 percent improvement in compression and 8% increase in execution time. The cross-check agreed with the proponent report (I2R), so we take this as a verification of the CE proposal. AhG recommends to Audio Subgroup that CE3 and CE4 are more alike than different, that context-dependent coding shows benefit in the SLS architecture and that the final decision be made in the Audio Subgroup. Tilman Liebchen, TUB, presented the AhG report, and the AhG members checked the details of the report. Audio plenary, joint meeting and task group activities Review of AHG reports There were no requests to review any of the AHG reports. Received national body comments and liaison matters The Chair presented 1056 7 SgNB Comment on the Collaborative Phase of the Audio Scalable Lossless(SLS) Coding Work Item. Singapore National Body Yuriy R, RN, commented that “complexity” has the dimensions of computation (i.e. MIPS), memory, programs space, documentation and implementation cost and time. In this respect, the compression/complexity trade-off is difficult. For example, a decrease in complexity that brings little or no increase in compression might still be very valuable. The Chair noted that as the specification progresses, the CEs tend to be less the type that adds new modules, and more the type that makes existing tools more efficient, and the latter tend to reduce complexity with little or no gain in compression. 121 A response was prepared later in the week, and can be found in the WG11 liaison response document. Audio plenary discussions New Test Material Paul Jessop, IFPI, gave a presentation on multi-channel test material. He notes that this is not limited to the MPEG community, and hence there may be quite a large community that would like a new archive of audio test material. This could be a DVD-R containing: Waveforms in WAV file format various recordings various recording formats incomplete tracks documentation on how the recording was made A licence for the material would be executed directly between IFPI and the company that will use the material. The material could then be used within the MPEG community and also for demonstration purposes at e.g. trade shows. The IFPI expects the material to be Mono, Stereo, Multichannel 5.1, Ambisonics B Various microphone methods, plus synthetic recordings (e.g. Structured Audio) Various formats 44.1, 48, 88.2, 96 and 192 kHz sampling rates, 16 and 24 bit word lengths. Some 5.1 channel signals may have a parallel track of stereo material that could be An independent manual mix An active or passive downmix (with documentation as to how it was done) Chair noted that this is urgently needed by the July. MPEG Audio experts are asked to recommend material that is appropriate for test use within our community. Paul Jessop noted that minor artists on major labels are most likely the easiest works to obtain. It would be very helpful if the audio experts could cite interesting material as a specific CD or DVD-A or SACD with track and segment. Paul Jessop, IFPI, can be contacted at Paul.jessop@ifpi.org Spatial Audio Coding Juergen Herre continued with his presentation on 1071 3 Evaluation of Spatial Audio Coding Schemes: Performance Criteria and Test Methods Juergen Herre He notes that the Audio Subgroup should choose a test methodology that is sufficient but also efficient. He notes that the MUSHRA methodology, that facilitates the direct comparison of systems under test, is particularly efficient and effective. He also notes that BS.1116-1 recommends the dynamic switching between Ref/A/B stimuli, although with a fade-out, 100ms silence and fade-in to enhance sensitivity to imaging alterations. An issue in any test is the choice of anchors. While MUSHRA mandates a low-pass filtered anchor, this contribution proposes that, in addition, some “matrixed” multi-channel representation (e.g. Dolby ProLogic II) be used as a low anchor and discrete multi-channel (e.g. MPEG AAC) be used as a high anchor. FhG has run a test using the MUSHRA methodology with a BS.1116-1 type dynamic switching and looping. The anchors were Dolby Prologic II (on PCM stereo channel) MPEG AAC LC at 320 kb/s While the system under test was 122 MP3 with Spatial Coding side information at 192 kb/s total rate Discussion: Gerhard Stoll, IRT, notes that MUSHRA is most appropriate for “intermediate quality” while BS.1116-1 is for “small impairments.” The chair noted that there are several phases in development of the technology: selection of RM0, subsequent CE work, and final verification test. In this respect, the modified MUSHRA might be fine for the RM0 and CE phases, while BS.1116-1 best for the verification test. Gerhard Stoll also noted that for the final verification test, it would be appropriate to gather new material and to do critical material selection. Juergen Herre proposed that for the RM0 selection phase, proponents could propose material for the selection test. Conclusions on this topic: MUSHRA with dynamic switching is appropriate for RM0 selection and subsequent CE work. BS.1116-1 may be appropriate for Final Verification Testing. Further remarks: Juergen Herre, FhG, remarked that RM0 should be selected such that audio coding distortion is minimal to none. Werner Oomen, Philips, has observed that there is interaction between the core audio codec and the Spatial Audio technology. Christof Faller remarked that we should be careful to eliminate any interaction between the distortion of the core codec and that of the spatial audio coding. Consensus from this discussion: There shall be one technology. Perhaps two use cases: A. Both high quality 5.1 and mono/stereo compatibility B. High quality 5.1, no mono/stereo compatibility Evaluation of use case A: Technology shall be tested at two operating points: Proponent downmix encoded by Reference AAC LC at 128 + X kb/s SI; 16<=X<=32 o AAC bitstr in one file, SI in another o No two-pass enc or per-item tuning 48 kb/s total; proponent reports side info avg rate. Where all rates are the average over the entire signal duration. The quality of the stereo/mono compatibility signal is important in both operating points RM0 selection criterion: best 5.1 presentation quality 128+X stereo presentation “no worse than the Downmix Reference” 48 stereo, if present, shall be downmixed to mono, and the mono presentation “no worse than the Downmix Reference” where “Downmix Reference” at 128+X kb/s is ITU-R 5.1 to stereo downmix which is then coded at 128 kb/s using the “reference MPEG-4 AAC LC coder” ITU-R 5.1 to mono downmix which is then coded at 24 kb/s using the “reference MPEG4 HE AAC coder” Final consensus: After subsequent discussion in task group and in Audio Plenary, the consensus of the Audio Subgroup was recorded in N6456, Draft Evaluation Procedures for Spatial Audio Coding. Joint Meetings 123 With Systems, Tue 1000-1200 Sam Narasimham, Motorola, presented 1055 8 USNB Issues Contribution: “Audio Type” A. G. USNB Tescher for This proposes changes to the table of Audio Types, specifically that “default” be changed to “main audio” and that a set of user private values be opened up. It was agreed to incorporate this into 13818-1/AMD 5. Dave Singer, Apple, presented 1055 4 Handling Audio Pre-roll in MPEG4 David Singer This proposal raises the issue of deterministic behavior of AAC codecs when encoding a segment of audio signal (as opposed to a stream of audio signal). The proposed solution is to associate additional information with the compressed audio data: Pre-roll as in AVC file format. An AMD is in progress to support this in the ISO file format. Edit list as in the ISO file format. The Audio Chair referred the group to Timestamp and Audio Codec Behavior (m10554/N6140). Dave Singer proposes that start-up behavior is the same as for streaming behavior (i.e. give an AU, get a CU), and confirmed that both of the following are “per track” in the MPEG-4 file: Pre-roll in frames frames prior to first output frame (see AVC file format, “roll-group”) Edit list in samples samples prior to first output sample (see ISO FF 14496-12, “edit list”) He further noted that Audio may have to make encoder and decoder start-up and shut-down behavior normative (e.g. that an AAC decoders cannot “drop Composition Units” on startup). Heiko Purnhagen, Coding Technologies, presented 1069 2 Information timestamps on HE-AAC decoder delay and Heiko Purnhagen Kristofer Kjörling The issue raised by this proposal is that a given bitstream may be decodable by more than one decoder (e.g. HE-AAC with an AAC decoder and a HE-AAC decoder), and this affects the decoder delay. The chair noted that one solution is to have identical delay without regard to which decoder is used. However this is only valid for decoders that are aware of both decoding options, i.e. it is not a solution for the case of legacy decoders. There was consensus that Audio will take the following actions at this meeting: Initiate a Corrigendum that specifies That timestamp is associated with the first sample of the CU derived from the AU. That decoders shall have normative behavior at start-up and shut-down (e.g. never discard output blocks). Revise 6140 to show how pre-roll and edit list parameters can be used to achieve deterministic behavior in the case of encode to file and decode from file. And that the following are topics for further study Audio will study how to specify deterministic behavior in the case that a single bitstream can be decoded with more than one decoder with more than one decoding delay. 124 Jeongil Seo, ETRI, presented 1062 7 CE Report on AdvancedAcousticScene node for MPEG-4 Audio BIFS version 3 Jeongil Seo Jerome Daniel This CE presented preliminary listening tests, but need a more extensive listening test. It is not clear if the measured implulse response gives significant added value to BIFS. It was concluded that the action for this week: is to determine if this capability is already supported within BIFS. Later in the week it was confirmed that virtually all if not all of the desired capability of this proposal could be met with existing BIFS technology. Hence this CE was withdrawn. 14.1.4 Joint meeting with All on MAF, Tue 1200-1300 Wo Chang, NIST, presented 10536 Multimedia Application Format (MAF) Overview Document Wo Chang MAF under development 3on4 (from Audio) Jon4 3GPP Requirements MAF shall provide a simple solution for the identified application MAF shall be build on existing MPEG specification, and not write new specification These are normative specifications, should be constricted without regard to existing profiles, and may become a profile themselves. Currently, they should consider only static metadata. An overview will present common requirements. With All on M3W, Tue 1400-1430 Jean, Philips, presented 1053 0 MPEG Multimedia Middleware: Context and Objective (Update) Jean Gelissen The Audio Chair attended this meeting. The work is in its preliminary stages, and should continue to be monitored. With MDS, Video on MPEG-7, Wed 1130-1300 Audio did not attend this meeting. With Requirements, Wed 1400-1430 The Requirements Chair reviewed the requirements for CfP for Spatial Audio and Draft CfP for Symbolic Music Representation. Requirements made valuable comments, which were incorporated into the two documents. Kate Grant, Nine Tiles, presented 1062 9 Requirements for conversion descriptions in a live radio broadcasting environment Kate Grant See 9390 from Pattaya for details of Audio Management Information Base (MIB). Task Group discussions MPEG-2 Layer III Bernhard Grill, FhG, presented the listening test results associated with contribution m10617. He reported that the 96 kHz MP3 yielded much better performance for transient signals, e.g. Castanets, and that if one changed the scale factor band structure, to maintain the same degree of resolution for 96 kHz as is found for 48 kHz, then the proposal has improved performance for densely tonal items. A listening test in the document showed that the mean performance of the 125 proposed 96 kHz MP3 system at 96 kHz was better than that of the 48 kHz MP3 system at 96 kHz. Werner Oomen, Philips, remarked that if 96 kHz operation is standardized, then decoders in the marketplace will have to support it. That would place a factor of 2 computational burden on decoder platforms, and would most likely mean that manufacturers would have to move to a new platform. It was decided to accept the “MPEG 2.5” 8 kHz mode and incorporate it into the amendment, while moving the 96 kHz mode text into a “Proposed High Sampling Rate for MP3” output document and ask for National Body comments on the proposal. MPEG-2/4 Audio Eunmi Oh, Samsung, presented 1064 2 MPEG-4 issues BSAC related Eunmi Oh Miyoung Kim SangWook Kim This contribution proposed a method to extend BSAC syntax and semantics to support multichannel signals. Samsung advises that there is only 1- and 2-channel BSAC equipment in the field, so that proposed changes will not affect backward compatibility to legacy equipment. There is a Digital Multimedia Broadcast project in Korea, and it is proposed that this use multi-channel BSAC. Samsung reported that the proposed changes are necessary to support BSAC within this project. Audio experts will review the proposal and consider e.g. the need to expand BSAC to multichannel as opposed to using existing MPEG multi-channel technology. A decision on whether to proceed with an amendment will be made later in the week. In discussions on Thursday it was clarified that, currently, BSAC can only use M/S coding for stereo presentations. The new aspects of the proposal is to Make M/S coding available for e.g. 5-channel presentations using BSAC Support bitrate scalability on a per-channel basis. Bernhard Grill, FhG, Heiko Purnhagen, Coding Technologies and Gerhard Stoll, IRT, all commented that “channel dropping” as a method of scalability would not be acceptable to most customers. The consensus of Audio Subgroup was to Take no action at this meeting. Produce a “Proposed Enhancements to BSAC” output document Ask Samsung to bring to the next MPEG meeting o Clear goals supported by proposed changes. o Clear evidence that proposed goals lead to enhanced performance. Ralph Sperschneider, FhG, presented 1070 1 Proposed addition to ISO/IEC 144963:2001/Cor.2 Ralph Sperschneider This proposes many extensions to the syntax of LATM, however it may be that it supports some combinations that may not be valuable in industry. Bernhard Grill, FhG and Heiko Purnhagen, Coding Technologies, remarked that perhaps this should not be incorporated into LATM, but rather that users should be advised that such combinations would not work within the LATM structure Kristofer Kjörling, Coding Technologies, presented these little changes: 1068 0 Proposed corrections and additions to the present ISO/IEC 144964:2001/AMD1:2003/Dcor1. Kristofer Kjörling The Chair confirmed that all proposed corrections are in response to ballot comments. The consensus of the Audio Subgroup is to add these proposals to the COR. Kristofer Kjörling, Coding Technologies, presented 126 1067 8 Proposed additions to the ISO/IEC 13818-4:200X/PDAM2 (Audio Conformance) document in order to specify SBR conformance for MPEG-2. Kristofer Kjörling The Audio Subgroup accepted this proposal, and it will be incorporated into the amendment. Kristofer Kjörling, Coding Technologies presented 1067 9 Kristofer Kjörling Andreas Schneider Additions to, and clarifications of MPEG-4 SBR conformance. These are primarily editorial changes that make the conformance specification easier to understand and use. In addition, there is the technical change that additional diagnostic bitstreams are added to the suite of conformance data. The consensus of the Audio Subgroup was to accept the proposal. Heiko Purnhagen, Coding Technologies, presented 1069 4 Proposed clarifications of AAC conformance testing Heiko Purnhagen Martin Wolters This proposed that the PCM conformance error criterion be clarified to be more in line with the concept used in MPEG-1, which is that the decoder output is measured before quantization, i.e. as an “integer and factional” format rather than just the integer part. The consensus of the Audio Subgroup was to accept the proposal. Ralph Sperschneider, FhG, presented 10700 Status on MPEG-4 Audio Conformance Ralph Sperschneider The table of cross-check commitments was revised to incorporate new companies that we expect to be more responsive. Werner Oomen, Philips, presented a Workplan for the Final Verification Test of MPEG-4 Parameteric Coding. All open issues from the previous meeting are addressed: FhG will provide reference quality AAC bitstreams and IRT will perform the listening test and write the associated report. MPEG-4 Lossless Audio Coding SLS The presentation and discussion of contributions that began in Sunday’s AHG meeting was continued later in the week. Based on compression performance, the Audio subgroup agreed to incorporate CE4 (I2R) into RM2. The workplan will reflect the integration of this technology into the RM and WD. Ralf Geiger, FhG, presented 1071 1 Proposed Core Experiment on MPEG-4 SLS Ralf Geiger Markus Schmidt Jürgen Herre This proposes three techniques for improved performance: Oversampling of intIMDCT with respect to the AAC core (by 2 or 4). Integrated M/S coding Noise shaping, such that noise power is emphasized in the low frequency region and deemphasized in the high-frequency region. Greatest improvement is realized in the high sampling rates: Parameters Improvement Fs Wd Oversampling Oversampling M/S Noise Shaping 48 16 1 0.20 0.29 96 24 2 1.99 2.33 2.73 192 24 4 3.55 3.77 4.54 Audio subgroup approved this CE proposal, and expects a cross-check of the proposal at the next meeting. 127 Rongshan Yu, I2R, presented 1068 2 Proposed WD2 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS) Rongshan Yu Xiao Lin Susanto Rahardja Haibin Huang This is the WD text that integrates CE2, improved coding efficiency for SLS (via “low energy” coding). The integrated CE2 software was put on the FTP site, so all aspects of this CE are complete. Fang-Chu Chen, ITRI, presented 1066 4 bit reordering in SLS enhancement layer Fang-Chu Chiu Chen, Te-ming This presentation was informative only. For the benefit of the submitter, the Chair reviewed the Core Experiment process. ALS Takehiro Moriya, NTT, presented 1057 8 Proposed draft for WD 3 of ISO/IEC 14496-3:2001/AMD 4, Audio Lossless Coding (ALS) Takehiro Moriya Tilman Liebchen, TUB, presented 1060 6 Verification Report on MPEG-4 ALS Core Experiment 3 (Coding of Audio in Floating-Point Format) Tilman Liebchen Patrick Runge Tilman feels that this proposal does not deliver the best performance possible, due to its using a 16 (rather than a 24-bit) core coder. As an additional point, he suggested that the changes to the RM that occurred as part of the floating-point implementation could be done in a better manner. For example, there is redundancy in the code that could be removed and there are modules that may be more complex than are necessary. This was discussed later in the week, at which time NTT presented more carefully structured RM code, which was acceptable to all parties. It was concluded that this CE advanced based on this new code. Tilman Liebchen, TUB, presented 1060 7 Proposed Core Experiment for Improved Coding of Random Access Frames in MPEG-4 ALS Tilman Liebchen Takehiro Moriya This proposed improved performance for encoding segments immediately following random access. This proposal comes at no cost in computation complexity, but does give an improvement in compression. The Chair noted that this proposal is exactly the case in which an evaluation of performance/complexity trade-off must be made. The consensus of the Audio Subgroup is to accept this CE proposal since it has nearly zero increase in complexity but does yield a moderate increase in compression, especially as the interval at which random access is possible approaches a single accessUnit. Yuriy Reznik, RealNetworks, presented 1063 8 Proposed CE on Coding of LPC Coefficients in MPEG-4 ALS Yuriy Reznik This proposes to use entropy coding to compress the predictor coefficients. While the LPC information was compressed by from 30% to 50%, overall compression increase was approximately 0.19%. There was discussion as to whether both this CE proposal and also the TUB CE proposal are compelling in light of their low complexity and simple integration into the ALS architecture. Consensus of the Audio Subgroup was to accept both of these CEs, and to ask for a cross-check at the next MPEG meeting. 128 MPEG-7 Audio Benoit Meudic, IRCAM, presented 1056 8 Proposed MPEG 7 audio tools Jerome Barthelemy Benoit Meudic Marc Texier This proposes descriptors to categorize instruments into one or more families (e.g. pipe organ could be in both the keyboard and wind instrument families). Holger Crysandt, Aachen Univ, presented 1061 4 Cross check results of the Audio Pattern Description Schema Holger Crysandt This cross-check gives identical results as are in the CE proposal. There was some discussion as to whether the cross-check provided sufficient evidence of the utility or viability of the descriptor. Holger also presented the results of a preliminary implementation of a music player that uses MPEG-7 metadata. The meta data was temporal, and segmented the song into “phrases” (e.g. intro, chorus, verse 1, etc.). The consensus of the Audio Subgroup was to that an additional cross-check be presented at the next MPEG meeting that clarifies the utility of this descriptor. Spatial Audio Coding Symbolic Music Representation Paolo Nesi, University of Florence, presented 1065 4 Music Notation Technical Requirements and Integration in MPEG4 Paolo Nesi Pierfrancesco Bellini Giorgio Zoia Jerome Barthelemy This document was reviewed, especially the informative annex (documents m10622 and m10661 were reviewed during the AHG meeting – see m10466, the AHG report for a very complete record of that meeting). Agreement was reached on some open issues, like possible visual and audio rendering, and authoring/end user scenarios. From this consolidated document, the draft Call for Proposals was produced as an output for this meeting. Meeting deliverables Press statement The Audio part of the press statement was prepared and reviewed. Dispositions of Comments All DoC were prepared and reviewed. Responses to Liaison and NB comments There were no liaison responses. The response to the SnG NB was prepared and approved. Recommendations for final plenary The Audio recommendations were presented and approved. Establishment of Ad-hoc Groups The following ad-hoc groups were established by the Audio subgroup: 129 No. 6458 6459 6460 Title AHG on Spatial Audio Coding AHG on MPEG-4 Lossless Audio Coding AHG on Symbolic Music Representation Mtg Yes Yes Yes Approval of output documents All output documents, shown in Annex D, were presented in Audio plenary and were approved. Future activities Schedule of future meetings Ad Hoc group meetings are indicated in Section 0. Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting. Agenda for next meeting The agenda for the next MPEG meeting is shown in Annex E. All other business There was none. Closing of the meeting The 65th Audio Subgroup meeting was adjourned at 13:45. 130 Annex A Participants First Name Alexandre Last Name Cotarmanac’h Country FR Pierfrancesco Kok Seng Holger Jerome Bellini Chong Crysandt Daniel I SG DE FR Bernd Edler DE Christof Faller CH Bernhard Feiten DE Ralf Bernhard Matthias Jürgen Johannes Sang-Wook Kristofer Geiger Grill Gruhne Herre Boehm Kim Kjörling DE DE DE DE CE KR S Tilman Adam Liebchen Lindsay DE UK Benoit Takehiro Sua Hong Paolo Kia Toshiyuki Eunmi Werner Vincent Heiko Meudic Moriya Neo Nesi Ng Nomura Oh Oomen Puig Purnhagen FR JP SG I UK JP KR NL FR S Schuyler Susanto Jean Bernard Quackenbush Rahardja Rault USA SG FR Yuriy Andreas Reznik Schneider USA DE Jeongil Ralph Jacques Seo Sperschneider Steyn KR DE ZA Hervé Naoya Mark David Taddei Tanaka Vinton Virette DE JP USA FR Lin Rongshan Giorgio Xiao Yu Zoia SG SG CH Affiliation France Telecom R&D UNI Firenze Panasonic Aachen Univ. France Telecom R&D University of Hannover EPFL Lausanne Deutsche Telekom FhG IIS IDMT FhG IIS FhG IIS IDMT FhG IIS Thomson Samsung Coding Technologies TU Berlin Lancaster University IRCAM NTT Panasonic UNI Firenze UL NEC Samsung Philips IRCAM Coding Technologies ARL I2R France Telecom R&D RealNetworks Coding Technologies ETRI FhG IIS Monash University Siemens AG Panasonic Dolby France Telecom R&D I2R I2R EPFL E-mail address alexandre.cotarmanach@francetelecom.com pbellini@dsi.unifi.it kschong@psl.com.sg crysandt@ient.rwth-aachen.de jerome.daniel@francetelecom.com edler@tnt.uni-hannover.de cfaller@agere.com bernhard.feiten@t-systems.com ggr@idmt.fraunhofer.de grill@iis.fraunhofer.de ghe@idmt.iis.fraunhofer.de hrr@iis.fraunhofer.de Johannes.Boehm@Thomson.net swkim@samsungait.com kk@codingtechnologies.com liebchen@nue.tu-berlin.de atl@comp.lancs.ac.uk meudic@ircam.fr moriya.takehiro@lab.ntt.co.jp shneo@psl.com.sg nesi@dsi.unifi.it kia@computer.org t-nomura@da.jp.nec.com sait@samsung.com werner.oomen@philips.com puig@ircam.fr hp@codingtechnologies.com srq@audioresearchlabs.com rsusanto@i2r.a-star.edu.sg jeanbernard.rault@francetelecom.com yreznik@real.com snd@codingtechnologies.com seoji@etri.re.kr ralph.sperschneider@iis.fraunhofer.de jacques.steyn@infotech.monash.edu Herve.taddei@siemens.com tanaka.naoya@jp.panasonic.com msv@dolby.com david.virette@francetelecom.com linxiao@i2r.a-star.edu.sg rsyu@i2r.a-star.edu.sg giorgio.zoia@epfl.ch Annex B Agenda and Schedule for the 68th MPEG Audio Meeting Time Agenda Item Number Title Sunday 0900-1030 1030-1300 1400-1700 10641 10681 10683 10710 10720 Monday 0900-1330 1330-1430 1430-1800 Source MPEG2/4 N1095 AHG on MPEG-4 BWE and Parametric Coding Discuss verification test (N6136) AHG on MPEG-4 Audio Exploration Objectives and evaluation methods AHG on Lossless Coding SLS Report on MPEG-4 SLS Core Experiment 3 (Context-dependent entropy coding) Crosscheck for Samsung’s Proposal on Context-Dependent Entropy Coding for MPEG Audio SLS Proposed Core Experiment for Improving Coding Efficiency of MPEG-4 Audio Scalable Coding (SLS) Cross-Check Report for MPEG-4 SLS Core Experiment 2 (Improved Coding Efficiency) Cross-check on I2R’s Proposed Core Experiment Eunmi Oh Jung-Hoe Kim Miao Lei SangWook Kim X Rongshan Yu X Rongshan Yu Xiao Lin Susanto Rahardja Haibin Huang X Ralf Geiger Markus Schmidt X S. R. Quackenbush X MPEG Plenary Lunch Audio Plenary Audio Chair Opening of the meeting 10715 10460 Administrative matters Approval of agenda Approval of 67th MPEG meeting report Audio Subgroup Report for the 67th MPEG Meeting Communications from the Chair - Review of Sun Chairs meeting Allocation of contributions to agenda and schedule Joint meetings Review of AhG reports AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4 S. R. Quackenbush X Jens Spille X MPEG-7 N0116 Time Agenda Item Number Title Report of the AHG on MPEG-4 Audio Conformance Report of the AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software AHG on MPEG-4 Audio Extensions 1 and 2 AHG on MPEG-4 Audio Lossless Coding AHG on MPEG-7 Audio AHG on Music Notation Requirements AHG on Timestamps and Audio Codec Behavior AHG on Audio Explorations 10461 10462 10463 10464 10465 10466 10467 10468 10567 10508 Task groups and mandates National body comments SgNB Comment on the Collaborative Phase of the Audio Scalable Lossless(SLS) Coding Work Item. Liaison Liaison Statement from ITU-T SG 16 on Audio Information [SC 29 N 5813] Source MPEG2/4 N1095 Ralph Sperschneider X Ralph Sperschneider Heiko Purnhagen X W. Oomen X Tilman Liebchen X Matthias Gruhne Paolo Nesi Giorgio Zoia X Schuyler Quackenbush X Schuyler Quackenbush X Singapore National Body X ITU-T SG 16 via SC 29 Secretariat X (no response needed) Summary of Voting on ISO/IEC 144963:2001/Amd.1:2003/DCOR 1 [SC 29 N 5843] Summary of Voting on ISO/IEC 138187:2003/DCOR 1 [SC 29 N 5844] Summary of Voting on ISO/IEC 144963:2001/DCOR 2 [SC 29 N 5845] Summary of Voting on ISO/IEC 138181:2000/PDAM 5 Late Vote on ISO/IEC 144963:2001/Amd.1:2003/DCOR 1 [SC 29 N 5849] Late Vote on ISO/IEC 13818-7:2003/DCOR 1 [SC 29 N 5851] Late Vote on ISO/IEC 14496-3:2001/DCOR 2 [SC 29 N 5852] X X Ballot Comments 10540 10541 SC 29 Secretariat SC 29 Secretariat 10542 SC 29 Secretariat 10544 SC 29 Secretariat 10601 SC 29 Secretariat 10602 SC 29 Secretariat 10603 SC 29 Secretariat 1600-1730 10693 Plenary discussions Exploration Comments on Draft Call for Proposals on Spatial Audio Coding Heiko Purnhagen Kristofer Kjörling 133 X X X X X X X MPEG-7 N0116 Time Agenda Item Number Title Evaluation of Spatial Audio Coding Schemes: Performance Criteria and Test Methods 10713 1800- Tuesday 0900 Audio Plenary Outline plan for the day Symbolic Music Representation 0900-1100 SLS 10711 Proposed Core Experiment on MPEG-4 SLS 10554 10692 10558 10627 1200-1300 10536 Joint Meeting with Audio, Systems Handling Audio Pre-roll in MPEG4 Information on HE-AAC decoder delay and timestamps USNB Contribution: “Audio Type” Issues CE Report on AdvancedAcousticScene node for MPEG-4 Audio BIFS version 3 Joint Meeting: Multimedia Application Format Multimedia Application Format (MAF) Overview Document 1300-1400 Lunch 1400-1430 Joint Meeting: Multimedia Middleware (m1530) MPEG Multimedia Middleware: Context and Objective (Update) 10530 1430-1630 10682 10664 10578 10606 Juergen Herre X MPEG-7 N0116 HOD Meeting 0900-1100 1000-1200 Source MPEG2/4 N1095 Audio Chair B/O Ralf Geiger Markus Schmidt Jürgen Herre David Singer Heiko Purnhagen Kristofer Kjörling A. G. Tescher for USNB Jeongil Seo Jerome Daniel X Audio X X X X Sys Wo Chang X Sys Jean Gelissen X Rongshan Yu Xiao Lin Susanto Rahardja Haibin Huang X chen te-ming chiu X Takehiro Moriya X Tilman Liebchen Patrick Runge X MPEG-4 ALS, SLS SLS Proposed WD2 of ISO/IEC 144963:2001/AMD 5, Audio Scalable Lossless Coding (SLS) bit reordering in SLS enhancement layer ALS Proposed draft for WD 3 of ISO/IEC 14496-3:2001/AMD 4, Audio Lossless Coding (ALS) Verification Report on MPEG-4 ALS Core Experiment 3 (Coding of Audio in Floating-Point Format) 134 Time Agenda Item Number Title Comments on MPEG-4 ALS CE3 reference software Comments on Lossless Coding of Audio in Floating-Point Format 10637 10721 1630-1730 10622 Symbolic Music Representation A New Application Scenario for Music Notation in MPEG 10654 Music Notation Technical Requirements and Integration in MPEG-4 10661 Proceedings of AHG on Music Notation Requirements 1730-1800 MPEG-2 Layer III 10617 1800-1830 1800-1900 1900- Wednesday 0900-1100 1100-1130 MPEG-1/2 Audio Layer 3 For Low And High Sampling Rates Source MPEG2/4 N1095 Yuriy Reznik X Takhiro Moriya X Giorgio Zoia James Ingram Paolo Nesi Pierfrancesco Bellini Giorgio Zoia Jerome Barthelemy Paolo Nesi Pierfrancesco Bellini Giorgio Zoia Jerome Barthelemy Bernhard Grill Johannes Hilpert Manfred Lutzky Martin Weishart Ernst F. Schroeder Audio Plenary Status for Chairs Meeting Liaison Meeting Chairs Meeting MPEG Plenary Audio Plenary Report on Chairs meeting and outline of plan for the day X X X X 0938 Audio Chair 1130-1230 Joint meeting on MPEG-7 profiles and MAF 1130-1300 MPEG-4 Audio 10642 MPEG-4 BSAC related issues Eunmi Oh Miyoung Kim SangWook Kim X 10701 Proposed addition to ISO/IEC 14496-3:2001/Cor.2 Ralph Sperschneider X 1300-1400 Lunch 1400-1430 Joint Meeting with Audio, Req 10629 1430-1530 Requirements for conversion descriptions in a live radio broadcasting environment Review of Spatal Audio, Symbolic Music Representation Requirements Plenary Audio Kate Grant X X MP3+Spatial Audio demonstrations X 135 MPEG-7 N0116 Time Agenda Item Number Title 1530-1630 MPEG-7 10568 Proposed MPEG 7 audio tools 10614 1700-1800 10678 10679 10680 10694 1800-1830 10607 10638 1900-2200 Cross check results of the Audio Pattern Description Schema Information on and demonstration of expression of ID3V1 as MPEG-7 metadata MPEG-4 Audio Proposed additions to the ISO/IEC 13818-4:200X/PDAM2 (Audio Conformance) document in order to specify SBR conformance for MPEG-2. Additions to, and clarifications of MPEG-4 SBR conformance. Proposed corrections and additions to the present ISO/IEC 144964:2001/AMD1:2003/Dcor1. Proposed clarifications of AAC conformance testing ALS Proposed Core Experiment for Improved Coding of Random Access Frames in MPEG-4 ALS Proposed CE on Coding of LPC Coefficients in MPEG-4 ALS Source Jerome Barthelemy Benoit Meudic Marc Texier Holger Crysandt MPEG2/4 N1095 X X X Holger Crysandt Kristofer Kjörling X Kristofer Kjörling Andreas Schneider X Kristofer Kjörling X Heiko Purnhagen Martin Wolters X Tilman Liebchen Takehiro Moriya Yuriy Reznik X X Social Thursday 10700 10617 1300-1400 Status on MPEG-4 Audio Conformance Presentation of listening test ALS LPC CE BSAC multi-channel proposal Parametric Coding Verif. Report SnG NB Comment response Revise Timestamps document Revise Audio Player MAF Ralph Sperschneider Lunch CfP for Spatial Audio Draft Evaluation Doc Draft CFP for SMR 1830-1900 1900- Audio Plenary Review list of deliverables Review list of AHGs Status for Chairs Meeting Chairs Meeting Audio Chair 0938 136 MPEG-7 N0116 Time Agenda Item Number Friday 0830-0900 Title 0900-1300 Audio Plenary Report on Chairs meeting and outline of plan for the day Discussion of unallocated contributions Meeting deliverables Press statement Dispositions of comments Responses to NB comments Liaison statements Recommendations for final plenary Establishment of new Ad-hoc groups Approval of output documents Future activities Agenda for next meeting A.O.B. Closing of the Audio meeting Source Requirements Approval of Spatial Audio and SMR 1300-1400 Lunch 1400- MPEG Plenary Audio Chair 137 MPEG2/4 N1095 MPEG-7 N0116 Annex C Task Groups Main tasks for the week: Document progression (see table below) Spatial Audio CfP Draft Symbolic Music Representation CfP Progress SLS CEs Verification Test of Parametric Stereo Progress o MPEG Music Player Application Format o Timestamps and Audio Codec Behavior 1. MPEG-2 Layer III Schuyler Quackenbush 1.1. Review contributions 1.2. Prepare and give to Jean-Claude DuFourd ISO/IEC 13818-4:200X/AMD 2:2000x, Audio Conformance Extensions 1.3. Prepare Study on ISO/IEC 14496-3:2001/FPDAM 3 1.4. Revised MPEG Music Player Application Format 2. MPEG-2 AAC Ralph Sperschneider 2.1. Review contributions 2.2. ISO/IEC 13818-7:2003/COR 1:2004 3. MPEG-4 Audio Kristofer Kjörling (BWE) Ralph Sperschneider (-4 –5) Schuyler Quackenbush (Other) 3.1. Review contributions 3.2. ISO/IEC 14496-3:2001/COR 2 3.3. ISO/IEC 14496-3:2001/AMD 1:2003/COR 1:2004 3.4. Workplan for Verification Test of MPEG-4 Parametric Coding 3.5. Assist in preparing DoC for ISO/IEC 13818-1:200X/AMD 5 (coordinate with Olivier) 3.6. Prepare and give to Jean-Claude DuFourd ISO/IEC 14496-4:2001/AMD 8 3.7. Prepare Study on ISO/IEC 14496-11:200X/PDAM 3 4. MPEG-4 Lossless Coding Tillman Liebchen (ALS) and Ralph Geiger (SLS) 4.1. Review contributions 4.2. 1-bit lossless Request for Amendment and WD or CD text 5. MPEG-4 Explorations Schuyler Quackenbush 5.1. Review contributions 5.2. Call for Proposals on Spatial Audio Coding 5.3. Draft Evaluation Procedures 6. Symbolic Music Representation Paolo Nesi and Giorgio Zoia 6.1. Review contributions 6.2. Draft CfP 7. MPEG-7 Matthias Gruhne 7.1. Review contributions 7.2. Revise Status of Conformance and Reference Software Audio Standards Under Development DCOR Name 13818-4:200X/AMD 2:2000x Description Audio Conformance Extensions (new bitstreams for 138 COR WD WD CD PDAM FCD FPDAM FDIS FDAM 62 67 68 70 13818-5:1997/COR 2:2004 13818-7:2003/COR 1:200x 14496-3:2001/COR 2 14496-3:2001/AMD 1:2003/COR 1:200x 14496-4:2001/AMD 8 Audio LIII) AAC AAC 66 66 BWE SBR, Audio BIFS and SA 139 68 68 68 68 66 67 68 70 Annex D Output Documents The Audio Subgroup produced the following output documents. Those approved for public release are indicated by the entry “Yes” in column TBP (to be public). Prepare for Systems DoC of ISO/IEC 13818-1:2001/PDAM 5, Text of ISO/IEC 13818-1:2001/FPDAM 5 Prepare for Integration DoC on ISO/IEC 13818-4:200X/PDAM 2:2000x Text of ISO/IEC 13818-4:200X/FPDAM 2:2000x, Audio Conf. Exten. LIII and SBR DoC on ISO/IEC 14496-4:2001/PDAM 8 Text of ISO/IEC 14496-4:2001/FPDAM 8, HE-AAC, Audio BIFS and SA Audio Documents Number Title TBP Avail. 6426 DoC on ISO/IEC 13818-7:2003/DCOR 1:2004, AAC 6427 Text of ISO/IEC 13818-7:2003/COR 1:2004, AAC 6428 Text of ISO/IEC 13818-7:2004, AAC Third Edition 04/04/16 6429 DoC on ISO/IEC 14496-3:2001/DCOR 2 6430 Text of ISO/IEC 14496-3:2001/COR 2, Misc. Corrections 04/04/16 6431 DoC on ISO/IEC 14496-3:2001/AMD 1:2003/DCOR 1:2004 Text of ISO/IEC 14496-3:2001/AMD 1:2003/COR 1:2004, 04/03/26 6432 Bandwidth Extension 6433 Study on ISO/IEC 14496-3:2001/FPDAM 3, MP3 on MP4 04/04/16 Request for Amendment: ISO/IEC 14496-3:2001/AMD 4, 6434 Audio Lossless Coding 6435 WD3 of Audio Lossless Coding Request for Amendment: ISO/IEC 14496-3:2001/AMD 5, 6436 Scalable Lossless Coding 6437 WD2 of Scalable Lossless Coding Request for Amendment: ISO/IEC 14496-3:2001/AMD 6, 6438 Lossless Coding of Oversampled Audio ISO/IEC 14496-3:2001/PDAM 6, Lossless Coding of 04/04/09 6439 Oversampled Audio Request for Amendment: ISO/IEC 15938-4:2002/AMD 2, 6440 High-level Descriptors 6441 WD 1 of MPEG-7, High-level Descriptors Request for New Work Item: MPEG-A Part 1, Music Player 6442 Application Format 6443 Text of MPEG-A Part 1, Music Player Application Format Yes 6444 Proposed High-Sampling Rate for MPEG-2 Layer III 04/04/16 6445 Proposed Enhancements to MPEG-4 BSAC multi-channel Workplan for Verification Test of MPEG-4 Parametric Audio 6446 Coding 6447 Workplan for Audio Lossless Coding (ALS) 6448 Workplan for Scalable Lossless Coding (SLS) 6449 Timestamps and Audio Codec Behavior 04/04/16 Workplan for Audio Contribution to MPEG-4 Conf. 6450 Bandwidth Extension 140 6451 6452 6453 6454 6455 6456 6457 Status of MPEG-4 Audio Conformance Status of MPEG-7 Audio Contribution to XM and Conformance Workplan for Audio Rhythmic Pattern CE Workplan for Instrumentation and Weighted Scale Type CE Call for Proposals on Spatial Audio Coding Yes Draft Evaluation Procedures for Spatial Audio Coding Yes Draft Call for Proposals for Symbolic Music Representation 141 Annex E Agenda for the 69th MPEG Audio Meeting Agenda Item 1. Opening of the meeting 2. Administrative matters 2.1. Approval of agenda 2.2. Approval of 68th meeting report 2.3. Communications from the Chair 2.4. Allocation of contributions 2.5. Joint meetings 2.6. Review of AhG reports 2.7. Review of task groups and mandates 2.8. Received national body comments and liaison matters 2.9. Plenary issues 3. Task group activities 3.1. MPEG Maintenance 3.2. MPEG-1 Access Units and Music Player Application Format 3.3. MPEG-4 Parametric Coding 3.4. MPEG-4 Lossless Coding 3.5. MPEG-4 BIFS 3.6. MPEG-7 Audio 3.7. Spatial Audio Coding 3.8. Music Notation 4. Discussion of unallocated contributions 5. Meeting deliverables 5.1. Press statement 5.2. Dispositions of comments 5.3. Responses to NB comments 5.4. Responses to Liaison statements 5.5. Recommendations for final plenary 5.6. Establishment of new Ad-hoc groups 5.7. Approval of output documents 6. Future activities 6.1. Agenda for next meeting 7. A.O.B. 8. Closing of the meeting 142 143 Annex 10 Report of SNHC meeting Source: Mikaël Bourges-Sévenier (Mindego Inc.) Opening of the Meeting Approval of the agenda Goals for the week The goals of this week are: Review the on-going core experiments Review answers of CfP Graphics API Finalize profiles and review supporting materials Finalize AFX conformance and reference software Review technologies ready for AFX/AMD1 Review physical models proposals 144 Schedule Time 08 09 10 11 12 13 14 15 16 17 18 19 20 21 22 Monday :00 :30 :00 :30 :00 :30 :00 :30 :00 :30 :00 :30 :00 :30 :00 :30 :00 :30 :00 :30 :00 :30 :00 :30 :00 :30 :00 :30 :00 :30 Tuesday Wednesday 10519 - CE Shadow MPEG Plenary 10704, 10733, 10696 - Discussion AFX profiles MPEG Plenary 10571 - XMT-A PointTexture 10593 - AFX encoder usage Thursday Friday Player3D secrets… Document review Presentation review Document number attribution … last items... Graphics API discussion 10582, 10583 - Water, Cloth, Player3D secrets / Graphics API discussion simulations 10647 - Answer to CfP Graphics API Lunch break Lunch break Roll call, agenda FAQ, web site, ref sw, conf. 10730 - BBA extensibility 10655 - MorphShape 10656 - BBA update for morphing 10707 - EE results on 3D model based movie streaming Lunch break Lunch break 10570 - PointTexture compression 10571 - XMT-A for PointTexture Output document review 10691 - CE multi-texturing Quaternions in BBA Graphics API discussion AFX encoder 10704, 10733, 10696 MPEG-4 profiles 10690 - Camera calibration 10579 - CE Point-based rendering Lunch break 10704 Compressed 3D profile Part1/AMDx/COR1 review 10719 - mass-spring models Part11: add Physics model discussion AFX/AMD1 review Liaison Liaison Social event Chairs Chairs 145 MPEG Plenary Allocation of joint meetings Sub-Groups Systems Monday Requirements Tuesday Wednesday Thursday 15:00-16:00 AFX encoder 16:00-17:00 Part 1/COR1 review 15:30-16:30 with Systems MPEG-4 profiles 16:00-16:30 Compressed 3D profile N0115 MPEG-7 Video Video/3DAV MDS Joint meetings notes Tue 12-13, Req: MAF Tue 14-14:30, Req: M3W Tue 14:30-15:30, Req: LaSeR Tue 15:30-16:30, Req: MPEG-4 profiles Rooms allocation SNHC 0999 Systems N1090 Requirements N1070 Chairs/HoD/Liaisons 0947 Allocation of contributions N° D1 Title Schedule Monday MPEG Plenary D1 D1 09h00-14h00 146 Activity MPEG Gen. Friday N° Title Report of AhG on MPEG-J extensions Schedule Mikaël Sévenier SNHC Agenda, FAQ, Web site AFX Reference software, integration issues AFX Profiles Mikaël Patrick Marius SNHC 10730 Extensibility feature of the BBA stream. Corrigendum Proposal 10655 MorphShape Node Implementation in Reference Software Marius PREDA Francoise Preteux Marius Preda Francoise Preteux Frederic Vexo 10656 BBA stream update for morphing-based Marius Preda virtual character animation Francoise Preteux Frederic Vexo 10707 Preliminary tests and evidences for EE on 3D Raphaèle Balter model-based movie streaming Patrick Gioia Luce Morin D2 Tuesday SNHC 10519 CE Shadow Algorithm Activity Bourges- Helge Drumm SNHC Patrick Gioia 10704 Proposal for Compressed 3D Profile Bourges10733 X3D Interactive profile, bitstream exchange Mikael update Sevenier Aaron E. Walsh 10696 Proposal of new requirements for streaming Jérôme Royan geo-visual contents Christian Bouville Patrick Gioia D1 15h00-16h00 15:00 15:30 15:45 D1 16h00-19h00 16:00 147 AFX CE 17:00 17:30 18:00 D2 D2 9:00 – 13:00 9:00 D2 10:00 – 11:00 10:00 Graphics AFX profiles/requirements (discussion) (discussion) (discussion) D2 11:00 – 12:00 SNHC SNHC Gen. AFX N° Title Schedule 10593 Implementation the Reference software of Gyeong Ja Jang AFX Encoder and User Guide James D. K. Kim D2 12:00 – 13:00 Kaneko 12:00 SNHC Activity 11:00 Graphics 10647 HI Corp., Waseda Univ. and Packet Video’s Itaru Response to Call for Proposal (SC29 WG11 (Waseda) N 6095) Osama K Alshaykh (Packet Video) Junya Tsutsumi (HI) Mark Callow (HI) Jiro Katto (Waseda) Daisuke Inoue (Waseda) D2 14:00 – 15:30 14:00 SNHC 10570 Improvement of PointTexture Compression in Depth Image-Based Representation (DIBR) Multi-Texturing for 10691 View-Dependent MPEG-4 AFX, Syntax and Semantics Specification Requirements Shinjun Lee Mahnjin Han Karsten Müller Aljoscha Smolic Thobias Rein 14:30 D2 15:30 – 16:30 Kaneko 15:30 10647 HI Corp., Waseda Univ. and Packet Video’s Itaru Response to Call for Proposal (SC29 WG11 (Waseda) N 6095) Osama K Alshaykh (Packet Video) Junya Tsutsumi (HI) Mark Callow (HI) Jiro Katto (Waseda) Daisuke Inoue (Waseda) Bourges10733 X3D Interactive profile, bitstream exchange Mikael 148 AFX MPEG profiles N° Title Schedule Activity update Sevenier Aaron E. Walsh 10696 Proposal of new requirements for streaming Jérôme Royan geo-visual contents Christian Bouville Patrick Gioia D2 16:30 – 18:00 17:00 SNHC 10579 Results on Core Experiment on Point based Stephan Wuermlin Rendering for MPEG-4 AFX Matthias Zwicker Michael Waschbuesch Markus Gross Hanspeter Pfister 14:30 10690 Proposal of 3D Camera Calibration Karsten Müller Parameters for MPEG-4 AFX Aljoscha Smolic Hanspeter Pfister Stephan Würmlin Matthias Zwicker D3 Wednesday D3 MPEG Plenary D3 09h00-11h00 SNHC D3 11h00-13h00 James D. K. Kim 11:00 10582 Proposal for Real-Time Water Simulation Jeong-Hwan Ahn Sang Oak Woo Jeong-Hwan Ahn 10583 Proposal for Cloth Animation James D. K. Kim Sang Oak Woo 10719 Proposal for MassSpring Node for Thomas Di Giacomo Animation Chris Joslin Marius Preda SNHC D4 14h00-16h00 14:00 10571 Proposal of XMT-A specifications for Gyeong Ja Jang 149 AFX MPEG Gen. AFX AFX N° Title PointTexture Compression Schedule Requirements 10704 Proposal for Compressed 3D Profile D4 D4 15h00-16h00 16:00 D4 D4 9h00-13h00 14:00-15:00 16:00-17:00 Patrick Gioia Thursday Systems 10593 XMT-A implementation user guide Part 1/COR1 review D5 Activity Shinjun Lee James D. K. Kim Mahnjin Han Friday SNHC General AFX SNHC Gen. Document number attribution D5 D5 9h00-11h00 9:00 MPEG Plenary D5 14h00-22h00 MPEG Gen. 150 General issues Web site The SNHC Web site is http://www.sait.samsung.co.kr/snhc/src/index.html Resolution As the web site hasn't been updated for a while, SNHC participants will add AFX Tutorial and other documents to promote AFX technologies. AFX Reference software The AFX Reference Software has been transferred to NIST and is available via CVS at 1. Register your login/password at http://mpeg.nist.gov/reg/login_new.php 2. :pserver:<your login>@mpeg.nist.gov:/big/mpegcvs 3. <your password> 4. Checkout "MPEG-4/Systems2/IM1" module (case sensitive). The AFX-related code is in OpenGL/AFX and conformance samples are in Tests/AFX. Standards from SNHC AFX conformance is finished; it has reached FDIS status at this meeting. AFX AMD1was to be CD at this meeting but without AFX nodes expressed in XMT, it remains at WD level. MPEG-J extensions for rendering is the new MPEG-4 Part 21. It will be WD in July. AFX COR1 has just started. The DCOR will be released at July meeting for 3-month ballot In red, status reached at this meeting. In yellow, status reached at next meeting. Projects that reached International Standard status have been removed. Std Pt Edit. Project Description CfP WD CD FCD FDIS PDAM FPDAM FDAM DCOR COR 02/10 02/12 03/12 04/07 03/12 04/07 05/01 4 5 4 11 2003 2003 Amd.7 Amd.4 4 16 4 16 4 21 2004 2004 2005 Cor.1 Amd.1 AFX Reference SW XMT and MPEG-J extensions AFX Corrigendum 04/03 04/07 AFX extension 03/07 04/07 MPEG-J extensions 03/12 04/07 04/10 for rendering 05/01 05/01 AFX activities Specifications updates The list of modifications for existing specifications handled by SNHC is as follows. 151 05/01 05/07 05/07 Part 1/COR1 AFX bitstream carriage in MPEG-4 Systems is moved to 14496-16/AMD1. 14496-1 will contain a normative reference to ISO/IEC 14496-16/AMD1 for AFX bitstream carriage. Part 11/AMD4 XMT-A Schema updated with AFX nodes. Part 11/COR1 Update node coding tables with AFX nodes removed (see section 0). Part 16/COR1 Update MeshGrid DecoderSpecificInfo (see proposal m10377) Update MeshGrid stream (see proposal m10377) Update WaveletSubdivisionSurface stream Add Bone-Based Animation corrections and quaternion support (see sections 0 and 0) Update node coding table update but leave the node code. Remove the following technologies Light Field Mapping, Solid modeling, Particle systems Part 16/AMD1 Delay at this time since XMT Schema is not ready. Add BBA stream and PointTexture stream identifiers. Move AFX stream decoder specific info from 14496-1. Conformance and reference software Conformance bitstreams are available and have all been tested by Samsung. SNHC would like to thank Samsung for checking all the bitstreams. M10655 – MorphShape node This is a follow up of the MorphShape node proposed at last meeting. The node is now implemented in IM1. Resolution Technology is stable and implemented. It is added to AFX/AMD1. M10656 – BBA update for morphing It is proposed to use MorphShape as a child of SBSegment and analyze how the stream needs to be updated. Using proposal m10730, this extension to BBA stream can be done. Resolution This update is accepted in AFX/AMD1. M10730 – BBA extensibility Correct BBA stream of AFX with a NoTypes indicator for future extensions. Resolution Add the proposal into AFX/COR1 to ensure backward compatibility with potential future extensions. 152 M10707 – EE results on 3D model-based movie streaming Resolution Promising results but it seems too limited at this time, more explorations are needed. Also, we cannot start a CE at this meeting; we need more industry support. M10519 – CE Shadow A new approach to the modeling of shadows was presented using shadow volumes. This works well with static shadows. However, it is very time consuming, so it is recommended to use this algorithm for simple geometry (no parametric surfaces). It was not tried with IndexedFaceSet node. Shadow is implemented into reference software. Comments The scenegraph management for shadow nodes and relationships with shapes and lights seems to be too big. We need to analyze this in detail. As this is a multi-pass algorithm, we also need to understand in more details the complexity of the proposed solution. Resolution Continue CE for penumbra and generic meshes. Complexity analysis of the different passes is needed. M10593 – Implementation of AFX encoder The following picture shows the architecture of the AFX bitstreams encoder provided generously by Samsung. This encoder enables all AFX/SNHC bitstreams to be generated and multiplexed into an mp4 files using IM1 tools. The architecture is extensible so that any AFX bitstream encoder can be added. This is a great tool Resolution Companies with AFX bitstreams should extend this tool with their bitstreams encoder. This software is added to the list of MPEG reference software. SNHC expresses its gratitude to Samsung for the donation of this tool. 153 M10570 – Improvement of PointTexture compression This proposal shows improvements in compression of PointTexture node for the depth and color fields. It was also proposed to update the BitWrapper node to support PointTexture streams. However, it was found that only the AFX stream identifier needed to be updated not the BitWrapper node coding. Results Depth improvement 32-52%, color improvement 2-5% Resolution Still need some improvement for color information compression. So the technology is kept in the AFX/AMD1 WD. M10691 – CE results on view-dependent multi-texturing Goal: Perform real-time view-dependent weighting of the textures. Syntax and semantics specification Proposal is to add a weight array into the existing MultiTexture node. The technology relies on 2 new nodes: MultiTexture is a Texture node to be used in Material.texture field. MultiTextureCoordinate is a new TextureCoordinate node IndexedFaceSet.texCoord field. to be used in Resolution The technology goes into AFX/AMD1 CD Implementation in reference software and text editing will be done within 1 month M10579 – CE point-based rendering For point-based rendering, it is proposed to extend existing DIBR nodes: DepthImage, SimpleTexture, PointTexture, by simply adding 'V2' at the end. Regarding compression, the scheme proposed by Samsung for PointTexture could be used but it is believed a more efficient compression is possible taking advantage of the extra fields for these nodes. Resolution The CE finished: the nodes are defined and functional with very good result. Technology will be included in AFX/AMD1 CD with 1 month editing period if implemented in reference software. Compression of this node will be defined for a new AFX amendment. M10690 – Camera calibration The proposal is to enhance computer graphics camera already in BIFS with more physical parameters such as lens information. Resolution MPEG-4 already provides camera support from a computer graphics point of view. We need to study the need for adding other physical parameters to model real cameras correctly. 154 Discussion: using quaternions in BBA In BBA rotations is represented using Euler angles but in some cases Euler angles produce Gimbal lock effects as already discussed during Trondheim meeting last year. It is proposed to add a flag to select either Euler angles or Quaternions. This adds one bit for rotation. Resolution Accepted (should have been a while ago!). Correction to BBA bitstream is added to Part 16/COR1. Physical model proposals M10582 – Real-time water simulation A water simulator is proposed based on perturbation of a mesh representing the water. Using environment mapping and other texturing effects, stunning visual representation can be achieved in real-time. However, the proposal focuses on simulation of oceans and lakes but may not address water in small environments such a glass, sinks etc. Other questions: How about collision detection with water? How about reflections on water? Resolution Start a CE on water simulation. Explore the simulation in a more global perspective with collision with other objects, reflections and so on. M10582 – Cloth simulation A physical model is built on top of mesh linking vertices by springs. External forces apply to the mesh and collision makes it behave like a real cloth. This type of simulation is more generally addressed by the following proposal. M10704 – Mass-spring Generic method using physically-based animation using forces, physical models (mass-spring models). It applies on whatever anisotropic/isotropic topology. The information that must be added to such a model is: For each vertex: mass or inverse of mass For each spring: rest length, damping, stiffness, starting and ending mass For the overall object: masses on which forces are applied Resolution A core experiment about physic modeling is started. The goal is to define a general and efficient representation for physically-based models. MPEG-4 Part 21 MPEG-J extensions for rendering MPEG-4 will be extended with a new Part 21 "MPEG-J extension for rendering" Rational for new MPEG-4 Part 21 The MPEG-J extensions for rendering is a set of Java APIs enabling efficient graphics capabilities to meet emerging industrial needs in graphics application combined with MPEG-J Application Engine. 155 Consensus in SNHC In order to write the Working Draft for the next meeting, we agreed To use M3G (JSR-184) as a starting point To maintain compatibility as much as possible e.g. extend M3G but not modify the APIs To work in liaison with JCP regarding extensions of JSR-184 specification To study extension of M3G for general platforms, if needed To study extension of MPEG-J for mobile platforms, if needed To study usage of M3G with MPEG o Getting access to decoder's buffer for composition o Investigate synchronization issues o Investigate architecture considerations for MPEG-J to support M3G, such as MPEGlets are not MIDlets. JSR-184 is intended to be used within a Canvas. MPEG-J can't use Canvas. Following Thursday Chairs meeting, it was decided to extend MPEG-4 with a new part: Part 21: MPEG-J extension for rendering, will contain Normative reference to Mobile 3G Graphics (M3G) API 1.0/2003 (technically referred as JSR-184) Extension to more general platform than mobiles Identify classes from other core Java APIs related to graphics and user interface functionalities necessary to implement the MPEG-J Graphics API Study streaming of M3G file format Study the need for subset to cover needs in smaller footprint implementations Editors: Mikaël Bourges-Sévenier, Vishy Swaminathan, Itaru Kaneko AhG meeting May 17-19, Japan, hosted by Hi Corp. And Sunday before 69th meeting Reflector: mpgj-sys Requirements… This section summarizes the discussions with MPEG Requirements group. SNHC profiles M10704 - Compressed 3D profile We propose to extend the Simple3D profile with 2 new graphics tools + backchannel: SubdivisionSurface and WaveletSubdivisionSurface are added to Graphics' simple compressed profile Backchannel support is added to Scenegraph's simple compressed profile profile. This doesn't increase decoder complexity since backchannel has nothing to do with decoding. It has been decided that Compressed3D profile will replace Simple3D profile since the complexity is not that big between the two profiles and Compressed3D enables more applications 156 Support: France Telecom, Superscape, Orange, Mindego, Samsung. Resolution The profile will be adopted in 14496-16/AMD1 at the next meeting if bitstream exchange is done. M10733 - X3D Interactive profile Resolution The bitstream exchange has been conducted. MPEG adopts the profile. It is added to 1449616/AMD1. M10696 – Geo-referencing Many consortia are working on geo-referencing: GeoVRML, GeoWeb, OpenGIS on the problem of coordinate systems. Examples of applications demonstrated: "Vivre a Rennes" from ArchiVideo Geo-positioning using GPS on mobile phone: 3D rendering on mobile, 3D maps, geoinformation (shops/hotels info etc.), virtual tourism (plan your travel, find hotel, virtual monuments…) Adaptability on bandwidth Crisis management for disaster relief management (fire, earthquakes…) Urban planning Flight simulators and games Technologies used Wavelets for streaming city map, not for building 2.5D representation for buildings: send the footprint of the building and the client reconstructs it. Scalability: adaptation to network bandwidth and to terminal capabilities View-dependent streaming Walkthrough or fly-over navigation What is missing in MPEG-4 to do such applications? It seems the efficient representation of so many buildings is not possible with current MPEG-4 technologies. However, we need to understand the technical details of the technology. It is proposed to add a new requirement to MPEG-4: Support of different coordinate systems (Cartesian, Geodetic, UTM, Geocentric). However, it is not believed that it is the role of MPEG to support different coordinate systems. More exploration is needed. Resolution This is a very promising application and we encourage the proponents to submit more technical details about the technology used and to study what is missing in MPEG-4. However, the requirement proposed (MPEG should support other coordinate systems) has not been accepted. Review of Call for Proposals on MPEG Graphics API Two contributions: Hi's Mascot Capsule APIs and JSR-184 by UK NB. Resolution (with Requirements and Systems) 157 MPEG should not reinvent the wheel. SNHC will study JSR-184 and recommend how to use it in MPEG-4 in a sensible way. Liaison with Java Community Process (JCP) that handles JSR-184 will be established. We need to understand the copyright issues regarding modifications of JSR-184 API. Resolutions of SNHC Output documents No. 631 0 631 1 631 2 631 3 Title TB P Availab le Editor 14496-16 MPEG-4 Animation Framework eXtension (AFX) AFX CE description No 04/04/02 Marius Preda ISO/IEC 14496-16/AMD1 WD 4.0 No 04/03/26 Marius Preda AFX VM 14.0 No 04/03/26 Marius Preda AFX 14496-16/DCOR1 No 04/03/26 Marius Preda Resolutions MPEG-4 Part 4 The SNHC subgroup would like to thank all the companies who contributed bitstreams for conformance of AFX technologies. The SNHC subgroup would like to express its gratitude to Samsung for conducting the verification of all the conformance bitstreams. Part 5 The SNHC subgroup acknowledges the development and donation of the generic AFX streams encoder by Samsung. Part 16 The SNHC subgroup informs on the removal of the following tools from the specification if no implementation is provided until the 69th meeting: o Light-Field mapping proposed by Intel Corp. o Solid modeling proposed by SGDL Systems o Particle systems proposed by Octaga The SNHC subgroup informs companies that no technology will be promoted to Committee Draft stage without implementation in MPEG reference software. Part 21 The SNHC subgroup would like to thank the companies who responded to the Call for Proposals on MPEG Graphics API: Hi Corp., PacketVideo, Waseda University, UK National Body. The SNHC subgroup is pleased to announce that Mobile 3D Graphics (JSR-184) specification has been chosen as the starting point for its graphics API in the new MPEG-4 Part 21 MPEG-J extensions for rendering specification. 158 Establishment of SNHC Ad-Hoc groups No. Title 635 0 635 1 AhG on software AhG on rendering N6350 Mandates: Chairman: Co-chairs: Duration: Meetings Reflector: Subscribe: N6351 Mandate: Chairman: Co-chairs: Duration Meetings: Reflector: Subscribe: Meetin g AFX documents, CEs, and 04/07/1 8 MPEG-J extensions for 04/07/1 8 Chair Marius Preda Mikaël Sévenier Bourges- Ad Hoc Group on AFX documents, CEs, and software 1. Maintain and edit 14496-16/AMD1 WD document 2. Maintain and edit SNHC VM document. 3. Coordinate SNHC CE activities. 4. Coordinate XMT representation of AFX technologies 5. Coordinate AFX/AMD1 software implementation Marius Preda (INT) Mahnjin Han (Samsung AIT) Mikaël Bourges-Sévenier (Mindego) Until 69th meeting Sunday before 69th meeting mpeg-snhc AT gti. ssr. upm. es Send an email to mpeg-snhc-request AT gti. ssr. upm. es with the message “subscribe” as the first line in the body. Ad Hoc Group on MPEG-J extensions for rendering 1. Maintain and edit 14496-21 WD document 2. Study extension of M3G for general platforms 3. Study feasibility of M3G subset for smaller footprint implementations 4. Study the combination of MPEG-J and M3G Mikaël Bourges-Sévenier (Mindego Inc.) Vishy Swaminathan (Sun Microsystems) Itaru Kaneko (Waseda University) Until 69th meeting May 17-19, Tokyo, Japan hosted by Hi Corp. Sunday before 69th meeting mpgj-sys AT advent. ee. columbia. edu Send an email to mpegj-sys-request AT advent. ee. columbia. edu with the message “subscribe” as the first line in the body. Closing of the Meeting See you in Seattle i 159 Annex 11 Report of Integration meeting Opening of the Meeting Allocation of contributions Monday Plenary 10459 Mahnjin Patrick Gioia Han 10460 Jens Spille AHG on MPEG-2 Audio Reference Software and Issues in MP3 on MP4 10461 Ralph Sperschneider Report of the AHG on MPEG-4 Audio Conformance 10462 Ralph Sperschneider Report of the AHG on MPEG-2 AAC and MPEG-4 Audio Text and Software Heiko Purnhagen 10470 Xin Wang, Jaime Delgado, AHG on MPEG-21 REL and RDD Reference Software Chris Barlas 10473 Christian Gerrard Drury … 10474 Gerrard Drury AHG on MPEG-21 DIP Reference Software Frederik De Keukelaere… 10476 T. Chiang, Yi-Shin Chung-Neng Wang 10485 Jean-Claude Dufourd 10486 Chun-Jen Tsai AHG on MPEG Multimedia Test Bed Mihaela van der Shaar… 10487 Thomas DeMartini AHG on MPEG-21 Conformance Sylvain Devillers… Timmerer AHG on AFX Conformance AHG on MPEG-21 DIA Reference Software Tung, AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance AHG on Reference Software Joint with MDS in MDS room, Tuesday 15:50-18:00, on MPEG-21 Conformance 10573 Eva Jaime Delgado… Rodriguez 10628 Thomas V. Venkatraman… DeMartini DMAG REL Interpretation Conformance Contribution to MPEG-21 REL Interpretation Conformance Test Cases Joint with MDS in MDS room, Tuesday 18:00-19:00, on MPEG-21 Reference Software 10521 Xin V. Venkatraman… Wang 10574 Eva Rodriguez, Jaime Delgado DMAG REL License Interpretation using RDD term genealogy – Implementation using Web Services 10575 Victor Torres, Jaime Delgado… Contribution to DID/REL/RDD reference software: DMAG REL License Interpretation within DID using RDD term genealogy 10577 Jaime Delgado, Eva Rodriguez… Status of DMAG Reference Software for MPEG-21 REL/RDD/DID 10702 Roberto Garcia, Jaime Delgado… MPEG REL and RDD Ontologies API 10703 Roberto Garcia, Jaime Delgado… RELOntos (REL Ontologies) Simple Integration Reference Software for MPEG-21 REL and DID Integration Plenary, Thursday 14:00 to 16:00, Systems room Conformance 10700 Ralph Sperschneider Status on MPEG-4 Audio Conformance 10550 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/PDAM 2 10543 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 7 10545 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/PDAM 8 160 10726 Ji Ming Study Text of ISO/IEC 14496-4:2002/FPDAM4 (MPEG-4 IPMPX Conformance) 10733 Mikael Bourges-Sevenier X3D Interactive profile, bitstream exchange update Aaron E. Walsh 10678 Kristofer Kjörling 10679 Kristofer Andreas Schneider 10694 Heiko Martin Wolters Proposed additions to the ISO/IEC 13818-4:200X/PDAM2 (Audio Conformance) document in order to specify SBR conformance for MPEG-2. Kjörling Purnhagen Additions to, and clarifications of MPEG-4 SBR conformance. Proposed clarifications of AAC conformance testing Reference Software xxxx CJ et al Study of Multimedia Test Bed document xxxx JCD / Ralph Progression of WD of MPEG-2 Software Simulation 2nd Edition 10527 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-4:200X/FDAM 3 [SC 29 N 5834] 10584 Michael Ransburg Status Report and Improvements of the MPEG-21 DIA Reference Software Christian Timmerer… 10593 Gyeong Ja James D. K. Kim 10609 Frederik De Keukelaere Contribution to DID 2nd Edition reference software Rik Van de Walle 10610 Frederik De Keukelaere Contribution to DII reference software Rik Van de Walle 10655 Marius Francoise Preteux… 10739 Jeho Hyuk-Min Kwon… Jang Preda Nam Implementation the Reference software of AFX Encoder and User Guide MorphShape Node Implementation in Reference Software Examples of Java Native Interface (JNI) for MPEG-21 DIA Reference SW xxxx past resolution In order to fill with appropriate text the Description section of the MPEG Reference Software Guide, the Integration subgroup kindly requests from all implementers a short description of their production including: language, status, functional description, input format or API, output format or API, dependencies and any other information deemed appropriate. xxxx Frederik and Gerrard update on software for DIP 10662 Shlomo Birman et al SynthesizedTexture Implementation in IM1 List of standards under development Std 2 2 2 4 Pt 4 4 5 4 Edit. 2004 2004 2004 2003 Project Amd.1 Amd.2 Dam1 Amd.4 4 4 4 4 4 4 4 7 4 4 4 4 4 5 5 6 2004 2003 2004 2004 2004 2004 2003 2001 Amd.6 Amd.7 Amd.8 Amd.9 Cor.1 Amd.6 Amd.7 Amd.1 7 21 7 8 2004 Amd.1 200 1st Ed. Description CfP WD CD FCD FDIS IPMP Conformance Ext. 03/03 03/07 03/12 04/07 Audio Conformance Ext. 03/10 03/12 04/03 04/07 IPMP Ref.Soft. Ext. 03/07 03/12 IPMP Extension 02/07 02/12 03/07 04/03 Conformance AVC 03/07 03/12 04/07 AFX Conformance 02/07 02/12 03/10 04/03 HE-AAC, ABIFS and SA 03/10 03/12 04/03 04/10 AVC PE Conformance 04/03 04/07 04/10 05/03 Visual Bitstreams 04/03 04/10 05/01 AVC and Audio SBR 03/03 03/07 03/12 04/07 AFX Reference SW 02/10 02/12 03/12 04/07 Reference software 01/12 03/03 03/12 04/07 extensions Conformance extensions 03/03 03/07 03/12 04/07 Reference software 03/03 04/03 04/07 05/01 161 x 12 200 x 14 200 x 21 21 1st Ed. 1st Ed. Test Bed for MPEG-21 Resource Delivery Conformance 02/12 03/12 04/07 03/10 04/03 04/07 05/01 Latest references Project MPEG-4 MPEG-4 MPEG-4 MPEG-4 MPEG-4 MPEG-7 MPEG-7 P. Standard 4 ISO/IEC 14496-4:2003 (MPEG-4 Conformance 2nd Ed.) 4 ISO/IEC 14496-4:2001/Amd.1 (FlexTime, Studio and Streaming Video Profile) 5 ISO/IEC 14496-5:2001 (Ref. Soft 2nd Ed.) 5 ISO/IEC 14496-5:2001/Amd.1 (FlexTime) 5 ISO/IEC 14496-5:2001/Amd.2 (XMT) 6 ISO/IEC 15938-6:2002 (Reference Software) 7 ISO/IEC 15938-7:2002 (Conformance) Issue 02/12 Awaji No. N5457 02/07 Klagenfurt 01/07 Sydney 02/03 Jeju 02/05 Fairfax 01/12 Pattaya 02/07 Klagenfurt N5083 N4368 N4711 N4865 N4475 N4937 Request documents n4904, Fairfax, request for 21000-8, editors: Olivier Avaro, Ian Burnett, Andrew Perkis MPEG-2 Conformance Contributions were presented in the Audio group. This results in the promotion of 13818-4 FPDAM2. MPEG-2 Reference Software We are waiting for a COR to be voted to integrate it in the second edition, so the draft 2nd edition is not promoted at this meeting. MPEG-4 Conformance (14496-4) 10726 Ji Ming Study Text of ISO/IEC 14496-4:2002/FPDAM4 (MPEG-4 IPMPX Conformance) This is an updated conformance document with additional bitstreams. This comes with a demo. The group recommends to have a look at this demo during the plenary, if time permits. MPEG-4 Reference Software (14496-5) 10593 Gyeong Ja James D. K. Kim Jang Implementation the Reference software of AFX Encoder and User Guide This contribution was presented. This is a missing element in the utility software. 162 10662 Shlomo Birman et al SynthesizedTexture Implementation in IM1 This contribution was not presented because neither of the authors was present during the Integration plenary MPEG-21 Conformance 1057 3 Eva Rodriguez Jaime Delgado… DMAG REL Interpretation Conformance This contribution and the software were presented. The status of the software was discussed and clarified: it will go into the utility section of the reference software document for MPEG-21. To be added to the conformance WD. 1062 8 Thomas DeMartini V. Venkatraman… Contribution to MPEG-21 REL Interpretation Conformance Test Cases This contribution presents a set of test cases that were used in the validation of the previous tool. These sequences will serve as basis of the initial test set for REL conformance. To be added to the conformance WD. State of the WD and possible promotion to CD: The current WD contains conformance for all sections but DID. Action: Rik to provided a suitable paragraph to the editors. The DIA section is then discussed. The REL is discussed for a long time. In the end, we decided to only specify description conformance (bitstream conformance in previous MPEG standards). MPEG-21 Reference Software 10521 10574 10575 10577 10702 10703 Xin Wang V. Venkatraman… Eva Rodriguez, Jaime Delgado Victor Torres, Jaime Delgado… Jaime Delgado, Eva Rodriguez… Roberto Garcia, Jaime Delgado… Roberto Garcia, Jaime Delgado… Simple Integration Reference Software for MPEG-21 REL and DID DMAG REL License Interpretation using RDD term genealogy – Implementation using Web Services Contribution to DID/REL/RDD reference software: DMAG REL License Interpretation within DID using RDD term genealogy Status of DMAG Reference Software for MPEG-21 REL/RDD/DID MPEG REL and RDD Ontologies API RELOntos (REL Ontologies) These contributions were presented. There was discussion about how to insert these in the reference software working draft. 163 No decision yet on the promotion of the document. 10609 Frederik De Keukelaere Contribution to DID 2nd Edition reference software Rik Van de Walle This is a candidate for the integration of MPEG-21 reference software and material for the DII part. The Integration group is impressed and thanks UGhent for their excellent work. 10610 Frederik De Keukelaere Contribution to DII reference software Rik Van de Walle This is part of the above software. 10584 Michael Ransburg Status Report and Improvements of the MPEG-21 DIA Reference Software Christian Timmerer… This contribution describes the current status of the DIA reference software, with a few missing bits, and also many improvements since last meeting’s version. There is a need until next meeting to update the reference software to FDIS status (could not be done before because the FDIS has only been available since the beginning of the week). The Integration group thanks Christian and UniKLU for their excellent integration work. 10739 Jeho Hyuk-Min Kwon… Nam Examples of Java Native Interface (JNI) for MPEG-21 DIA Reference SW This contribution gives a useful example guiding proponents for integration of a native module. xxxx Frederik and Gerrard update on software for DIP This is a report from discussions on what the reference software for DIP should be. The basis will be a refactored version of the Wollongong software, and the Ghent software will be integrated to it, and the Sun contributions as well. Last question: promotion of MPEG-21 reference software as CD. The consensus of the group is that the components are all ready (everything which has reached FDIS). The editing period will be one month. Frederik is to be named coordinating editor of the MPEG-21 Reference Software document and the list of co-editors needs to be cleaned up. Multimedia Test Bed There was a discussion about the need for a Study document. The rationale was presented: - port of DIA and IPMP - as a consequence new APIs - two week editing period MPEG Reference Software Guide xxxx Convenor In order to fill with appropriate text the Description section of the MPEG Reference Software Guide, the Integration subgroup kindly requests from all implementers a short description of their production including: language, status, functional description, input format or API, output format or API, dependencies and any other information deemed appropriate. 164 IPMP group has modified their document to answer that request. After the meeting, this will be formatted into a module description and offered as example to follow for the other module authors. 165 Unpublished Integration Standards 13818-4 13818-5 13818-5 14496-4 14496-4 200 X 200 X 200 X 2003 2003 Conformance testing Amd. 1 2nd Ed Amd. 1 03/10/24 Edito r Reference Software 03/12/12 ? Reference Software 03/12/12 (MPEG-2 IPMP) ? Conformance testing ITTF Conformance Testing ITTF 15938-6 (Conformance testing for MPEG-4) Conformance Testing (MPEG-4 Conformance extensions for XMT and media nodes) Reference SW 2nd ed. (XMT, DMIF) Reference SW 2nd ed. (Visual new level and tools) Reference Software 15938-7 Conformance testing 14496-4 2003 Amd. 2 14496-5 2001 Amd. 2 2001 Amd. 3 14496-5 166 ITTF 02/05/10 ITTF To be submitted to SC 29 DAM To be published FDAM to be issued by ITTF FDAM to be issued by ITTF to be published 03/03/14 ? 01/12 ITTF Under FDIS ballot (Closing 2003-04-0427) 02/10/25 Edito Prepare FDIS text r Resolutions of Integration Resolutions 1. The Integration subgroup reiterates its kind request to reference software authors for all parts of all MPEG standards to document their production for insertion in the MPEG reference software guide by the next meeting. An example based on a contribution from the IPMPX contributors will be posted on the MPEG Reference Software ad-hoc group reflector. 2. The Integration subgroup recommends appointing Frederik De Keukelaere (University of Ghent), Xin Wang (ContentGuard), Gerrard Drury (ENIKOS) and Chistian Timmerer (University of Klagenfurt) as editors of the 21000-8 MPEG-21 Reference Software. Documents MPEG-2 No. Title 13818-4 MPEG-2 Conformance 6461 DoC on ISO/IEC 13818-4:200X/PDAM2 Audio Conformance Ext. 6462 Text of ISO/IEC 13818-4:200X/FPDAM2 Audio Conformance Ext. TBP Available N N 04/03/19 04/03/19 MPEG-4 No. 6463 6464 6465 6466 6467 6468 6353 Title 14496-4 MPEG-4 Conformance DoC on ISO/IEC 14496-4:2003/FPDAM4 IPMP Conformance Ext. Text of ISO/IEC 14496-4:2003/FDAM4 IPMP Conformance Ext. DoC on ISO/IEC 14496-4:2003/FPDAM7 AFX Conformance Ext. Text of ISO/IEC 14496-4:2003/FDAM7 AFX Conformance Ext. Doc on ISO/IEC 14496-4:2003/PDAM8 HE-AAC, ABIFS & SA Conf. Text of ISO/IEC 14496-4:2003/PDAM8 HE-AAC, ABIFS & SA Conf. WD of ISO/IEC 14496-4:2003/AMD9 AVC Fidelity Range Extension Conformance TBP Available N N N N N N N 04/03/19 04/03/19 04/03/19 04/03/19 04/03/19 04/03/19 04/04/30 MPEG-21 No. 6470 No. 6471 No. Title 21000-8 MPEG-21 Reference Software Text of ISO/IEC 21000-8 CD MPEG-21 Reference Software TBP Available 04/03/19 Title TBP Available 21000-12 MPEG-21 Test Bed for MPEG-21 Resource Delivery Study of ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource N 04/04/04 Delivery Title 21000-14 MPEG-21 Conformance TBP Available 167 6472 WD3.0 of ISO/IEC 21000-14 MPEG-21 Conformance 168 04/03/19 AHG N6473 Mandate: AHG on MPEG-21 Reference Software 1. Develop and maintain reference software for the individual parts of MPEG-21 as well as integrated MPEG-21 reference software, 2. Follow the implementation plans of relevant parts of MPEG-21 3. Investigate transfer of the MPEG-21 reference software to the NIST site, 4. Check and improve the MPEG Reference Software Guide. Chairman: Xin Wang (ContentGuard, xin.wangX@Xcontentguard.com), Christian Timmerer (University Klagenfurt – christian.timmererX@Xitec.uni-klu.ac.at), Gerrard Drury (ENIKOS, gerrardx@xenikos.com), Jean-Claude Dufourd (ENST, dufourdX@Xenst.fr) Duration: Until 69th Meeting No meeting. Business will be conducted by E-mail or telephone conference. Meetings Reflector: mpeg-21-refsw@uow.edu.au Subscribe: Send email with “Subscribe mpeg-21-refsoft” to majordomo@uow.edu.au 169 Annex 12 Report of Test meeting Opening of the Meeting Goals for the week The goals of this week are: Presentation and discussion on results from SVC CfP Discussion on CE for ongoing SVC activities Presentation of results from Verification Tests for the MPEG-4 Error Resilient Simple Scalable Profile Joint Meetings The following joint meetings were scheduled with JVT – Objective video quality measure with Video – SVC & Error resilience Test reports Contributions 10737 Subjective test results for the CfP on Scalable Video Coding Technology (Baroncini / Oelbaum) 10744 Results of the MPEG-4 Error Resilient Simple Scalable Profile Verification Test (Baroncini / Reid) Test Activities Subjective test results for the CfP on Scalable Video Coding Technology (Baroncini / Oelbaum) Subjective tests were made at TUM (Munich) and ISCTI (Rome) between February 27th and March 12th . A SS (single stimulus) method was used to obtain the results, votes were given based on a discrete eleven grade scale. Confidence intervals were below 0.7 for all results. Parts of the tests were performed independently in both laboratories. Results have shown evidence that new scalable video coding technologies exist that provide subjective results within the range of <0.5 average deviation measured by an MOS scale, as compared to a high-quality single layer anchor. In some cases of rate points, it was found that scalable algorithms could perform superior to the anchor SVC CE An „expert viewing“ test method will be used to evaluate the different proposals in the CE process. With this method a ranking between different proposals can be made using only very few (4 to 5) experts and without the need of special resources. This method provides reproducible results for a CE process. A detailed description of this test method will be given as an input document to the next meeting. 170 Results of the MPEG-4 Error Resilient Simple Scalable Profile Verification Test (Baroncini / Reid) The new MMDSCQE (Multi Media Double Stimulus Continuous Quality Evaluation) was used in this test to compare the unimpaired (but compressed) with the impaired video. Progressive scan displays were used for the test and a PC mouse was used by the subjects to provide their quality observations. Error patterns were gained using a GPRS link layer simulator. The results clearly show the effectiveness of the Error Resilient Simple Scalable Profile compared to the Simple Scalable Profile in an error prone environment as it is typical for a GPRS based communication. Objective video quality measure The work presented in JVT-J024 contains some very strong weaknesses of which the most important one is that the quality evaluation presented here does only consider the luminance values and ignores the color information. The test group believes, that current objective quality measures can not replace a careful designed subjective evaluation. The author is encouraged to continue his work in groups that work on objective quality measurements (e.g. VQEG). Test Resolutions Output Documents 6382 Results of the MPEG-4 Error Resilient Simple Scalable Profile Verification Test 6383 Subjective test results for the CfP on Scalable Video Coding Technology AdHoc Groups No AdHoc Groups have been set up at this meeting. The video group has setup the AhG for the “SVC call for proposal”. Resolutions The Test Subgroup would like to thank the following companies for their financial support to the AVC verification test Microsoft Motorola NTT DoCoMo The Test Subgroup would like to thank all parties involved in the MPEG-4 Error Resilient Simple Scalable Profile Verification Test, in particular Vittorio Baroncini (FUB) for preparation of the test subjective test conduction and results processing. Gus Reid (Motorola) for preparation of the test and reporting the results. The Test Subgroup would like to thank all the participants to the SVC CfP testing activities and in particular: Konstatin Hanke Thomas Russert and Matthias Wien, (RWTH Aachen) for the preparation of the test material. Vittorio Baroncini (FUB) for preparation of the subjective test. 171 Vittorio Baroncini (FUB), Angelo Ciavardini and Giancarlo Gaudino (ISCTI); for the subjective test conduction and results processing. Vittorio Baroncini (FUB) for the preparation of the report. 172 Annex 13 Report of ISG meeting Source: Editor: ISG Chair Marco Mattavelli (EPFL) Overview The main work items of the Implementation Studies Subgroup in Munich are: 1. The advances in the development of the MPEG-4 “Part 9 Reference Hardware Description” Phase 2 concerning the integration of the MPEG-4 Optimized Reference software Part 7 and the Reference Hardware Part 9 so as to constitute a “mixed” software hardware description of MPEG-4 video using the concept of the virtual socket. 2. The planning and extensions of the integrated framework for the support to the development of MPEG-4 Part 9 with MPEG-7 part 7 and AVC (MPEG-4 Part-9) software. Input contributions w.r.t. the above items are summarized according to the following table: Contributions M1045 7 M1052 3 “Report of the AHG on MPEG-4 Part 9 Marco Mattavelli EPFL, "Reference Hardware Description" Robert Turney Xilinx Research Lab. HDL Virtual Socket Platform Rev 1.0 for MPEG- Paul Schumacher 4 Part 9 Robert Turney Detailed Report Reference hardware description for MPEG-4 The ISG activity at the Munich meeting has mainly been devoted to: the review of contribution on the “Virtual Socket” concept, the planning of the releases and advances on the integrated framework supporting the virtual socket idea on the drafting of the new edition of the PDTR for MPEG-4 part 9, on the specification of the July demonstration, on the update of the Part 2 and Part 10 module submission commitments.. The release “1” of the integrated environment running the mixed software/hardware description (MPEG-4 Part 9 and Part 7) using the chosen platform (Wildcard II) has been distributed to the 173 MPEG contributors to the development of Part 9 four weeks before the meeting. The updated workplan and detailed description of new releases and extensions is the following: Release “1” (current available version): The initial release of the virtual socket connects to the LAD bus interface on the WildCard-II. The memory-map for the WildCard-II provides each hardware accelerator with four defined regions: Read-Only Registers, Write-Only Registers, Read-Only Memory and Write-Only Memory. There also exists a master interface that provides access to the hardware accelerator identification register. Each virtual socket development team will be assigned a bit that acts as presence indicators so that software may determine which hardware accelerators are present within the framework. The basic functionality of the virtual socket interface is to route the host traffic to and from the appropriate hardware accelerator. As an example of creating a hardware accelerator it has been created a block move design. The VHDL file, vs_blockmove.vhd, demonstrates how one may connect to the virtual socket top-level located in virtual_socket.vhd. This demonstrates the support for the HDL flow in Revision 0. The virtual socket interface provides four strobe signals to each HWA indicating when a read or write is occurring to its register or memory regions. The HWA then must act appropriately and in cases of reads, must provide a strobe back to the top level indicating the data it is providing is valid. Revision 0 also provides support for the Handel-C language. The virtual socket interface is functionally identical to the HDL design with the exception of imported WildCard-II LAD bus interface VHDL source. The interface to the LAD bus is provided in Handel-C code. An external memory interface support is also introduced in this release. There is 2MB of 133 MHz ZBT SRAM located on the WildCard-II, and in Revision 1.0, this memory is accessible by both the host software and hardware accelerators on the virtual socket. Software may address the SRAM memory via the master unit. Since the entire address space of the SRAM is not addressable directly, the user must use a segment-offset technique that requires the writing to a 32-bit start address register mapped in the master unit’s register space. The most significant bit (31) of the start address indicates whether accesses are to the read or write only memory regions of the master: if 0, the ZBT SRAM; if 1, to the SDRAM. A ZBT controller is provided within the virtual socket top-level that allows three hardware accelerators to access the SRAM. An external block move example is provided to demonstrate the additional control signals to interface with the ZBT controller defined by the VHDL file zbt_manager.vhd. Hardware debugging support is also provided via a tool called ChipScope. Using the WildCard-II’s Left User I/O external connector, a hardware accelerator developer can debug their designs. Release 1.1 (release plan on 15th April 2004) A DRAM controller will be added in Revision 1.1 to read and write to the 64MB of 266 MHz DDR SDRAM located on the WildCard-II. This complements the access to the ZBT SRAM provided in Release 1.0. Release 2.0 (release on 30th April 2004) Support for co-simulation is provided in Release 2.0. A user can co-simulate their host software with their hardware code defined in either Handel-C code or HDL code. Release 3.0 (release on 15th may 2004) Release 3.0 will provide DMA access to the virtual socket platform allowing faster access to the hardware accelerators. Support for interrupts will also be provided. The MPEG-4 Part 10/AVC code will also be integrated into the code tree. Download Instructions for all releases: 174 All releases will be posted to the following ftp site: ftp://mpeg:76a43uV@ftp.xilinx.com/pub/MPEG-ISG/ Each release will be contained in a zip file named MPEG_platform_revXX.zip, where XX is the release number. An updated table of module submission commitment has been defined (question marks indicate that the commitment is uncertain concerning the delivery date or that the module has not been selected for a submission commitment): Part 9 Block Name DCT/IDCT Univ. Calgary DCT/IDCT Xilinx Motion comp. Engine Univ. Calgary MPEG Document Part submission VHDL Integration in Conformance submission the test Framework 2 Done Done 2 Done Done Univ. Calgary 4/30/2004 Framework 4/30/2004 4/30/2004 2 Done Done 4/30/2004 4/30/2004 Part 9 AMD 1 Block Name IDCT (8x8) University of AveiroPortugal IQ University of AveiroPortugal IS University of AveiroPortugal VLD University of AveiroPortugal VLD-IS-IQ-IDCT University of AveiroPortugal VLD-IS-IQ-IDCT + Motion Comp ?? 4x4 DCT/IDCT Luma University of AveiroPortugal 2x2 Chroma MPEG Document Part submission VHDL Integration in Conformance submission the test Framework 2 31/03/2004 31/03/2004 30/04/2004 15/05/2004 2 7/04/2004 7/04/2004 21/05/2004 31/05/2004 2 7/04/2004 7/04/2004 21/05/2004 31/05/2004 2 7/06/2004 15/06/2004 21/06/2004 31/06/2004 2 7/06/2004 15/06/2004 30/06/2004 07/07/2004 2 ?? ?? ?? ?? 10 16/08/2004 16/08/2004 21/08/2004 31/08/2004 10 16/08/2004 16/08/2004 21/08/2004 31/08/2004 175 Transform University of AveiroPortugal DCT/IDCT for Intra 16x16 macroblock type University of AveiroPortugal 4x4 Transform for SP frames University of AveiroPortugal Motion estimation Univ. Dublin Motion estimation Univ Dijon Direct Quant (LISIF) ? Direct Zig-Zag Scan LISIF VLC LISIF DCT/Q/ZZS/VLC (LISIF) ? CAVLC Ghent Univ CABAC Ghent Univ Luma 4x4 integer DCT/IDCT Ghent Univ 10 16/08/2004 16/08/2004 21/08/2004 31/08/2004 10 31/08/2004 7/09/2004 15/09/2004 15/09/2004 2/10 Done 31/05/2004 31/05/2004 31/05/2004 2/10 July 2004 31/06/2004 31/06/2004 31/06/2004 2/10 ? ? ? ? 2/10 31/05/2004 31/05/2004 15/06/2004 30/06/2004 2/10 31/05/2004 31/05/2004 15/06/2004 30/06/2004 2/10 ? ? ? ? 10 15/7/2004 15/7/2004 ? ? 10 15/7/2004 15/7/2004 ? ? 10 15/7/2004 15/7/2004 ? ? The ad-hoc group on the development of MPEG-4 Part 9 has been re-established with the usual mandates, including a specific mandate for the specification and development of the demonstration platform. The ad-hoc schedule includes 4 telephone conferences before next meeting. Phone conferences are planned on 15th Apr., 13th May, 3th June, 25th June. at 3 p.m. GMT. Tel: (from US 1-877-582-3182, from outside US 1-706-679-1128, participant code 9202060193). IMPORTANT: due to mail spamming a new reflector address has been established at : refhwmpeg@listes.epfl.ch To subscribe to the reflector send an email to: refhwmpeg-subscribe@listes.epfl.ch Resolutions The above activities have led to the following resolutions and output document 176 approval. MPEG-4 part 9 related resolutions: The Implementation Studies subgroup recommends to approve the following documents No. Title TBP Available 14496-9 MPEG-4 Reference Hardware Description N6307 ISO/IEC 14496-9/PDAM of AM 1: Information Technology – Coding N 04/04/30 of Audio Visual Objects - Part 9: Reference Hardware Description. N6308 Request for Reference Hardware Description Extensions N Y The Implementation Studies subgroup recommends to establish a protected CVS repository for the submission and appropriate maintenance of the reference hardware modules and the integrated framework implementing the virtual socket API for hybrid software hardware platforms. 177 Annex 14 Report of Liaisons meeting Source: Jan Bormans Following a request of the “Audio Video Coding Standard Working Group of China (AVS)” for a formal Liaison relationship, WG11 has asked SC29 for the approval of a class C Liaison between both organisations. AVS’s mandate is to establish standards for compression, decompression, manipulation and display in digital audio and video multimedia equipment and systems. At present, AVS comprises five sub-groups, concerned with audio, video, requirements and testing, system and implementation, and security and copyright. The benefits of establishing a Class C liaison are to facilitate: The active participation of AVS to MPEG standardization; and The efficient and timely exchange of information of work in progress. (MPEG-2) IPMP technologies are expected to be the first topic of collaboration. The Liaisons Group considered the following input documents: Contribution No. M10496 M10497 M10501 M10539 M10620 M10633 M10659 M10660 M10725 M10736 M10738 M10750 Title ISO/IEC FCD 19774: Information technology -- Computer graphics and image processing -- Humanoid animation (H-Anim) (SC24) Liaison Statement from the TV-Anytime Forum Liaison Statement from the TV-Anytime Forum Liaison Statement from 3GPP CRF Liaison to MPEG SMPTE Liaison to MPEG on V/ISAN and ISO 13818-1 DAM4 IEC CDV 62297-1: Triggering messages for broadcast applications -- Part 1: Format [SC 29 N 5856] IEC CDV 62297-2: Triggering messages for broadcast applications -- Part 2: Transport [SC 29 N 5857] Liaison Statement from 3D Consortium China AVS Response to WG11 N6119 Liaison Statement from ISO TC 46/SC 9 Liaison Statement from IEEE LTSC In addition to replying, when appropriate, to the incoming Liaison Statements, it was agreed to take the initiative to send outgoing Liaison Statements to: TV-Anytime Forum (on TV-Anytime metadata specifications), SMPTE (on V/ISAN and ISO 13818-1 DAM4), AVS China (on IPMP), ISO TC 46/SC 9 (on V/ISAN and ISO 13818-1 DAM4), IEEE-LTSC (on MPEG-21 REL), W3C (on Call for Proposal on Lightweight Scene Representation), and JPEG (on JPEG 2000 new activities and explorations). 178 Given the potential importance of the Call for Proposals on MPEG-21 IPMP for the organisations WG11 is in Liaison with, it was decided to widely distribute it to them: for a complete list of recipients see the list below in the Liaison resolutions. The responses for the non-technical National Body comments as well as an updated list of organisations with which MPEG entertains liaisons were completed. The following recommendations were issued: The approval of the following documents (Liaison Statements): Title Liaison Statement to the TV-Anytime Forum Liaison Statement to SMPTE on V/ISAN and ISO 13818-1 DAM4 Liaison Statement to AVS China Liaison Statement to ISO TC 46/SC 9 Liaison Statement to IEEE-LTSC Liaison Statement to W3C Liaison Statement to JPEG Information on MPEG-21 IPMP Call for Proposals The approval of the following documents (statement of benefits): Title Statement of benefits from establishing a Class C liaison with AVS China No. N6340 N6341 N6342 N6343 N6344 N6345 N6346 N6425 No. N6347 The approval of the following documents (other Liaison documents): Title Responses to NB Comments List of WG11 Liaisons No. N6348 N6349 The Liaison group recommends the approval of the new Class C Liaison with AVS China. The Liaison groups requests the SC29 secretariat to send N6425 to following organizations in Liaison: o o o o o o o o o o o o o o CIDF: Content ID Forum Content Reference Forum (CRF) DAISY Consortium DVB: Digital Video Broadcasting EDItEUR IDF: International DOI Foundation IEEE Learning Technology Standards Committee IFPI: International Federation of the Phonographic Industry ISMA: Internet Streaming Media Alliance OASIS - Right Language Technical Committee OeBF: Electronic Book Exchange Working Group OMG: Object Management Group Third Generation Partnership Project (3GPP) TVA: TV-Anytime Forum 179 o UMTSF ICTG: Universal Mobile Telecommunications Systems Forum, Information Communication Technology Group Nomination of liaison representatives: o Shen Sheng Mei to AVS China 180