INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO N6484 ISO/IEC JTC 1/SC 29/WG 11 Redmond, WA – July 2004 Source Leonardo Chiariglione, Convenor Title Report of the 68th meeting Status Report of the 69th meeting 1 Opening The 68th WG11 meeting was held at the Technical University of Munich on 2004/03/15-19 at the kind invitation of the German National Body (DIN). 2 Roll call of participants Annex 1 gives the attendance list. 3 Approval of agenda Annex 2 gives the agenda approved. 4 Allocation of contributions Annex 3 gives the list of input contributions 5 Communications from Convenor 6 Report of previous meeting This was approved. 7 Processing of NB Position Papers National Body papers were considered and answers provided where appropriate. 8 Work plan 8.1 Media coding 8.1.1 MPEG-2 AAC BW Extensions conformance The following documents were approved 6617 DoC on ISO/IEC13818-4:200X/FPDAM2 Audio Conformance Ext. 6618 ISO/IEC13818-4:2004/FDAM2 Audio Conformance Ext. 8.1.2 Parametric Audio Coding The following document was approved 1 6675 Formal Verification Report on MPEG-4 Parametric Audio Coding 8.1.3 Advanced Video Coding The following document was approved 6540 Text of ISO/IEC 14496-10 Advanced Video Coding 3rd Edition 8.1.4 AVC Conformance The following documents were approved 6532 DoC on ISO/IEC 14496-4/FPDAM6 AVC Conformance 6533 ISO/IEC 14496-4/FDAM6 AVC Conformance 8.1.5 AVC Fidelity Range Extensions 8.1.6 AVC Fidelity Range Extensions Conformance The following document was approved 6534 ISO/IEC 14496-4/PDAM9 AVC FRExt Conformance 8.1.7 New levels in MPEG-4 Simple profile The following documents were approved 6495 Request for ISO/IEC 14496-2:2004 AMD2 6496 Text of ISO/IEC 14496-2:2004/PDAM 2 (New Levels in Simple Profile) 8.1.8 New levels in MPEG-4 Simple profile conformance The following document was approved N6497 Request for ISO/IEC 14496-4:2004 Amd.10 N6498 Text of ISO/IEC 14496-4:2004 PDAM10 Conformance Extensions for New Levels of Visual Simple Profile 8.1.9 AFX Conformance 8.1.10 AFX Extensions The following document was approved 6544 ISO/IEC 14496-16/PDAM1 8.1.11 Audio Lossless Coding The following documents were approved 6672 Text of 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS) 6680 Workplan for Audio Lossless Coding (ALS) 8.1.12 Audio Scalable Lossless Coding The following documents were approved 2 6673 Text of 14496-3:2001/PDAM 5, Scalable Lossless Coding (SLS) 6681 Workplan for Scalable Lossless Coding (SLS) 8.1.13 1-bit Audio Lossless Coding The following document was approved 6674 Text of 14496-3:2001/FPDAM 6, Lossless coding of 1-bit oversampled signals 8.1.14 HE-AAC Conformance The following documents were approved 6622 DoC on ISO/IEC 14496-4/FPDAM8 HE-AAC, ABIFS and SA Conformance 6623 ISO/IEC 14496-4/FDAM8 HE-AAC, ABIFS and SA Conformance 8.1.15 SA Conformance The following documents were approved 6622 DoC on ISO/IEC 14496-4/FPDAM8 HE-AAC, ABIFS and SA Conformance 6623 ISO/IEC 14496-4/FDAM8 HE-AAC, ABIFS and SA Conformance 8.1.16 Scalable Video Coding 8.1.17 Streaming Text Format 8.1.18 Spatial Audio Coding 8.1.19 Video Coding Tool Repository 8.1.20 3D AV Coding 8.2 Composition coding 8.2.1 Audio BIFS Extensions The following documents were approved 6590 DoC on ISO/IEC 14496-11/FPDAM3 6591 Text of ISO/IEC 14496-11/FDAM3 8.2.2 Audio BIFS Conformance The following documents were approved 6622 DoC on ISO/IEC 14496-4/FPDAM8 HE-AAC, ABIFS and SA Conformance 6623 ISO/IEC 14496-4/FDAM8 HE-AAC, ABIFS and SA Conformance 8.2.3 XMT extensions The following documents were approved 6592 DoC on ISO/IEC 14496-11/PDAM4 3 6593 Text of ISO/IEC 14496-11/FPDAM4 8.2.4 Lightweight Scene Representation The following documents were approved 6499 Request of ISO/IEC 14496-20 6500 Text of ISO/IEC 14496-20/CD 8.2.5 Symbolic Music Representation The following document was approved 6689 Call for Proposals for Symbolic Music Representation 8.3 Description coding 8.3.1 Efficient representation of descriptions 8.3.2 Video Descriptors The following document was approved N6516 WD 2.0 of MPEG-7 New Visual Extensions 8.3.3 Audio Descriptors 8.3.4 MDS user preference extensions The following documents were approved 6633 DoC on ISO/IEC 15938-5 FPDAM/2 6634 ISO/IEC 15938-5 FDAM/2 “MDS User Preference Extensions” 8.3.5 MPEG-7 Conformance Extensions The following documents were approved 6637 DoC on ISO/IEC 15938-7 FPDAM/1 6638 ISO/IEC 15938-7 FDAM/1 8.3.6 MPEG-7 Profiles 8.3.7 Schema definition The following documents were approved 6639 DoC on ISO/IEC 15938-10 FCD 6640 ISO/IEC 15938-10 FDIS “Schema Definition” 4 8.3.8 Extraction and use of MPEG-7 descriptions extensions 8.4 Systems support 8.4.1 Carriage of ISAN and V-ISAN metadata 8.4.2 New audio profile and level signaling 8.4.3 Text profile descriptor The following documents were approved 6588 Request of ISO/IEC 14496-1:2004 Amd.1 6589 Text of ISO/IEC 14496-1:2004/PDAM1 8.4.4 MPEG-1 Audio access units The following documents were approved 6670 DoC on 14496-3:2001/FPDAM 3, MPEG-1/2 Audio in MPEG-4 6671 Text of 14496-3:2001/FDAM 3, MPEG-1/2 Audio in MPEG-4 8.4.5 Streaming of MPEG-7 descriptions 8.4.6 Timestamps and Audio Codec Behavior The following document was approved 6682 Timestamps and Audio Codec Behavior 8.5 IPMP 8.5.1 MPEG-2 IPMP-X Conformance The following documents were approved 6624 DoC on ISO/IEC13818-4/FPDAM1 IPMP Conformance Ext. 6616 ISO/IEC13818-4/FDAM1 IPMP Conformance Ext. 8.5.2 MPEG-4 IPMP-X Conformance 8.5.3 Evaluation Tools for Persistent Association 8.5.4 MPEG-21 IPMP Framework The following document was approved 6644 ISO/IEC 21000-4 WD v.1 “IPMP” 8.6 Digital Item 8.6.1 Digital Item Declaration The following documents were approved 6641 DoC on 21000-2 CD 2nd Edition – Digital Item Declaration 5 6642 ISO/IEC 21000-2 DID 2nd Edition FCD 8.6.2 Digital Item Binarisation The following document was approved 6613 Text of ISO/IEC 21000-16/CD 8.6.3 DIA Conversions and Permission The following document was approved 6647 MPEG-21 DIA PDAM/1 “Conversions and Permissions” 8.6.4 Event Reporting The following document was approved 6656 ISO/IEC 21000-15 WD v.2 “Event Reporting” 8.6.5 MPEG-21 Conformance 8.6.6 Vision, technologies and strategy 8.7 Transport and File Format 8.7.1 MPEG-2 Systems The following documents were approved: 6583 Study Text of ISO/IEC 13818-1:2000/FPDAM4 6584 DoC on ISO/IEC 13818-1:2000/FPDAM5 6585 Text of ISO/IEC 13818-1:2000/FDAM5 8.7.2 ISO File Format extensions The following documents were approved: 6595 Study Text of DoC on ISO/IEC 14496-12/FPDAM1 6596 Study Text of ISO/IEC 14496-12/FPDAM1 8.7.3 MPEG-21 File Format The following documents were approved: 6610 DoC on ISO/IEC 21000-9/CD 6611 Text of ISO/IEC 21000-9/FCD 8.8 Multimedia architecture 8.8.1 MPEG-J extension for scene control 8.8.2 MPEG-J extension for rendering The following document was approved 6549 ISO/IEC 14496-21 WD 1.0 6 8.8.3 Digital Item Processing The following documents were approved 6653 Draft DoC on ISO/IEC 21000-10 CD 6654 Study on ISO/IEC 21000-10 CD “Digital Item Processing” 8.8.4 MPEG Multimedia Middleware 8.9 Reference implementation 8.9.1 AVC Reference Software The following documents were approved 6535 DoC on ISO/IEC 14496-5/FPDAM6 AVC and HE-AAC reference software 6536 ISO/IEC 14496-5/FDAM6 AVC and HE-AAC reference software 8.9.2 HE-AAC Reference Software The following documents were approved 6535 DoC on ISO/IEC 14496-5/FPDAM6 AVC and HE-AAC reference software 6536 ISO/IEC 14496-5/FDAM6 AVC and HE-AAC reference software 8.9.3 MPEG-2 IPMP Reference Software The following documents were approved 6619 DoC on ISO/IEC 13818-5/DAM2 IPMP Reference Software Ext. 6620 ISO/IEC 13818-5/AMD2 IPMP Reference Software Ext 8.9.4 AFX Reference Software The following documents were approved 6625 DoC on ISO/IEC 14496-5/FPDAM7 AFX reference software 6626 ISO/IEC 14496-5/FDAM7 AFX reference software 8.9.5 AVC Fidelity Range Extensions Reference Software The following document was approved 6537 ISO/IEC 14496-5/PDAM8 AVC FRExt reference software 8.9.6 MPEG-4 Visual Reference Hardware Description 8.9.7 MPEG-4 AVC Reference Hardware Description The following documents were approved 6506 6509 Updated Call for the Submission of Hardware Reference Code for MPEG-4 Part 9: Reference Hardware Description Status of HDL submissions and commitments for MPEG-4 Part-9 7 8.9.8 MPEG-7 Reference Software Extensions The following documents were approved 6512 6511 DoC of ISO/IEC 15938-6/FPDAM1 Information Technology -Multimedia Content Description Interface- part 6: Reference Software Extensions ISO/IEC 15938-6/FDAM1 Information Technology -Multimedia Content Description Interface- part 6: Reference Software Extensions 8.9.9 MPEG-21 Reference Software The following documents were approved 6627 DoC on ISO/IEC 21000-8/CD MPEG-21 reference software 6628 ISO/IEC 21000-8/FCD MPEG-21 reference software 8.9.10 Test Bed for MPEG-21 Resource Delivery The following documents were approved 6629 DoC on ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource Delivery 6630 ISO/IEC 21000-12/DTR Test Bed for MPEG-21 Resource Delivery 8.10 Application formats 8.10.1 Music player Application Format The following documents were approved 6687 DoC on 23001-1:200X CD, “Player Application Format” 6688 Text of 23001-1:200X FCD, “Player Application Format” 8.10.2 Photo album Application Format 8.11 Maintenance 8.11.1 Systems standards The following documents were approved 6582 6586 6587 6594 Text of ISO/IEC 13818-1:2000/DCOR3 DoC on ISO/IEC 14496-1/DCOR3 Text of ISO/IEC 14496-1/COR3 Text of ISO/IEC 14496-11/COR2 8.11.2 Video coding standards The following document was approved N6514 MPEG-4 Visual: List of Problems Reported version 13.0 8.11.3 Audio coding standards The following documents were approved 6621 ISO/IEC 13818-5 :1997/Amd1:1999/COR2 6669 Text of 13818-7:2004/DCOR 1 “AAC ADTS buffer fullness correction” 8 6677 Proposed 3rd Edition of 14496-3 8.11.4 Synthetic coding standards The following document was approved 6545 ISO/IEC 14496-16/DCOR1 8.11.5 Visual description coding standards 8.11.6 Audio description coding standards 8.11.7 MDS standards The following documents were approved 6635 DoC on ISO/IEC 15938-5 DCOR/1 6636 ISO/IEC 15938-5 COR/1 8.11.8 IPMP The following document was approved 6646 ISO/IEC 21000-6 DCOR/1 8.11.9 Digital Item The following document was approved 6648 ISO/IEC 21000-7 COR/1 WD v.1 9 Liaison matters 10 Organisation of this meeting 10.1 Tasks for subgroups Tasks were assigned to achieve the goals of the work plan. 10.2 Joint meetings The following joint meetings were held Groups What Req, JVT Profiles, DCinema, etc. Req, MDS, Sys MPEG-21 IPMP HOD Req, Vid MPEG-4 Video Profiles, SVC Req, Sys, Aud, Vid, MDS MAF Vid, Tst SVC Experts viewing DMP Req, Sys OpenType, M3W Req, MDS, Sys DID, binarisation Req Sys, Snh Laser, MPEG-j, XMT Req, Aud Scalable Audio in MPEG-21 Req, Sys, Aud, Vid, MDS MP7 Profiles Req, Int, MDS MP21 integration & implem. 9 Where JVT Req Lassen Vid Req Vid Lassen Req Req Sys Aud Req Req Day Mon Mon Mon Tue Tue Tue Tue Tue Tue Tue Tue Wed Wed Time 15:30-16:30 17:00-18:00 18:00-19:00 09:00-11:00 11:00-11:30 11:00-12:00 13:00-14:00 14:00-15:00 15:00-16:30 17:00-18:00 11:30-12:00 11:30-13:00 14:00-15:00 Req, Sys MDS, Int Vid, JPG Aud, Sys Sys, SNHC Vid, VCEG Req, MDS Vid, ISG MDS, Sys Req, Vide Sys, JPG MDS, Int Req, Aud M3W MP21 conform. Scalable Video Coding Audio codec behaviour Laser Scalable Video Coding MP21 IPMP VCTR MP21 FF PAT, 3DAV, SVC ISO File Format ext MP21 RSW SMR reqs Req MDS Vid Aud Snh Vid Req Vid Sys Vid Sys MDS Req Wed Wed Wed Wed Wed Wed Wed Wed Thu Thu Thu Thu Thu 14:00-14:30 15:00-16:00 15:00-16:00 16:00-17:00 16:00-15:00 16:00-17:00 16:30-17:00 11:30-12:30 09:00-10:00 09:30-11:00 10:00-11:00 11:00-12:00 14:00-14:30 10.3 Administrative matters 10.3.1 Schedule of future MPEG meetings The following meeting schedule was approved Meeting 69th 70th 71st 72nd 73rd 74th 75th City Country Yr. Mo. Days Redmond, WA US 04 07 19-23 Palma de Mallorca ES 04 10 18-22 Hong Kong CN 05 01 17-21 Busan KR 05 04 18-22 Poznań PL 05 07 25-29 ? FR 05 10 17-21 ? ? 06 01 23-27 10.3.2 Promotional activities An ad hoc group with this mandate was re-ablished. 11 Planning of future activities The following ad hoc groups were established 6528 6662 6664 6526 6525 6668 6502 6531 6504 6523 AHG on 3DAV Coding AHG on AFX documents, CEs, and software AHG on Audio Standard Maintenance AHG on Core Experiments in Scalable Video Coding AHG on Description Tools for New Visual Extensions AHG On Exploration of Scalable Audio and Speech Coding AHG on Font Format Representation AHG on M3W AHG on MAF AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance 6524 AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software 6657 AHG on Media Locators 6632 AHG on MPEG 101 10 6659 6660 6661 6503 6658 6666 6510 6696 6692 6663 6527 6615 6665 6667 6631 6529 6614 AHG on MPEG-21 DIA AHG on MPEG-21 DIP AHG on MPEG-21 Event Reporting AHG on MPEG-21 Integration and Outreach AHG on MPEG-21 IPMP AHG on MPEG-4 Lossless Audio Coding AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2. AHG on MPEG-7 Audio AHG on MPEG-7 Interoperability and Profiling AHG on MPEG-J extensions for rendering AHG on Scalable Video Model and SVC Reference Software AHG on Scene Representation AHG on Spatial Audio Coding AHG on Symbolic Music Representation AHG on the Communicating MPEG to the business Community AHG on Video Coding Tools Repository AHG on XML Structure Binarization and Streaming 12 Resolutions of this meeting These were approved (N6482) 13 A.O.B There was no other business 14 Closing The meeting closed at 2004/07/24T21:20. 11 Annex 1 Attendance list First Name Myriam Gerrard Shane Axel Robert David Ian Christian Joeri Jan Frederik Alexandru Peter Rik Antonin Spencer Jeremie Alain Demin Patrick Lowell Feng Jizheng Shiqiang Chengwei Wang Hsin-Hao Hsueh-Ming Tihao Chun-Jen Yi-Shin Chung-Neng Jan Petri Mauri Henrik Michel Olivier Abdellatif Renaud Cyril Alexandre Jean-Claude Melanie Francois Patrick Marc Mariam Frederic FX Marius Claude Jerome David Jérôme Last Name Amielh Drury Lauf Becker Prandolini Taubman Burnett Timmerer Barbarien Bormans De Keukelaere Salomie Schelkens Van de Walle Descampe Cheng Farret Mignot Wang Rault Winger Wu Xu Yang Gao Baoai Chen Hang Chiang Tsai Tung Wang Achrenius Kero Vaananen Karppinen Allain Avaro Benjelloun Touimi Cazoulat Concolato Cotarmanac'h Dufourd Dulong de Rosnay Edouard Gioia Guez Vucher Kimiaeiasadi Loras NUTTALL Preda Seyrat Vieron Virette Caporossi Company CISRA TITR / enikos University of Wollongong/Enikos CISRA Defence Science & Technology Org The University of New South Wales University of Wollongong/Enikos University Klagenfurt Vrije Universiteit Brussel IMEC Ghent University Vrije Universiteit Brussel Vrije Universiteit Brussel Ghent University Université Catholique de Louvain Morphbius Technology SGDL Systems Inc SolideSpace Communications Research Centre FastVDO LSI Microsoft Microsoft Research Asia Tsinghua University Anyka Cayman Corporation China Electronics Standardization Institute OES/ITRI National Chiao Tung University NCTU/MITSUBISHI National Chiao Tung University National Taiwan University National Chiao Tung University Hybrid Graphics, Ltd. Hybrid Graphics, Ltd. Nokia Nokia, Inc. SACEM France Telecom R&D France Telecom R&D France Telecom R&D ENST France Telecom ENST Medialive Thomson R&D France Telecom R&D SCPP ENST France Telecom CISAC Int EXPWAY Thomson France Telecom Medialive 12 Country Australia Australia Australia Australia Australia Australia Australia Austria Belgium Belgium Belgium Belgium Belgium Belgium Belgium Canada Canada Canada Canada Canada Canada China China China China China China China China China China China Finland Finland Finland Finland France France France France France France France France France France France France France France France France France France France Vania Christine Fabrice Didier Stéphane Stephane Francoise Peter Oliver Johannes Martin Ivan Bernhard Harald Ralf Bernhard Matthias Juergen Joerg Tilman Joern Thomas Juergen Andreas Aljoscha Ralph Mathias Ingo Siegfried Gero Ulrich Ulrich Carsten Peter Detlev Tobias Jens-Rainer Heiko Herbert Thomas Thomas Aharon Zvi Marco Riccardo Paolo Stefano Giovanni Roberto Leonardo Takashi Kohtaro Yukihiro Toshiaki Kazuhiro Satoshi Yutaka Takahiro Masaki Takuyo Conan Guillemot Le Leannec Nicholson Pateux Valente Preteux Amon Baum Boehm Dietz Dimkovic Feiten Fuchs Geiger Grill Gruhne Herre Heuer Liebchen Ostermann Rusert Schmidt Schneider Smolic Sperschneider Wien Wolf Foessel Bäse Benzler Fecker Herpel List Marpe Oelbaum Ohm Schwarz Thoma Wedi Wiegand Gill Lifshitz Tagliasacchi Leonardi Nesi Tubaro Cordara Flaiani Chiariglione Nishi Asai Bandou Fujii Iida Ito Kamamoto Kimoto Kitahara Kogure Thales INRIA Canon Research Centre France SAS Thales France Telecom R&D Philips Digital Systems Labs - Paris Institute National de Telecommunication Siemens AG Fraunhofer IIS Thomson Coding Technologies Ahead Software Deutsche Telekom T-Systems Fraunhofer IIS Fraunhofer IDMT Fraunhofer IIS Fraunhofer IDMT Fraunhofer IIS Siemens AG Technical University of Berlin Universität Hannover - Institut für Theoretische N Aachen University Thomson Coding Technologies Fraunhofer HHI Fraunhofer IIS Aachen University T-Systems Germany Fraunhofer IIS Siemens AG Robert Bosch GmbH University of Erlangen-Nuremberg Thomson Deutsche Telekom T-Systems Fraunhofer HHI Munich University of Technology RWTH Aachen Fraunhofer HHI Fraunhofer IIS Panasonic European Laboratories Fraunhofer HHI Zoran Microelectronics, Ltd. Optibase, Ltd. Politechnico di Milano University of Brescia DSI-DISIT- University of Florence - MUSICNETWORK Politecnico di Milano Telecom Italia LAB Aethra CEDEO Oki Electric Industry Company, Ltd. Mitsubishi Electric Corporation NTT Nagoya University Panasonic Toshiba NTT NEC NTT Matsushita Electric 13 France France France France France France France Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Germany Israel Israel Italy Italy Italy Italy Italy Italy Italy Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Takehiro Tokumichi Hirofumi Toshiyuki Takeshi Masanori Craig Takanori Yoshinori Seishi Naoya Masayuki Takafumi Akio Hiroshi Junichi Akio Naoki Yukiko Takeshi Hideaki Masaaki Tomokazu Satoru Teruhiko Toshiya Hideki Thiow Keng Yoshihisa Masao Itaru Hiroshi Chung-Hyun Kyung-Ae Sangchang Jong-Jin Yongju Ik-Hwan Woo-Jin Mahnjin Hendry Kang Gyeong Ja Euee Seon Ye Sun Sang-Kyun Hae Kwang Kiseob HyoungJoong Wook-Joong Rinchul Sangwook Munchurl Kyuheon Hyun Mun Wonha JungHoe Jaejoon Joohee Seok-Hoon Moriya Murakami Nishikawa Nomura Norimatsu Sano Schultz Senoh Sugihara Takamura Tanaka Tanimoto Ueno Yamada Yasuda Hara Matsubara Kobayashi Ogura Chujoh Kimata Kobayashi Murakami Sakazume Suzuki Takahashi Takehara Tan Yamada Aizu Kaneko Watanabe Ahn Cha Cha Chae Cho Cho Han Han Hendry Hogab Jang Jang Joung Kim Kim Kim Kim Kim Kim Kim Kim Kim Kim Kim Kim Kim Kim Kim NTT Mitsubishi Electric Corporation Mitsubishi Electric Corporation NEC Matsushita Electric NHK Multimedia-Architectures Matsushita JEITA NTT Panasonic Nagoya University Matsushita Electric NEC The University of Tokyo RICOH RICOH Nippon Telegraph Telephone East Corporation IPSJ/ITSCJ Toshiba NTT Oki Electric Industry Company, Ltd. Hitachi, Ltd. Victor Company of Japan, Ltd. Sony Panasonic Victor Company of Japan, Ltd. NTT DoCoMo, Inc. Mitsubishi Electric Corporation Canon, Inc. Tokyo Polytechnic University Waseda University ETRI Information and Communications University Samsung Electronics net&tv Inc. ETRI In-ha University Samsung Electronics Samsung AIT Information and Communications University Hersasu Samsung AIT Hanyang University ETRI Samsung AIT Sejong University Kangwon National University Kangwon National University ETRI University of Seoul Samsung AIT Information and Communications University ETRI Samsung AIT Kyung Hee University Samsung AIT Daegu University Samsung AIT Korea Digital Content Forum 14 Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Japan Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Hye Yun Daijin Jong-Tae Sun Young Jong won Jeho Eunmi Weon Geun Keunsoo Soo Jun Seungho Jeongil Youngjoo Hyung Sik Won-Young Kisong Chee Sun Dong-Seok Jeon Woong Il Yo-sung Manbae Haksoo Yong Han Yung-Lyul Young-Kwon Ji-Ho Sang Yong Jean H.A. Werner Andrew Fons Jan Gisle Arild Eyvind Wladyslaw Marek Fernando Kok Seng Neo Sua Zhongyang Ming Men Huang Xiao Chin Phek Susanto Xiaokang Rongshan Vincent ChakJoo Jiunn Bin Chong Soon Jaime Marc Thomas Eva Paulo Kristofer Heiko Kim Kim Kim Lee Lee Nam Oh Oh Park Park Park Seo Song Suh Yoo Yoon Won Jeong ByeongMoon Choi Ho Kim Kim Kim Lee Lim Park Seo Gelissen Oomen Tokmakoff Bruls van der Meer Bjontegaard Fuldseth Fossbakk Skarbek Domanski Pereira Chong Hong Huang Ji Lee Lin Ong Rahardja Yang Yu Diong Lee Lim Lim Delgado Gauvin Kummer-Hardt Rodriguez Villegas Kjorling Purnhagen Samsung-AIT Postech KAIST Hanyang University Samsung ETRI Samsung AIT ETRI Korean Broadcasting System ETRI Kyung Hee University ETRI ETRI KwareSoft Inc. ETRI ETRI Dongguk University INHA University LG Electronics Inc. Sungkyunkwan University GIST Kangwon National University Kangwon National University University of Seoul Sejong University net&tv, Inc. LG Electronics Inc. Korea Telecom Philips Research Philips PDSL-E Telematica Instituut Philips Philips Tandberg Tandberg Norwegian Broadcasting Corporation Warsaw University of Technology Pozna&#324; University of Technology Instituto Superior Técnico Panasonic Singapore Laboratories Panasonic Singapore Laboratories Panasonic Singapore Laboratories Panasonic Singapore Laboratories Panasonic Singapore Laboratories Institute for Infocomm Research Panasonic Singapore Laboratories Institute for Infocomm Research Institute for infocomm research Institute for Infocomm Research Panasonic Singapore Laboratories Panasonic Singapore Laboratories Panasonic Singapore Laboratories Panasonic Singapore Laboratories Universitat Pompeu Fabra sDae AIO Universitat Pompeu Fabra Telefonica I+D Coding Technologies Coding Technologies 15 Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea Korea NL NL NL NL NL Norway Norway Norway Poland Poland Portugal Singapore Singapore Singapore Singapore Singapore Singapore Singapore Singapore Singapore Singapore Singapore Singapore Singapore Singapore Spain Spain Spain Spain Spain Sweden Sweden Per Marco Julien Stephan Francesco Giorgio Touradj Chris Miroslaw Leszek Niels Martin Ray Simon Steve Ping Catherine Paul Thomas Wenlong Michael Igor Jose' Roberto Hye-Yeon Chad Neelesh Mingning Michael Karl Daniel Steve Rob Eric Hitoshi Hsi-Jung Dengzhi Sheng Jeroen Bruce Jonathan Marina Mikael George Katie Sachin Matt Chuck Bradford Marco James D. (jj) Mukta Rob Mike Khosrow Vladimir Debargha Martha Florian Hanspeter Schuyler Fröjdh Mattavelli Reichel Wuermlin Ziliani Zoia Ebrahimi Barlas Bober Cieplinski Rump Russ Taylor Watt Appleby Wu Grant Jessop DeMartini Dong Good Komir Alvarez Cheong Fogg Gokhale Gu Horowitz Lillevold Miner Purcell Robinett Viscito Watanabe Wu Zhang Zhong Bekaert Block Boley Bosi Bourges-Sevenier Chen Cornog Deshpande Fellers Fenimore Gandee Hurtado Johnston Kar Koenen Ksar Lashkari Levantovsky Mukherjee Nalebuff Pestoni Pfister Quackenbush Ericsson EPFL VisioWave ETH Zurich VisioWave EPFL EPFL Rightscom, Ltd. Mitsubishi Electric ITE-VIL Mitsubishi Electric ITE-VIL Rightscom, Ltd. British Telecommunications plc NDS Limited Universal Music International BT Tandberg Television Nine Tiles IFPI ContentGuard, Inc. Microsoft Corporation Recordare llc Analog Devices, Inc. Mobilygen Corporation Columbia University Pixonics RealNetworks QPixel Technology CoVi Technologies RealNetworks DirecTV Enmedia Modulus Video eV Consulting QPixel Technology Apple Computer, Inc. QPixel Technology Broadcom Ghent University / Los Alamos National Laboratory RIAA University of Miami MPEG LA LLC Mindego, Inc. STMicroelectronics Avid Technology Sharp Laboratories of America Dolby Laboratories NIST ContentGuard, Inc. IBM Microsoft Corporation Cable Television Laboratories InterTrust Microsoft Corporation DoCoMo USA Labs Agfa Monotype Corporation Hewlett-Packard Microsoft Corporation Microsoft Corporation Merl Audio Research Laboratories 16 Sweden Switzerland Switzerland Switzerland Switzerland Switzerland Switzerland UK UK UK UK UK UK UK UK UK UK UK US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US Majid Chris Ofer John Ali Mihaela Anthony Mark Xin S. Merrill Thomas Dai Wendy Ali Wo Walter Michael Susie Lian John Marta Taek David Pankaj Alexandros Mike Yiliang Frank Peisong Sherman Craig Felix Harinath Walter Stephen Munsi Barry Caspar Louis Shawmin Michael Jiuhuai Ajay Tom Raghavendra Mandayam Atul Wei Viji Yuriy Justin Phoom David Huifang Shijun Kumar Vishwanathan Yasser Peter Robert Rabbani Russell Shapiro Smith Tabatabai Vander Schaar Vetro Vinton Wang Weiss White Yang Aylsworth Bilgin Chang Husak Marcellin Wee Zhu Apostolopoulos Karczewicz Kim Lindbergh Topiwala Tourapis Rubinfeld Bao Bossen Chen Chen Demel Fernandes Garudadri Gish Gordon Haque Haskell Horne Kerofsky Lei Lightstone Lu Luthra McMahon Nagaraj Narasimhan Puri Qi Raveendran Reznik Ridge Sagetong Singer Sun Sun Swaminathan Swaminathan Syed Symes Turney Eastman Kodak MPAA Quix IBM T. J. Watson Research Center Sony Uc Davis / Philips Mitsubishi Electric Dolby Laboratories ContentGuard, Inc. Merrill Weiss Group LLC MIDI Mfrs Assoc VidiatorTechnology (us) Inc. Warner Brothers University of Arizona NIST Dolby University of Arizona Hewlett-Packard Crowley-Davis Research Hewlett-Packard Nokia Research Center Hewlett-Packard Polycom, Inc. FastVDO Thomson - Corporate Research NIST Nokia, Inc. DoCoMo USA Labs Qualcomm, Inc. Broadcom CoWare Inc. Texas Instruments Qualcomm, Inc. Dolby Laboratories Broadcom Intel Corporation Apple Computer, Inc. Self-employed Sharp Laboratories of America Sharp Laboratories of America Nvidia Panasonic Motorola Dolby Laboratories Vidiator Technoogly us inc Motorola RealNetworks Vweb Corporation Qualcomm, Inc. RealNetworks Nokia, Inc. Qualcomm, Inc. Apple Computer, Inc. Mitsubishi Electric Research Laboratories Sharp Laboratories of America Hughes Network Systems Sun Cable Television Laboratories SMPTE Xilinx Research Laboratories 17 US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US US Feng Chi Gary Peter Andy Wang Sullivan Schirling Tescher Conexant Systems, Inc. Microsoft Corporation IBM Research Microsoft Corporation 18 US US US US Annex 2 Agenda 1. 2. 3. 4. 5. 6. 7. 8. 1. 8.1 1.1. 1.2. 1.3. 1.4. 1.5. 1.6. 1.7. 1.8. 1.9. 1.10. 1.11. 1.12. 1.13. 1.14. 1.15. 1.16. 8.2 2.1. 2.2. 2.3. 2.4. 2.5. 8.3 3.1. 3.2. 3.3. 3.4. 3.5. 3.6. 3.7. 3.8. 8.4 4.1. 4.2. 4.3. Agenda item Opening Roll call of participants Approval of agenda Allocation of contributions Communications from Convenor Report of previous meeting Processing of NB Position Papers Work plan Media coding MPEG-2 AAC BW Extensions conformance AVC Conformance AVC Fidelity Range Extensions AVC Fidelity Range Extensions Conformance AFX Conformance AFX Extensions Audio Lossless Coding Audio Scalable Lossless Coding 1-bit Audio Lossless Coding HE-AAC Conformance SA Conformance Scalable Video Coding Streaming Text Format Spatial Audio Coding Video Coding Tool Repository 3D AV Coding Composition coding Audio BIFS Extensions Audio BIFS Conformance XMT extensions Lightweight Scene Representation Symbolic Music Representation Description coding Efficient representation of descriptions Video Descriptors Audio Descriptors MDS user preference extensions MPEG-7 Conformance Extensions MPEG-7 Profiles Schema definition Extraction and use of MPEG-7 descriptions extensions Systems support Carriage of ISAN and V-ISAN metadata New audio profile and level signaling MPEG-1 Audio access units 19 4.4. 4.5. Streaming of MPEG-7 descriptions Timestamps and Audio Codec Behavior 8.5 IPMP 5.1. MPEG-2 IPMP-X Conformance 5.2. MPEG-4 IPMP-X Conformance 5.3. Evaluation Tools for Persistent Association 5.4. MPEG-21 IPMP Framework 8.6 Digital Item 6.1. Digital Item Declaration 6.2. Digital Item Binarisation 6.3. DIA Conversions and Permission 6.4. Event Reporting 6.5. MPEG-21 Conformance 6.6. Vision, technologies and strategy 8.7 Transport and File Format 7.1. ISO File Format extensions 7.2. MPEG-21 File Format 8.8 Multimedia architecture 8.1. MPEG-J extension for scene control 8.2. MPEG-J extension for rendering 8.2. Digital Item Processing 8.3. MPEG Multimedia Middleware 8.9 Reference implementation 9.1. AVC Reference Software 9.2. HE-AAC Reference Software 9.3. AFX Reference Software 9.4. AVC Fidelity Range Extensions Reference Software 9.5. MPEG-4 Visual Reference Hardware Description 9.6. MPEG-4 AVC Reference Hardware Description 9.7. MPEG-7 Reference Software Extensions 9.8. MPEG-21 Reference Software 9.9. Test Bed for MPEG-21 Resource Delivery 8.10 Application formats 10.1. Music player Application Format 10.2. Photo album Application Format 8.11 Maintenance 11.1 Video coding standards 11.2 Audio coding standards 11.1 Visual description coding standards 11.2 Audio description coding standards 11.3 MDS standards 9. Liaison matters 10. Organisation of this meeting 10.1 Tasks for subgroups 10.2 Joint meetings 11. Administrative matters 11.1 Schedule of future MPEG meetings 11.2 Promotional activities 20 12. 13. 14. 15. Planning of future activities Resolutions of this meeting A.O.B Closing 21 Annex 3 Input document list No. Authors 10751 Wo Chang 10752 Robert Turney Marco Mattavelli Title Document Register for SC29/WG11 Meeting Redmond, USA AHG on MPEG-4 Part 9 Reference Hardware Description Phase 1 and 2 Marius Preda 10753 Mahnjin Han Mikael Bourges-Svenier AHG on AFX documents, CEs, and software Mikael Bourges-Svenier 10754 Vishy Swaminathan Itaru Kaneko AHG on MPEG-J extensions for rendering T. Chiang 10755 Yi-Shin Tung Chung-Neng Wang AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance L. Cieplinski A. Yamada 10756 Sang-Kyun Kim Stephan Herrmann AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software Miroslaw Bober Sang-Kyun Kim AHG on Description Tools for New Visual Extensions Mihaela van der Schaar A. Becker 10758 J. Ridge C.J. Tsai AHG on Core Experiments in Scalable Video Coding 10757 10759 Aljoscha Smolic Hideaki Kimata AHG on 3DAV Coding 10760 Euee S. Jang Kohtaro Asai AHG on Video Coding Tools Repository 10761 Simon Watt 10762 Wo Chang Olivier Avaro Wo Chang 10763 Akio Yamada Alan Melby 10764 Gerrard Drury Frederik De Keukalaere Gerrard Drury 10765 Frederik De Keukaleare Munchurl Kim 10766 FX Nuttall Andrew Tokmakoff AHG to evaluate responses to the MPEG-21 IPMP CfP AHG on Multimedia Application Format (MAF) AHG on MPEG-7 Profiles AHG on Core Experiments for MPEG-21 DID 2nd Edition AHG on Core Experiments for MPEG-21 DIP AHG on MPEG-21 Event Reporting 10767 S. Quackenbush AHG on Spatial Audio Coding 10768 Tilman Liebchen AHG on MPEG-4 Lossless Audio Coding 10769 Paolo Nesi Giorgio Zoia AHG on Symbolic Music Representation 22 Claude Seyrat 10770 Andreas Hutter Itaru Kaneko AHG on XML Structure Binarization and Streaming Jean-Claude Dufourd 10771 Alexandre Cotarmanac.h Juergen Schmidt AHG on Scene Representation Jean Gelissen Olivier Avaro 10772 Ian Burnett Young-Kwon Lim AHG on MPEG Multimedia Middleware 10773 P. Schirling AHG on Communicating MPEG to the business Community 10774 Thomas DeMartini Requirement for MPEG-21 Binarization 10775 IEC TC 100 via SC 29 Secretariat IEC CDV 60728-9/Amd.1: Cable networks for television signals, sound signals and interactive services -- Part 9: Interfaces for cabled distribution systems for digitally modulated signals, Amendment 1 [SC 29 N 5891] 10776 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 15938-4/FDAM 1 [SC 29 N 5892] 10777 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-1:2001/FDAM 3 [SC 29 N 5954] 10778 SC 37 via SC 29 Secretariat ISO/IEC FCD 19794-6: Information technology -- Biometric data interchange formats -- Part 6: Iris image data [SC 29 N 5958] 10779 SC 37 via SC 29 Secretariat SC 37 NP on Vascular Biometric Image Interchange Format [SC 29 N 5959] 10780 SC 37 via SC 29 Secretariat ISO/IEC FCD 19794-5: Information technology -- Biometric data interchange formats -- Part 5: Face image data [SC 29 N 5960] 10781 IEC TC 100 via SC 29 Secretariat IEC CDV 62328-1: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 1: General description and architecture [SC 29 N 5961] 10782 IEC TC 100 via SC 29 Secretariat IEC CDV 62328-2: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 2: General recording structure [SC 29 N 5962] 10783 IEC TC 100 via SC 29 Secretariat IEC CDV 62328-3: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 3: Broadcasting system specific recording structure -- ISDB [SC 29 N 5963] 10784 ITU-T SG 17 via SC 29 Secretariat Liaison Statement from ITU-T SG 17 [SC 29 N 5968] 10785 ITU-T SG 12 via SC 29 Secretariat Liaison Statement from ITU-T SG 12 [SC 29 N 5980] 10786 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 21000-6 [SC 29 N 5981] 10787 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/PDAM 4 [SC 29 N 5982] 10788 SC 29 Secretariat Summary of Voting on ISO/IEC TR 13818-5:1997/Amd.1:1999/DCOR 2 [SC 29 N 5998] 10789 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 14496-8 [SC 29 N 5999] 10790 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 15938-5:2003/FDAM 1 [SC 29 N 6001] 10791 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 1 [SC 29 N 6002] 10792 SC 29 Secretariat Summary of Voting on ISO/IEC PDTR 21000-12 [SC 29 N 6008] 10793 TVA via SC 29 Secretariat Liaison Statement from the TV-Anytime Forum [SC 29 N 6015] 23 10794 IEC TC 100 via SC 29 Secretariat IEC CDV 62298-1: Teleweb Application -- Part 1: General Description [SC 29 N 6016] 10795 IEC TC 100 via SC 29 Secretariat IEC CDV 62298-2: Teleweb application -- Part 2: Delivery methods [SC 29 N 6017] 10796 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 13818-1:2000/FDAM 3 [SC 29 N 6019] 10797 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-10 [SC 29 N 6103] 10798 ITU-R SG 6/WP 6M via SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6M [SC 29 N 6022] 10799 ITU-T SG 9 via SC 29 Secretariat Liaison Statement from ITU-T SG 9 [SC 29 N 6033] 10800 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 14496-18 [SC 29 N 6029] 10801 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 14496-19 [SC 29 N 6035] 10802 a 10803 Glenn Adams David Singer MPEG-21 DIA W3C Comments on the MPEG Timed Text specification 10804 Ralph Sperschneider Study on ISO/IEC 14496-3:2001/FPDAM 3 (MP3onMP4) 10805 Mikael Bourges-Sevenier AhG MPEG-J extensions for rendering, Tokyo meeting report 10806 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-7/FPDAM 1 [SC 29 N 6046] 10807 Niels Rump Chris Barlas Relationship between Digital Items and Digital Item Declarations Navarro Silva 10808 Nunes Aragao 2-D IDCT Hardware Accelerator Implementation for Virtex-II Devices 10809 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3/FPDAM 3 [SC 29 N 6047] 10810 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-1:2001/FDAM 7 [SC 29 N 6048] 10811 JTC 1 Secretariat via SC 29 Secretariat Summary of Voting on ISO/IEC TR 13818-5:1997/DAM 2 [SC 29 N 6049] 10812 Jean-Claude Dufourd Olivier Avaro Answer to the CfP on LASeR and SAF: Streamezzo format proposal overview 10813 Niels Rump Simon Watt Overview of responses to Call for Proposals for MPEG-21 IPMP 10814 Joerg Heuer Andreas Hutter Answer to Call for Proposal on Lightweight Scene Representation 10815 Jean-Claude Dufourd Olivier Avaro Answer to the CfP on LASeR and SAF: Streamezzo LASeR format proposal 10816 Jean-Claude Dufourd Olivier Avaro Answer to the CfP on LASeR and SAF: Streamezzo SAF format proposal 10817 Jean-Claude Dufourd Olivier Avaro Answer to the CfP on LASeR and SAF: Streamezzo Test Set and Executables 10818 Alexandre Cotarmanach Renaud Cazoulat Answer to the CfP on LASeR and SAF 10819 Renaud Cazoulat Alexandre Cotarmanach Answer to the CfP on LASeR and SAF 10820 Robin Berjon Response to the CfP on LASeR : BiM SVG Profile for LASeR 24 Gregoire Pau Claude Seyrat J.Dubois 10821 L.Pierrefeu M.Mattavelli Motion estimation Hardware Accelerator Implementation for Virtex-II Devices 10822 Robert Prandolini Scalable Video Coding Requirements for Video Surveillance Systems 10823 Wael Badawy Tamer Mohamed An Integrated Hardware-Accelerated Software Framework for MPEG4 Hardware Reference Model Ihab Amer 10824 Wael Badawy Graham Jullien AN IP BLOCK FOR MPEG-4 PART 10 CONTEXT-BASED DAPTIVE VARIABLE LENGTH CODING (CAVLC) Ihab Amer 10825 Wael Badawy Graham Jullien A Hardware Block for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10 Ihab Amer 10826 Wael Badawy Graham Jullien A SystemC Description for 2x2 Hadamard Transform and Quantization Block with Application to MPEG–4 Part 10 Ihab Amer 10827 Wael Badawy Graham Jullien A Hardware Block for 4x4 Hadamard Transform and Quantization in MPEG4 Part 10 Ihab Amer 10828 Wael Badawy Graham Jullien A SystemC model for 4x4 Hadamard Transform and Quantization witj application to MPEG-4 Part 10 Ihab Amer 10829 Wael Badawy Graham Jullien A Hardware Block for THE MPEG-4 PART 10 4x4 DCT-LIKE TRANSFORMATION AND QUANTIZATION Ihab Amer 10830 Wael Badawy Graham Jullien A SYSTEMC MODEL FOR THE MPEG-4 PART 10 4x4 DCT-LIKE TRANSFORMATION AND QUANTIZATION 10831 Thomas DeMartini Editor's Input: DIA AMD/1 WDv2.1 Eva Rodriguez 10832 Silvia Llorente Jaime Delgado DMAG answer to MPEG-21 Intellectual Property Management and Protection Call for Proposals 10833 Jean-Claude Dufourd Young-Kwon Lim Proposed WD 0.1 of ISO/IEC 14496-20, LASeR and SAF 10834 Olivier Avaro et alii Proposed Draft Core Experiment on LASeR Harmonization with SVG 10835 Olivier Avaro et alii Proposed Draft Core Experiment on LASeR Binary Representation 10836 Young-Kwon Lim 10837 Olivier Avaro et alii 10838 SC 29 Secretariat Report of the LASeR evaluation meeting LASeR software Summary of Voting on ISO/IEC FCD 14496-17 [SC 29 N 6057] Melanie Dulong de Rosnay Answer to the Call for Proposals for MPEG-21 IPMP: Medialiving 10839 Jérôme Caporossi technology Daniel Lecomte 10840 ITU-R SG 6/WP 6Q via SC 29 Secretariat Liaison Statement from ITU-R SG 6/WP 6Q [SC 29 N 6059] 25 10841 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-3:2001/FDAM 2 [SC 29 N 6062] 10842 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 15938-3:2002/FDAM 1 [SC 29 N 6063] 10843 DMP via SC 29 Secretariat Liaison Statement from the Digital Media Project [SC 29 N 6060] 10844 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-1:2001/DCOR 3 [SC 29 N 6064] 10845 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/DCOR 2 [SC 29 N 6069] 10846 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-5:2003/DCOR 1 [SC 29 N 6072] 10847 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-8 [SC 29 N 6075] Itaru Kaneko (Tokyo Polytechnic University) Application Specific Binary Coding (ASBC) of MPEG-21 descriptors for Nobuyuk Kinoshita 10848 better coding efficiency maintaining interoperability to regular MPEG-21 (MMG) decoder Spencer Cheng (Morphbius Technology) Valentin Muresan Noel O’Connor 10849 Noel Murphy Sean Marlow Alan Smeaton 10850 Carlos Serrao Panos Kudumakis Low-power hardware acceleration for motion estimation ENTHRONE answer to the Call for Proposal for MPEG-21 IPMP 10851 Wo Chang testing Yongju Cho Young-Kwon Lim 10852 Moonsub Song Hyung-Joon Kim Proposed Resource Reference Box for addressing a sub-part of a media resource 10853 Mauri Väänänen Finnish NB comment: SVC requirements and directions Panos Kudumakis 10854 Carlos Serrao Claudio Alberti MOSES and ENTHRONE answer to the MPEG-21 IPMP CfP Hendry Kyung-Ae Cha 10855 Munchurl Kim Keun Soo Park Answer to the CfP on MPEG-21 IPMP : A Right Description Model on Resource Combinations Jeongyeon Lim Qonita Shahab Hendry 10856 Kyung-Ae Cha Munchurl Kim Keun Soo Park Answer to the CfP on MPEG-21 IPMP : An IPMP Decription Tool for Partial Encryption of Digital Items Hendry 10857 Munchurl Kim Keun Soo Park Answer to the CfP on MPEG-21 IPMP : REL DIBOs in MPEG-21 DIP for MPEG-21 IPMP Zhongyang Huang Ming Ji 10858 Shengmei Shen Taka Senoh Takafumi Ueno Answer to the MPEG-21 IPMP CfP: IPMP_Scheme Descriptor and its Processing for Digital Item Protection 10859 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 7 [SC 29 N 6080] 26 10860 Ian S Burnett Gerrard Drury Response to CfP for MPEG-21 IPMP Sang-Hoon Oh Seok-Hoon Kim 10861 Hyung-Sik Suh Sang-Gyu Lee Bon-Hong So Response to CfP for MPEG-21 IPMP : Reference Model for IPMP Assessment 10862 Craig Schultz Answer to the CfP on MPEG-21 IPMP 10863 Silva O. Nunes C. Aragao MPEG-4 Inverse Quantizer Hardware Accelerator Implementation in Virtex II Xin Wang 10864 Venugopal Venkatraman Thomas DeMartini Simple Integration Reference Software for MPEG-21 REL, DID and DIA J. J. Chae J. Nam 10865 B. J. Kim J. W. Hong Answer to CfPs for MPEG-21 IPMP Bin Li Li Zhao 10866 Nanshan Wu Shiqiang Yang The DRM Framework for Large-scale Broadcast 10867 Tom McMahon AVC FRExt Level Requirements for D-Cinema and High Quality SD/HD Distribution, Contribution, and Backhaul David Taubman none 10868 Nagita Mehrseresht none Raymond Leung SVC Technical Contribution: Overview of recent technology developments at UNSW Chris Barlas Niels Rump Ian Burnett Paul Jessop Rik van de Walle 10869 Fernando Pereira Simon Watt Kate Grant Chris Russell Brian Green MPEG-21 Integration and Outreach 10870 Marco Rittermann A Proposal for Testing Multi-View Video Coding Jeho Nam Hyuk-Min Kwon Man-Bae Kim 10871 Seungji Yang Truong Cong Thang Rin-Chul Kim Hae-Kwang Kim Updated Status of MPEG-21 DIA Utility Software Modules 10872 Ye-Kui Wang Finnish NB comments on 14496-12 Amd.1 Victor Torres 10873 Jaime Delgado Eva Rodriguez MPEG-21 DIP Core Experiments: A contribution to the implementation of DIBOs for REL Spencer Cheng 10874 Gene Wen Nickolay Pakoulin Improving MPEG-21 IPMP Conformance - Experience from MPEG-2/4 IPMPX 27 Vitaly Omelchenko Alexander Koptelov Alexandre Petrenko Alexander Kossatch 10875 Shijun Sun Temporal Scalable Coding Using AVC Coding Tools 10876 JTC 1 Secretariat via SC 29 Secretariat Summary of Voting on ISO/IEC DTR 21000-1 (2nd Edition) [SC 29 N 6093] 10877 SC 37 via SC 29 Secretariat Liaison Statement from JTC 1/SC 37 on ISO/IEC FCD 19794-5 [SC 29 N 6094] 10878 SC 29 Secretariat Summary of Voting on NP MPEG-A [SC 29 N 6099] 10879 SC 29 Secretariat Summary of Voting on CD MPEG-A [SC 29 N 6101] 10880 Gyeong Ja Jang James D. K. Kim 10881 KNB 10882 Gyeong Ja Jang James D. K. Kim Update of XMT-A for AFX KNB comment on 14496-11/PDAM4 (XMT & MPEG-J Extensions) Updates on the reference software of AFX Encoder Andrew Kinane Valentin Muresan Noel O’Connor 10883 Noel Murphy Seán Marlow Alan Smeaton Hardware Acceleration Module for Shape Adaptive Discrete Cosine Transform 10884 Young-Kwon Lim Proposal on SL-compliant SAF packet headers Jong-Tae Kim Weon-Geun Oh 10885 Hae-Kwang Kim Heung-Kyu Lee Young-Ho Seo Video Extension to Evaluation Tools for Persistent Association Technologies Ik-Hwan Cho Hae Kwang Kim 10886 Weon-Geun Oh Dong-Seok Jeong The Composition of Test Video Sequences for Evaluation of the robustness of Digital Video Watermarking 10887 JTC 1 Secretariat via SC 29 Secretariat Summary of Voting on ISO/IEC DTR 21000-11 [SC 29 N 6102] 10888 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 6 [SC 29 N 6106] 10889 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-2 [SC 29 N 6107] 10890 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-4:200X/FDAM 5 [SC 29 N 6108] Eva Rodriguez 10891 Jaime Delgado Silvia Llorente Revised REL Interpretation Conformance after verification of Test Cases Jeroen Bekaert Thomas DeMartini 10892 Rik Van de Walle Herbert Van de Sompel Identification of a DIDL Document Wendy Aylsworth Tom McMahon 10893 Peter Symes Oliver Morgan SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18 28 Stephan Würmlin Michael Waschbüsch Edouard Lamboray 10894 Peter Kaufmann Aljoscha Smolic Markus Gross Image-space Free-viewpoint Video Won-Young Yoo Weon-Geun Oh 10895 Hae-Kwang Kim Yong-Seok Seo Sung-Hwan Lee Transaction Watermarking Model for Persistent Association Technologies 10896 AUNB via SC 29 Secretariat AUNB Contribution on JPEG & MPEG Public Document Archive [SC 29 N 6112] 10897 TVA via SC 29 Secretariat Liaison Statement from the TV-Anytime Forum [SC 29 N 6114] 10898 Mahnjin Han Addition to PointTexture Compression for future extensions Gyeong Ja Jang Shinjun Lee 10899 James D.K. Kim Mahnjin Han Update on XMT-A specification for encoding parameter of PointTexture Compression 10900 Jean H.A.Gelissen Contribution to MPEG Multimedia Middleware Requirements v.1.0 10901 Francois Edouard Vieron Jerome THOMSON requirements for Scalable Video Coding Francois Edouard Boisson Guillaume 10902 Vieron Jerome Bottreau Vincent Guillemot Christine Evaluation of Motion accuracy scalability - SVC Core experiment 1a 10903 Boisson Guillaume Improvements of SVC CfP S18 proposal Vincent Bottreau Christine Guillemot 10904 Rashid Ansari Edouard Francois SVC Technical Contribution to CE1b: Spatial Transform using Three Lifting Steps 10905 Alexandre Cotarmanac'h Vladimir Levantovsky Proposal to amend ISO/IEC 14496-1:2004 10906 A. G. Tescher for USNB USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21 10907 A. G. Tescher for USNB USNB Contribution: Response to Munich resolution 2.2.3 10908 A. G. Tescher for USNB USNB Contribution: "Fidelity Range Extensions" name change 10909 A. G. Tescher for USNB USNB Contribution: Response to Munich resolution 2.2.2 10910 A. G. Tescher for USNB USNB Contribution: The need for additional levels for Visual SP 10911 A. G. Tescher for USNB USNB Contribution: Suggested corrigendum to 13818-1:2000 10912 A. G. Tescher for USNB Proposed conversion of OpenType to an ISO/IEC standard 10913 A. G. Tescher for USNB USNB Contribution: ISO/IEC 14496-17/FCD concerns 10914 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-9 10915 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3:2001/PDAM 6 10916 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-6:2003/FPDAM 1 29 10917 JTC 1 Secretariat Summary of Voting on ISO/IEC TR 15938-8/DAM 1 10918 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 6 10919 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-10:2003/FPDAM 1 10920 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 4 10921 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 5 10922 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 2 10923 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 8 10924 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/FPDAM 3 10925 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-5:2003/FPDAM 2 10926 SC 29 Secretariat Summary of Voting on ISO/IEC FCD 15938-10 10927 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-12/FPDAM 1 & 15444-12/FPDAM 1 10928 Wook-Joong Kim Euee. S. Jang Consideration on the MAF for omni-directional AV 10929 Ulrich Fecker Andre Kaup Transposed Picture Ordering for Dynamic Light Field Coding 10930 Vladimir Levantovsky 10931 Ulrich Benzler Mathias Wien 10932 Ulrich Benzler 10933 Karol Wnukowicz Wladyslaw Skarbek Han-Kuang Hsu Chia-Yang Tsai 10934 Hsiang-Cheh Huang Hsueh-Ming Hang Tihao Chiang Proposal for amendment of ISO/IEC 14496-14 Results of SVC CE3 (Quality Evaluation) Discussion on requirements and applications for Scalable Video Coding Dominant Color Temperature Descriptor Response to CE1b in SVC-- SB-Reach Method for Entropy Coding 10935 Vittorio Baroncini Tobias Oelbaum A Multimedia material Visual quality ranking procedure based on Single or Multiple Viewing 10936 Alain Mignot Pierre Garneau Simplification of AFX/SolidRep node 10937 Patrick Gioia Jérôme Royan Proposal for multiresolution urban representation 10938 Robert O'Callaghan Miroslaw Bober Preliminary Results on Situation/View-Based Clustering Hendry Munchurl Kim Keunsoo Park 10939 Eva Rodriguez Torres Jaime Delgado CE report for Core Experiment on DIBOs for REL 10940 Peter van Beek MPEG-7 User Description Profile Update 10941 Sachin Deshpande HTTP Agent-Driven Content Negotiation for Scalable Video Coding 10942 Shane Lauf Ian S Burnett Mobile MPEG-21 browser implementation 30 Zhang Hu Sun Lifeng 10943 Yang Shiqiang Cheng Xiaoyu Results for EE3 on evaluation of MAC for stereoscopic video coding 10944 AUNB AUNB Comments on MPEG-A CD J. J. Chae J. H. Nam 10945 B. J. Kim J. W. Hong Comments of the proposed document M10865 10946 Takahiro Kimoto Yoshihiro Miyamoto Response to SVC Core Experiment 1d. Introduction of a Base-Layer Sang-Kyun Kim Seungji Yang 10947 Yong Man Ro Ji-Yeun Kim Consideration on the clustering evaluation method for situation/view based photo clustering experiment (VCE-1) Sang-Kyun Kim Seungji Yang 10948 Yong Man Ro Ji-Yeun Kim CE Report for situation/view based photo clustering experiment (VCE-1) Sang-Kyun Kim Seungji Yang 10949 Yong Man Ro Ji-Yeun Kim GT set proposed for situation/view based photo clustering experiment (VCE1) Sang-Kyun Kim Seungji Yang 10950 Yong Man Ro Ji-Yeun Kim Consideration on the photo categorization scheme (VCE-2) Sang-Kyun Kim Seungji Yang 10951 Yong Man Ro Ji-Yeun Kim Model set and GT set for the photo categorization experiment (VCE-2) Sun Lifeng Yang Shiqiang 10952 Cheng Xiaoyu Li Fang Consideration on Quality Measure for Multiview Video Sang-Kyun Kim Seungji Yang 10953 Yong Man Ro Ji-Yeun Kim Consideration of face based photo clustering and retrieval 10954 Tamer Mohamed Wael Badawy Multiple IP-Core Hardware-Accelerated Software System 10955 Akio Yamada Sang-Kyun Kim MPEG-7 Visual XM Document version 20.1 10956 Akio Yamada Sang-Kyun Kim WD 1.1 of MPEG-7 New Visual Extensions 10957 Myriam Amielh Final CE report on MPEG-21 Media Locator 10958 Yoshihiro Miyamoto Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition 10959 Jung Kyunheon Kim Interframe adaptive spatial transform 10960 Wo Chang Update M7ITB Testbed and Available Tools for MPEG-7 Bitstreams 31 Repository 10961 Wo Chang Schuyler Quackenbush MAF Reference Software Workplan Proposal 10962 Wo Chang MAF File Format Proposal Myriam Amielh Ernest Wan 10963 Gerrard Drury Ian Burnett Proposed DIBO for playing a Fragment 10964 AUNB AUNB Contribution: A DIBO for playing a DID fragment 10965 Euee S. Jang Ja Kim Euee S. Jang Lee 10966 Cho Lee On the status of 3D Mesh Compression in MPEG-4 Initial thoughts on VCTR activity 10967 Euee S. Jang Asai AHG on MPEG VCTR 10968 Noboru Harada Yongshan Yu Proposal of CE for improved floating-point compression in ALS (Audio Lossless Coding) 10969 Yutaka Kamamoto Noboru Harada Proposal of CE on Multi channel extension for ALS (Audio Lossless Coding) 10970 Li Fang Test Incomplete 3D Synthesis Method for Multiview Video Christian Timmerer 10971 on behalf of the Austrian NB ANB comments on 21000-2 CD 2nd Edition Christian Timmerer 10972 on behalf of the Austrian NB ANB comments on 21000-8 CD Christian Timmerer 10973 on behalf of the Austrian NB ANB comments on 21000-10 CD Christian Timmerer Stephen Davis 10974 Itaru Kaneko Spencer Cheng Robbie De Sutter Report of CE on MPEG-21 Binarisation 10975 Hideaki Kimata Masaki Kitahara Anchor bitstreams for experiments on multiple view video coding (3DAV) 10976 Hideaki Kimata Masaki Kitahara Preliminary results on multiple view video coding (3DAV) 10977 Soo-Jun Park Myung Gil Jang Cross verification of Model set and GT set for the photo categorization experiment (VCE-2) 10978 Christian Timmerer Hermann Hellwagner Comments on DIA AMD1 WDv2 10979 Soo-Jun Park Myung Gil Jang Cross verification of GT set proposed for situation/view based photo clustering experiment (VCE-1) 10980 Soo-Jun Park Myung Gil Jang Cross verification reprot of situation/view based photo clustering experiment (VCE-1) 32 10981 Soo-Jun Park Myung Gil Jang Yesun Joung Won-Sik Cheong 10982 Jihun Cha Kyuheon Kim Young-Kwon Lim Dataset of VCE-1 and 2 Comments on LASeR Harmonization with SVG 10983 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-5:2001/FDAM 4 [SC 29 N 6078] 10984 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 14496-5:2001/FDAM 5 [SC 29 N 6079] 10985 OMA via SC 29 Secretariat Liaison Statement from the Open Mobile Alliance (OMA) [SC 29 N 6121] 10986 Soo-Jun Park Chee Sun Won A proposal for a hierarchical grouping of digital photos CE Julien Reichel 10987 Guillaume Baud Francesco Ziliani Responses of CE1e in SVC: Adaptive update step in MCTF Diego Santa Cruz 10988 Julien Reichel Francesco Ziliani Responses of CE1d: Base-Layer 10989 Francesco Ziliani Summary of responces to Ce1d: Inroduction of a Baser Layer Ji Ming 10990 Huang Zhongyang Taka Senoh Suggestions on the scope of MPEG-21 IPMP Standardization 10991 LEE SgNB Comment on the Lossless Audio Coding Work 10992 SC 37 Liaison Officer Liaison Statement from SC 37 Biometrics Pateux 10993 Amonou Kervadec A generic framework for MCTF-based coding 10994 Helge Drumm CE - Shadow: Preliminary Results on Reference Software Implementation Pateux 10995 Amonou Kervadec France Telecom Requirements for Scalable Video Coding Ingo Wolf Bernhard Feiten Teodora Guenkova-Luy 10996 Andreas Schorr Franz Hauck Andreas J. Kassler MPEG-21 DIA based delivery using SDPng and RTP Ihor Kirenko 10997 Rene van der Vleuten Fons Bruls Flexible Scalable Video Compression Gero Bäse 10998 Andreas Hutter Peter Amon Requirements for a scalable video coding standard 10999 Jean-Claude Dufourd Olivier Avaro Zhongyang Huang 11000 Ming Ji Shengmei Shen Comments on LASeR and SVG Metadata protection in ISO Base File Format Amendment 33 Taka Senoh 11001 Heiko Purnhagen Werner Oomen CT/Philips contribution to CfP on spatial audio coding 11002 James Ingram Position Paper on the SMR Draft Call for Proposals Itaru Kaneko (Tokyo Polytechnic University) 11003 Mark Callow (HI Corporation) Comments on MPEG-4 part 21 MPEG-J extension forrendering 11004 Ray Taylor MPEG-7 Systems extensions, TVAnytime indexing core experiments 11005 Martin Link Subjective results formal verification test MPEG4-Ext2. (Parametric) 11006 Adam Lindsay ID3v2 Tags in MPEG-A 11007 Kate Grant for UKNB UKNB position on patent statements 11008 Kristofer Kjörling New profile proposal combining HE-AAC and Parametric Stereo Per Ekstrand 11009 Andreas Schneider Kristofer Kjörling Proposed additions to Sbr conformance testing 11010 Konstantin Hanke SVC CE1e - Verification of Visiowave Results on Adaptive Update Step in MCTF 11011 Konstantin Hanke Response to SVC CE1e - Spatial Highpass Transition Filtering 11012 DANAE Consortium Licensing status of software in SVC standardization 11013 Chris Barlas ISO/IEC 21000-6 COR/1 WD v.1 Editor's Input 11014 Masayuki Tanimoto Toshiaki Fujii Utilization of inter-view correlation for multiple view video coding Naoya Tanaka 11015 Kok-Seng Chong Kazuhiro Iida Technical Description and Performance Test Results of Panasonic Spatial Audio Coding Joeri Barbarien Adrian Munteanu Yiannis Andreopoulos 11016 Fabio Verdicchio Jan Cornelis Peter Schelkens Prediction-based scalable motion vector coding Thomas Wedi Teruhiko Suzuki Yoshihisa Yamada Takuya Imaide 11017 Tom McMahon Stijn de Waele Byeong-Moon Jeon Stephen Gordon Norio Ito Definition of a 4:2:0 / 8-bit Profile for H.264/AVC FRExt 11018 Eunmi Oh Miyoung Kim Paolo Nesi Giorgio Zoia 11019 Pierfrancesco Bellini Jerome Barthelemy Proposed changes in MPEG-4 BSAC multi-channel audio coding Draft Evaluation Criteria for Assessing SMR Proposals 34 James Ingram David Crombie 11020 Thomas Wedi Verification of HHI Results for Core Experiments on AVC-Based Scalable Video Coding Paolo Nesi Pierfrancesco Bellini 11021 Jerome Barthelemy James Ingram Neil McKenzie Examples of matching SMR aspects and available technologies Giorgio Zoia Pierfrancesco Bellini 11022 Jerome Barthelemy Paolo Nesi Mikael Bourges-Sevenier Graphic functionality in MPEG-4 and Symbolic Music Representation 11023 Masanori SANO Some thoughts on MPEG-7 Profiling 11024 Masanori SANO MPEG-7 Core Description Profile Update Paolo Nesi Giorgio Zoia 11025 James Ingram Piefrancesco Bellini Study on Draft CfP on Symbolic Music Representation JungHoe Kim 11026 SangWook Kim Eunmi Oh Comments on MPEG-4 BSAC Conformance 11027 van der Meer Inputs on study text of timed text FCD (part 17) 11028 Juergen Schmidt Oliver Baum Study Text of ISO/IEC 14496-11/2003 FPDAM-3 11029 Juergen Schmidt Klaus Eilts-Grimm Simple Integration Reference Software for MPEG-4 AudioBIFS, version 3 11030 Mariam Kimiaei Asadi Jean-claude Dufourd Possible missing features in MPEG-21 DIA 11031 Karsten Müller Aljoscha Smolic View-Dependent Multi-Texturing for MPEG-4 AFX, Syntax and Se-mantics Specification Update 11032 John R. Smith Alan Melby CE Results on Addressing Scheme for MPEG-21 using MPEG-7 Media Locators 11033 Matthias Gruhne Jan Rohden Proposed Core Experiment on Audio Rhythm Patterns Joerg Heuer Andreas Hutter 11034 Andrea Kofler-Vogt Harald Kosch 11035 Werner Oomen Heiko Purnhagen CE-Report on Evaluations of the Siemens Index System Proposed corrigenda to AMD2, (parametric) Joerg Heuer Andreas Hutter 11036 Andrea Kofler-Vogt Harald Kosch Stream Reordering for Fast Random Access 11037 Werner Oomen Complementary information to Formal verification test parametric 11038 Stephan Würmlin Christopher Lee Results on Reference Software Implementation on Point based Rendering for MPEG-4 AFX 35 Matthias Zwicker Michael Waschbüsch Markus Gross Hanspeter Pfister 11039 Leszek Cieplinski Soroush Ghanbari Preliminary Results of SVC CE1c 11040 Mathias Wien CE2.4 Adaptive Spatial Transforms: Verification of HHI results Joseph Meehan Minhua Zhou 11041 Jennifer Webb Felix Fernandes MPEG4 Simple-Profile Level 4 and 5 Proposal 11042 Woo-Jin Han Verification of SAIT results for SVC on CE1a Motion Scalability Heiko Schwarz 11043 Detlev Marpe Thomas Wiegand SVC Core Experiment 2.1: Inter-layer prediction of motion and residual data Detlev Marpe Thomas Wiegand SVC Core Experiment 2.1: Inter-layer prediction of motion and residual data 11044 Y. Andreopoulos A. Munteanu 11045 M. van der Schaar J. Cornelis P. Schelkens Comparison Between t+2D and 2D+t Architectures with Advanced Motion Compensated Temporal Filtering Alexandru Salomie Adrian Munteanu 11046 Rudi Deklerck Peter Schelkens Proposal for the XMT-A specifications for MeshGrid 11047 Woo-Jin Han Sang-Chang Cha Heiko Schwarz 11048 Detlev Marpe Thomas Wiegand 11049 Woo-Jin Han Ho-Jin Ha Verification of OES/ITRI results for SVC on CE1c Intra Prediction SVC Core Experiment 2.2: Influence of the update step on the coding efficiency Verification of VisioWave results for SVC on CE1d Base Layer Woo-Jin Han 11050 Sang-Chang Cha Jae-Young Lee Verification of MSRA results for SVC on CE1e Deblocking Heiko Schwarz 11051 Detlev Marpe Thomas Wiegand SVC Core Experiment 2.3: Spatial interpolation Heiko Schwarz 11052 Detlev Marpe Thomas Wiegand SVC Core Experiment 2.4: Adaptive Spatial Transforms Woo-Jin Han 11053 Ho-Jin Ha Bae-Keun Lee Responses of SVC CE1a Motion Scalability; Interpolated motion layer 11054 Woo-Jin Han Sang-Chang Cha Responses of SVC CE1c Intra Predictionl; Pixel-interpolated prediction 11055 Woo-Jin Han Ho-Jin Ha Responses of SVC CE1d Base Layer; R-D optimized base-layering 36 Woo-Jin Han 11056 Sang-Chang Cha Jae-Young Lee Responses of SVC CE1e Deblocking; In-loop prediction smoothing 11057 Jean-Claude Dufourd FNB comment on LASeR Rongshan Yu Xiao Lin 11058 Susanto Rahardja Haibin Huang Proposed WD3 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS) 11059 Rongshan Yu Crosscheck on FhG’s Proposed Core Experiment for MPEG-4 Audio Scalable to Lossless (SLS) Coding 11060 Tilman Liebchen Verification Report on MPEG-4 ALS Core Experiment 5 (Coding of LPC Coefficients) 11061 Tilman Liebchen Yuriy A. Reznik Proposed Text of ISO/IEC 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS) Rongshan Yu Susanto Rahardja 11062 Xiao Lin Haibin Huang Reduce Complexity for MPEG-4 Audio Scalable Lossless (SLS) Coding 11063 Tilman Liebchen Proposed Core Experiment on Higher Predictor Orders in MPEG-4 ALS Andrew Tokmakoff Youngjoo Song 11064 Kyunghee Ji Senator Jeong CE-Report on MPEG-21 Event Reporting 11065 Schuyler Quackenbush DRAFT Procedures for the Evaluation of Spatial Audio Coding Systems Marius Preda 11066 Françoise Preteux Olivier Marre Morphing Appearances Julien Reichel 11067 Francesco Ziliani Jean Claude Michelou Requirements for Scalable Video Coding for Video Surveillance Applications 11068 Marius Preda Francoise Preteux Textual BBA 11069 Vatis Jörn Ostermann Verification of HHI Results for Core Experiment on Scalable Video Coding 11070 Vatis Jörn Ostermann verification of HHI results for core experiment on scalible video coding 11071 Ralph Sperschneider Problem with buffer fullness derivation in the case of number_of_raw_data_blocks_in_frame>0 and protection_absent=0 11072 Ralph Sperschneider Status on MPEG-4 Audio Conformance 11073 Ralph Sperschneider Proposed ISO/IEC 14496-3:2004 (Audio 3rd Edition) Davide Maestroni 11074 Marco Tagliasacchi Stefano Tubaro Responses of CE1d in SVC: Base Layer Juergen Herre Christof Faller 11075 C. Spenger J. Hilpert K. Linzmeier Fraunhofer/Agere Submission to Spatial Audio CfP 11076 Juergen Herre Evaluation of Spatial Audio Coding Schemes 37 Thomas DeMartini 11077 Herbert Van de Sompel Jeroen Bekaert Status of mpegRA activity 11078 Ralf Geiger Proposed WD4 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable Lossless Coding (SLS) 11079 Ralf Geiger Juergen Herre On the Performance of MPEG-4 SLS RM4 11080 S. Quackenbush H. Purnhagen Description of Audio Codec Behavior Jeroen Bekaert Frederik De Keukelaere 11081 Herbert Van de Sompel Rik Van de Walle Requirement for MPEG-21 DID 11082 French National Body FNB Position on SVC Standardization 11083 Michael Good Response to Draft Call for Proposals N6457 Gregoire Pau Beatrice Pesquet-Popescu 11084 Mihaela van der Schaar Jerome Vieron Delay-Performance Trade-Offs in Motion-Compensated Scalable Subband Video Compression 11085 Gregoire Pau Beatrice Pesquet-Popescu Cross-verification of RWTH results on SVC CE-1e Christian Timmerer Klaus Leopold 11086 Dietmar Jannach Hermann Hellwagner Contribution to DIA AMD1 WDv2 Joerg Heuer 11087 Gabriel Panis Andreas Hutter Considerations for efficient Resource Adaptation based on MPEG-21 DIA 11088 Charith Abhayaratne SVC Core Experiment CE1b - Summary 11089 Matt Fellers Proposed Test Items for MPEG Spatial Audio Coding Matt Fellers Mark Vinton 11090 Mark Davis Grant Davidson Dolby Laboratories Submission to CfP on MPEG-4 Spatial Audio Coding Debargha Mukherjee 11091 Huisheng Wang Sam Liu On BSD Transformation Instructions - Streaming Implementation and updates Daniel Larkin Valentin Muresan Noel E. O'Connor 11092 Noel Murphy Seán Marlow Alan Smeaton Hardware Acceleration Module for MPEG-4 binary shape coding motion estimation 11093 Eric Gsell FRExt Extended Bit Depth Characterization 11094 Walter Gish Hyung-Suk Kim FRExt Bit Depth Interoperability 11095 Diego Santa Cruz Yukihiro Bandoh Cross-verification of results for SVC on CE1d 38 11096 Thomas Rusert Mathias Wien Multi-Layered Motion Estimation with Constrained Enhancement (SVC CE1a) 11097 Ali Tabatabai Rohit Puri Multiple description coding for generalized layering Blaszak 11098 Domanski Lange 11099 Rafal Lange Marek Domanski Results in SVC CE2: mode selection and spatial upsampling Response to SVC CE2 tasks: inter-layer motion information prediction Deepak Turaga 11100 Ali Tabatabai Minh Do Multiresolution Representation of Motion Information for Scalable Video Coding Lukasz Blaszak Marek Domanski 11101 Rafal Lange Adam Luczak Response to SVC CE2 tasks: testing of SNR scalability technologies 11102 FNB FNB Position Paper on MPEG applications, context and objectives 11103 Alexandre Cotarmanac'h Updated software for SL extension Valentin Muresan Daniel Larkin 11104 Andrew Kinane Noel O’Connor Status of CDVP's contribution to MPEG-4 Part 9 - Implementation Study Group 11105 Hiroshi Yasuda Takuyo Kogure Digital Cinema QOS and Conformance Justin Ridge Per Fröjdh 11106 Jonathan Teh Woo-Jin Han Mobile communications industry comments on SVC requirements Justin Ridge Marta Karczewicz 11107 Yiliang Bao Shawn Wang Extension to AVC-based scalable video coding 11108 Justin Ridge Comment regarding SVC software selection 11109 Mikael Bourges-Sevenier Update of XMT-A and MPEG-J standards 11110 Gerrard Drury Ian Burnett Comments on Identification of DID a Document 11111 Mikael Bourges-Sevenier Vishy Swaminathan Considerations for MPEG-J extensions for rendering 11112 Yuriy A. Reznik 11113 Gerrard Drury Ian Burnett Verification Report on MPEG-4 ALS Core Experiment 4 (Coding of Random Access Frames) Response to Comments on DIP CD 11114 Yuriy A. Reznik Proposed CE on Additional Enhancements for Lossless Audio Coding 11115 Wo Chang Testing 11116 BD Founders via SC 29 Secretariat 11117 Chun-Jen Tsai Liaison Statement from Blu Ray Disk Founders Scalable Multimedia Streaming Test Bed for Media Coding and Testing in 39 Chung-Neng Wang Chih-Hung Li Yin-Tzu Shih Chen-Wei Fan Jien-Peng Ho Streaming Environments 11118 Myriam Amielh Issues relating to the use of URI Fragment Identifiers in MPEG-21 Hsin-Hao Chen 11119 Guo-Zua Wu Yi-Jung Wang Responses of CE1c in SVC: Exploiting the Spatial Correlation within the Low-Pass Frames 11120 Edouard Francois Thomas Rusert CE1a : cross verification of MSRA proposal 11121 John R. Smith Alan K. Melby Revised Logical Media Locator for MPEG-7 & MPEG-21 11122 Giovanni Cordara CE1a: TILAB-PdM solution 11123 Ji Jizheng Xu Verification of NCTU results for SVC on CE1b, entropy coding 11124 Xiong Jizheng Xu Verification of TILAB/PdM results for SVC on CE1a 11125 Song Jizheng Xu Verification of SUMSUNG results for SVC on CE1c 11126 Xiong Jizheng Xu Feng Wu Spatial Scalability in 3D Wavelet Coding with Spatial Domain MCTF Encoder 11127 Ji Jizheng Xu Debin Zhao Feng Wu Responses of CE1d in SVC: Base layer 11128 Xiong Jizheng Xu Feng Wu Responses of CE1a in SVC: Scalable Motion 11129 Song Jizheng Xu Hongkai Responses of CE1e in SVC: Adaptive update based on human vision system Xiong Feng Wu 11130 Zhang Jizheng Xu Hongkai Sub-pixel phase over-complete sub-band transform Xiong Feng Wu Zang Wenpeng Ding 11131 Jizheng Xu Hanqin Lu Feng Wu Responses of CE1b in SVC: Direction prediction for spatial transform Chen Jae Hoon Kim 11132 Joaquín López Antonio Ortega Illumination compensation for inter view Multi View Video Compression 11133 Guillemot, Liebl, Stockhammer, Jenkac Discussion on requirements and applications of Scalable Video Coding for MBMS 11134 Jeremie Farret Olivier Bellis Solid implementation into IM1 Chen Jae Hoon Kim 11135 Joaquín López and Antonio Ortega Anchor encoding results for the ST and Aquarium multi view sequences 11136 Feng Pan Yin Sun SVC CE1e - Verification of MSRA Results on MCTF adaptation in the temporal update step 11137 Joohee Kim Hyeyeon Kim Responses to SVC CE1a: scalable motion information coding 11138 HsinHao Chen Verification Report of Samsung results for SVC on CE1c: Intra-prediction 11139 Giovanni Cordara CE1a : cross verification of Samsung proposal 40 11140 Han-Kuang Hsu Hsueh-Ming Hang Verification of MSRA results for SVC on CE1b, entropy coding 41 Annex 4 Output document list No. 6481 6482 6483 6484 6485 6486 6487 6488 6489 6490 6491 6492 6493 6494 6495 6496 6497 6498 6499 Source Convener Convener Convener Convener Convener Convener Convener HoD HoD Requirements Requirements Requirements Requirements Requirements Video Video Video Video Systems Title List of Documents from the Redmond, USA Meeting Resolutions of the Redmond, USA Meeting List of AHGs Established at the 69th Meeting in Redmond, USA Report of the 68th Meeting in Redmond, USA Guidelines for Electronic Distribution of MPEG and WG 11 Documents Press Release of the 69th Meeting in Redmond, USA Meeting Notice of the 70th Meeting in Palma de Mallorca, ES Guide for WG 11 Meeting Hosts MPEG 101 MPEG-4/2 Profiles under Consideration Study of FCD ISO/IEC 15938-9 Requirements for MPEG-21 IPMP Draft of PDTR for potential second edition of ISO/IEC 21000-11 Call for Evidence for Multi-view Video Coding Request for 14496-2:2004 Amd.2 Text of 14496-2:2004 PDAM2 New Levels in Simple Profile Request for 14496-4:2004 Amd.10 Text of 14496-4:2004 PDAM10 New Levels in Simple Profile Conformance Request for ISO/IEC 14496-20 Lightweight Application Scene Representation and Simple Aggregation Format 6500 Systems Text of ISO/IEC 14496-20 CD Lightweight Application Scene Representation and Simple Aggregation Format 6501 Requirements Requirements for Multi-view Video Coding 6502 Convener AHG on Font Format Representation 6503 Convener AHG on MPEG-21 Integration and Outreach 6504 Convener AHG on MAF 6505 Requirements Requirements for Scalable Video Coding 6506 ISG Updated Call for the Submission of Hardware Reference Code for MPEG-4 Part 9: Reference Hardware Description 6507 ISG Template for MPEG-4 Part 9 HDL module documentation 6508 ISG CVS server user manual and code format specification for MPEG-4 Part-9 submissions and maintenance Rev. 0 6509 ISG Status of HDL submissions and commitments for MPEG-4 Part-9 6510 Convener AHG on MPEG-4 Part 9: Reference Hardware Description Phase 1 and 2. 6511 ISG ISO/IEC FPDAM 15938-6 Information Technology -Multimedia Content Description Interface- part 6: Reference Software Extensions 6512 ISG DoC of ISO/IEC PDAM 15938-6 Information Technology -Multimedia Content Description Interface- part 6: Reference Software Extensions 6513 Testing Results of the visual assesment of the results of the CEs on Scalable Video Coding Technology 6514 Video MPEG-4 Visual: List of Problems Reported version 13.0 6515 Video WD 2.0 of 14496-4 Visual Bitstreams Conformance Corrigendum 6516 Video WD 2.0 of MPEG-7 New Visual Extensions 42 6517 6518 6519 6520 6521 6522 6523 Video Video Video Video Video Video Convener MPEG-7 Visual XM Document version 21.0 Description of Core Experiments for MPEG-7 New Visual Extensions WD 1.0 of ISO/IEC 21000-13 Scalable Video Coding Scalable Video Model Version 2.0 Description of Core Experiments in MPEG-21 Scalable Video Coding Study of Video Coding Tools Repository AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance 6524 Convener AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software 6525 Convener AHG on Description Tools for New Visual Extensions 6526 Convener AHG on Core Experiments in Scalable Video Coding 6527 Convener AHG on Scalable Video Model and SVC Reference Software 6528 Convener AHG on 3DAV Coding 6529 Convener AHG on Video Coding Tools Repository 6530 Requirements M3W Requirements 6531 Convener AHG on M3W 6532 JVT Disposition of NB Ballot Comments on ISO/IEC 14496 4/FPDAM6 AVC Conformance 6533 JVT Text of ISO/IEC 14496-4/FDAM6 AVC Conformance 6534 JVT Text of ISO/IEC 14496-4/PDAM9 AVC Fidelity Range Extensions Conformance 6535 JVT Disposition of NB Ballot Comments on ISO/IEC 14496 5/FPDAM6 AVC and HE AAC Reference Software 6536 JVT Text of ISO/IEC 14496 5/FPDAM6 AVC and HE AAC Reference Software 6537 JVT Text of ISO/IEC 14496-5/PDAM8 AVC Fidelity Range Extensions Reference Software 6538 JVT Disposition of NB Ballot Comments on ISO/IEC 14496 10/FPDAM1 AVC Professional Extensions 6539 JVT Text of ISO/IEC 14496 10/FDAM1 AVC Fidelity Range Extensions 6540 JVT Text of ISO/IEC 14496 10 Advanced Video Coding 3rd Edition 6541 JVT Request for Corrigendum for ISO/IEC 14496-10 Advanced Video Coding 6542 JVT Working Draft 1 of Corrigendum for ISO/IEC 14496-10 Advanced Video Coding 6543 SNHC AFX Reference software FPDAM7 6544 SNHC ISO/IEC 14496-16/PDAM1 6545 SNHC ISO/IEC 14496-16/DCOR1 6546 SNHC AFX CE description 6547 SNHC AFX VM 15.0 6548 SNHC SNHC FAQ 12.0 6549 SNHC ISO/IEC 14496-21 WD 1.0 6550 Requirements Summary of font format standardization activities in WG11 6551 Liaison Liaison Statement to the Digital Media Project 6552 Liaison Liaison Statement to the DCCSDP 6553 Liaison Liaison Statement to the OMA 6554 Liaison Liaison Statement to JTC 1/SC 37 6555 Liaison Liaison Statement to ITU-T SG 17 6556 Liaison Liaison Statement to ITU-R SG 6/WP 6M 6557 Liaison Liaison Statement to W3C on MPEG Timed Text specification 43 6558 6559 6560 6561 Liaison Liaison Liaison Liaison 6562 6563 6564 6565 6566 6567 6568 6569 6570 6571 6572 6573 6574 Liaison Liaison Liaison Liaison Liaison Liaison Liaison Liaison Liaison Liaison SNHC JVT JVT 6575 JVT 6576 JVT 6577 JVT 6578 JVT 6579 JVT 6580 JVT 6581 JVT 6582 6583 6584 6585 6586 6587 6588 6589 6590 6591 6592 6593 6594 6595 6596 6597 6598 6599 Systems Systems Systems Systems Systems Systems Systems Systems Systems Systems Systems Systems Systems Systems Systems Systems Systems Systems Liaison Statement to Blu Ray Disk Founders Liaison Statement to IEEE LTSC Liaison Statement to SMPTE on OpenType® and ISO/IEC 14496-18 Liaison Statement to W3C on Public Workshop on Metadata for Content Adaptation Liaison Statement to VCEG Liaison Statement to TVAF Liaison Statement to JSR-239 Liaison Statement to IEC TC 100 Liaison Statement to SMPTE on Alpha Channel and AVC/H.264 Frext Statement of benefits from establishing a class C liaison with the DMP Statement of benefits from establishing a class C liaison with the DCCSDP Statement of benefits from establishing a class C liaison with the OMA Responses to NB Comments List of WG11 Liaisons Request for ISO/IEC 14496-16/AMD1 Liaison statement to ATSC on ISO/IEC 14496 10 FRExt amendment work Liaison statement to AVS China on ISO/IEC 14496 10 FRExt amendment work Liaison statement to DVB on ISO/IEC 14496 10 FRExt amendment work Liaison statement to DVD Forum on ISO/IEC 14496 10 FRExt amendment work Liaison statement to EBU on ISO/IEC 14496 10 FRExt amendment work Liaison statement to IMTC on ISO/IEC 14496 10 FRExt amendment work Liaison statement to ITU-R SG 6 on ISO/IEC 14496 10 FRExt amendment work Liaison statement to ITU-T SG 9 on ISO/IEC 14496 10 FRExt amendment work Liaison statement to MPEGIF on ISO/IEC 14496 10 FRExt amendment work Text of ISO/IEC 13818-1:2000/DCOR3 Study Text of ISO/IEC 13818-1:2000/FPDAM4 DoC on ISO/IEC 13818-1:2000/FPDAM5 Text of ISO/IEC 13818-1:2000/FDAM5 DoC on ISO/IEC 14496-1/DCOR3 Text of ISO/IEC 14496-1/COR3 Request of ISO/IEC 14496-1:2004 Amd.1 Text of ISO/IEC 14496-1:2004/PDAM1 DoC on ISO/IEC 14496-11/FPDAM3 Text of ISO/IEC 14496-11/FDAM3 DoC on ISO/IEC 14496-11/PDAM4 Text of ISO/IEC 14496-11/FPDAM4 Text of ISO/IEC 14496-11/COR2 Study Text of DoC on ISO/IEC 14496-12/FPDAM1 Study Text of ISO/IEC 14496-12/FPDAM1 Study Text of DoC on ISO/IEC 14496-17/FCD Study Text of ISO/IEC 14496-17/FCD Core Experiment on LASeR Binary Representation 44 6600 6601 6602 6603 6604 6605 6606 6607 6608 6609 6610 6611 6612 6613 6614 6615 6616 6617 6618 6619 6620 6621 6622 Convener Convener Convener Convener Convener Convener Systems Systems Systems Systems Systems Systems Systems Systems Convener Convener Integration Integration Integration Integration Integration Integration Integration 6623 6624 6625 6626 6627 6628 6629 Integration Integration Integration Integration Integration Integration Integration 6630 6631 6632 6633 6634 6635 6636 6637 6638 6639 6640 6641 6642 6643 6644 6645 Integration Convener Convener MDS MDS MDS MDS MDS MDS MDS MDS MDS MDS MDS MDS MDS Terms of Reference MPEG Standards Table of unpublished standards at FDIS level Work plan and time line Work item assignment List of patent statements received Core Experiment on LASeR Harmonization with SVG WD1.0 of ISO/IEC 14496-20 Reference Software Core Experiments for Systems Extensions MPEG-7 Systems reference software workplan DoC on ISO/IEC 21000-9/CD Text of ISO/IEC 21000-9/FCD Technology under consideration for 21000-9 Text of ISO/IEC 21000-16/CD AHG on XML Structure Binarization and Streaming AHG on Scene Representation ISO/IEC13818-4/FDAM1 IPMP Conformance Ext. DoC on ISO/IEC13818-4:200X/FPDAM2 Audio Conformance Ext. ISO/IEC13818-4:2004/FDAM2 Audio Conformance Ext. DoC on ISO/IEC 13818-5/PDTR IPMP Reference Software Ext. ISO/IEC 13818-5/Dam1 IPMP Reference Software Ext ISO/IEC 13818-5:1997/Amd1:1999/COR2 DoC on ISO/IEC 14496-4/FPDAM8 HE-AAC, ABIFS and SA Conformance ISO/IEC 14496-4/FDAM8 HE-AAC, ABIFS and SA Conformance DoC on ISO/IEC13818-4/FPDAM1 IPMP Conformance Ext DoC on ISO/IEC 14496-5/FPDAM7 AFX reference software ISO/IEC 14496-5/FDAM7 AFX reference software DoC on ISO/IEC 21000-8/CD MPEG-21 reference software ISO/IEC 21000-8/FCD MPEG-21 reference software DoC on ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource Delivery ISO/IEC 21000-12/DTR Test Bed for MPEG-21 Resource Delivery AHG on the Communicating MPEG to the business Community AHG on MPEG 101 DoC on ISO/IEC 15938-5 FPDAM/2 ISO/IEC 15938-5 FDAM/2 “MDS User Preference Extensions” DoC on ISO/IEC 15938-5 DCOR/1 ISO/IEC 15938-5 COR/1 DoC on ISO/IEC 15938-7 FPDAM/1 ISO/IEC 15938-7 FDAM/1 DoC on ISO/IEC 15938-10 FCD ISO/IEC 15938-10 FDIS “Schema Definition” DoC on 21000-2 CD 2nd Edition – Digital Item Declaration ISO/IEC 21000-2 DID 2nd Edition FCD Status of Registration Authority for DII ISO/IEC 21000-4 WD v.1 “IPMP” MPEG-21 REL/RDD Software Implementation Plan v.7 45 6646 6647 6648 6649 6650 6651 6652 MDS MDS MDS MDS MDS MDS MDS 6653 6654 6655 6656 6657 6658 6659 6660 6661 6662 6663 6664 6665 6666 6667 6668 6669 6670 6671 6672 6673 6674 MDS MDS MDS MDS Convener Convener Convener Convener Convener Convener Convener Convener Convener Convener Convener Convener Audio Audio Audio Audio Audio Audio 6675 Audio 6676 Audio 6677 6678 6679 6680 6681 6682 6683 6684 6685 6686 6687 6688 6689 6690 Audio Audio Audio Audio Audio Audio Audio Audio Audio Audio Audio Audio Audio Audio ISO/IEC 21000-6 DCOR/1 MPEG-21 DIA PDAM/1 “Conversions and Permissions” ISO/IEC 21000-7 COR/1 WD v.1 MPEG-21 DIA Software Implementation Plan v.8 Workplan for Core Experiment on Text Capabilities of Terminals Workplan for Core Experiment on Conversion Parameters Workplan for Core Experiment on Bitstream Adaptation in Constrained and Streaming Environments DoC on ISO/IEC 21000-10 CD ISO/IEC 21000-10 FCD “Digital Item Processing” MPEG-21 DIP Software Implementation Plan v.3 ISO/IEC 21000-15 WD v.2 “Event Reporting” AHG on Media Locators AHG on MPEG-21 IPMP AHG on MPEG-21 DIA AHG on MPEG-21 DIP AHG on MPEG-21 Event Reporting AHG on AFX documents, CEs, and software AHG on MPEG-J extensions for rendering AHG on Audio Standard Maintenance AHG on Spatial Audio Coding AHG on MPEG-4 Lossless Audio Coding AHG on Symbolic Music Representation AHG On Exploration of Scalable Audio and Speech Coding Text of 13818-7:2004/DCOR 1 “AAC ADTS buffer fullness correction” DoC on 14496-3:2001/FPDAM 3, MPEG-1/2 Audio in MPEG-4 Text of 14496-3:2001/FDAM 3, MPEG-1/2 Audio in MPEG-4 Text of 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS) Text of 14496-3:2001/PDAM 5, Scalable Lossless Coding (SLS) Text of 14496-3:2001/FPDAM 6, Lossless coding of 1-bit oversampled signals Formal Verification Report on MPEG-4 Parametric Audio Coding Status of Performance and Complexity of MPEG Lossless Audio Coding Architectures Proposed 3rd Edition of 14496-3 Study on High-Sampling Rate for MPEG-1/2 Layer III Proposed Enhancements to MPEG-4 BSAC multi-channel Workplan for Audio Lossless Coding (ALS) Workplan for Scalable Lossless Coding (SLS) Timestamps and Audio Codec Behavior Status of MPEG-4 Audio Conformance Proposed New Audio Conformance Bitstreams for BSAC Workplan for Audio Rhythmic Pattern Application Formats Framework DoC on 23001-1:200X CD, “Player Application Format” Text of 23001-1:200X FCD, “Player Application Format” Call for Proposals for Symbolic Music Representation DRAFT SMR Evaluation Procedure 46 6691 6692 6693 6694 6695 6696 6697 Audio Convener Convener HoD JVT Convener Audio Workplan for the Evaluation of Spatial Audio Coding Responses AHG on MPEG-7 Interoperability and Profiling MPEG Items Completed MPEG General Audio Codecs Liaison statement to SCTE on ISO/IEC14496 10 FRExt amendment work AHG on MPEG-7 Audio Request for Subdivision to ISO/IEC 23000-1 47 Annex 5 Report of Requirements meeting Source: Rob Koenen, InterTrust Technologies NB: this report does not duplicate the resolutions, but rather complements them. This implies that not all output documents and not all Ad Hoc Groups are explicitly listed in the report below. 9:00-13:00 13:30-14:30 Monday opening plenary meeting Lunch (ends one hour after plenary ends) MPEG-21 Technical Reports – Requirements Plenary Summary of Voting on ISO/IEC DTR 21000-1 (2nd Edition) - JTC 1 Secretariat Summary of Voting on ISO/IEC DTR 21000-11 [SC 29 N 6102] - JTC 1 Secretariat Video Extension to Evaluation Tools for PATs - Jong-Tae Kim, et,.al. The Composition of Test Video Sequences for Evaluation of the robustness of Digital Video Watermarking - Ik-Hwan Cho, Hae Kwang Kim, Weon-Geun Oh, Dong-Seok Jeong 10895 Transaction Watermarking Model for PAT - Won-Young Yoo, et.al. Joint with JVT 10867 AVC FRExt Level Requirements for D-Cinema and High Quality […] - Tom McMahon 15:30-16:30 11017 Definition of a 4:2:0 / 8-bit Profile for H.264/AVC FRExt - Thomas Wedi, et.al. 11116 Liaison Statement from Blu Ray Disk Founders - BD Founders via SC 29 IPMP Responses and Associated Submissions – Joint with MDS and Systems Transfer of the work from Requirements to standards development 10813 Overview of responses to Call for Proposals for 21 IPMP - Niels Rump, Simon Watt 10860 Response to CfP for 21 IPMP - Ian S Burnett, Gerrard Drury 10865 Answer to CfPs for 21 IPMP - J. J. Chae, J. Nam, B. J. Kim, J. W. Hong 10866 The DRM Framework for Large-scale Broadcast - Bin Li, et.al. 10945 Comments of the proposed document M10865 - J. J. Chae et.al. 10850 ENTHRONE answer to the Call for Proposal for 21 IPMP - Serrao, Kudumakis 10858 IPMP_Scheme Descriptor and its Processing for DI Protection – ZY Huang et.al. 17:00-18:00 10990 Suggestions on the scope of 21 IPMP Standardization - Ji Ming, e.al. 10832 DMAG answer to 21 IPMP Call for Proposals - Eva Rodriguez, et.a. 10839 Answer to […]: Medialiving technology - Melanie Dulong de Rosnay, e.al. 10854 MOSES and ENTHRONE answer to the 21 IPMP CfP - Panos Kudumakis , et.al. 10855 Answer […]: A Right Description Model on Resource Combinations - Hendry, e.al. 10856 Answer […] An IPMP Description Tool for Partial Encryption of DI’s - Jeongyeon Lim, et.al. 10857 Answer to the CfP on 21 IPMP : REL DIBOs in 21 DIP for 21 IPMP - Hendry, et.al. 10862 Answer to the CfP on 21 IPMP - Craig Schultz 10876 10887 10885 14:30-15:30 10886 11041 10910 10822 09:00-11:00 10901 10995 10998 11067 11106 10932 11082 Tuesday MPEG-4 Visual Profiles, joint with Video MPEG4 Simple-Profile Level 4 and 5 Proposal - Joseph Meehan, e.al. USNB Contribution: The need for additional levels for Visual SP - USNB SVC Requirements – Joint with Video Scalable Video Coding Requirements for Video Surveillance Systems - Robert Prandolini THOMSON requirements for Scalable Video Coding - Francois Edouard, Vieron Jerome France Telecom Requirements for Scalable Video Coding - Pateux, Amonou, Kervadec Requirements for a scalable video coding standard - Bäse, Hutter, Amon Requirements for SVC for Video Surveillance Applications - Reichel, et.el. Mobile communications industry comments on SVC requirements - Justin Ridge, et.al. Discussion on requirements and applications for Scalable Video Coding - Ulrich Benzler FNB Position on SVC Standardization - French National Body 48 Lassen Cascad e Lassen Kodiak MAF – joint with Systems, Audio, Video, MDS 10762 AHG on Multimedia Application Format (MAF) - Wo Chang, Olivier Avaro 11:00-11:45 10961 MAF Reference Software Workplan Proposal - Wo Chang, Schuyler Quackenbush 10962 MAF File Format Proposal - Wo Chang MAF Requirements Joint with Audio 11:45-12:45 10906 USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21 - USNB 13:00-14:00 Lunch Joint with Systems 10893 SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18 - Wendy Aylsworth, 14:00-15:00 et.al. 10912 Proposed conversion of OpenType to an ISO/IEC standard - A. G. Tescher for USNB MPEG-21 Requirements – joint with MDS (and Systems for the Binarization) 10774 Requirement for 21 Binarization - Thomas DeMartini 10848 Application Specific Binary Coding (ASBC) of 21 descriptors for better coding efficiency maintaining interoperability to regular 21 decoder - Itaru Kaneko et.al. (briefly) 15:00-16:30 10807 Relationship between Digital Items and Digital Item Declarations - Niels Rump, Chris Barlas 10892 Identification of a DIDL Document - Bekaert, DeMartini, Van de Walle, Van de Sompel 11110 Comments on Identification of DID a Document - Gerrard Drury, Ian Burnett 11081 Requirement for 21 DID - Bekaert, De Keukelaere, Van de Sompel, Van de Walle MPEG-21 Joint with Integration, MDS 16:30-17:00 10869 21 Integration and Outreach - Chris Barlas, et.al. 10874 Improving 21 IPMP Conformance - Experience from 2/4 IPMPX – Spencer Cheng, et.al. 17:00-18:00 Review of IPMP work (joint with MDS?) Wednesday 09:00Plenary meeting 11:00 MPEG-7 Profiles etc. – joint with MDS, others 10763 AHG on 7 Profiles - Wo Chang, Akio Yamada, Alan Melby 10940 7 User Description Profile Update - Peter van Beek 11:30-13:00 10960 Update M7ITB Testbed and Available Tools for 7 Bitstreams Repository - Wo Chang 11023 Some thoughts on 7 Profiling - Masanori SANO 11024 7 Core Description Profile Update - Masanori SANO 11147 Liaison Statement from IEEE-LTSC - IEEE-LTSC 13:00-14:00 Lunch 14:00-14:30 M3W – Joint with Systems 10900 Contribution to MPEG Multimedia Middleware Requirements v.1.0 - Jean H.A.Gelissen Audio Audio Lassen Lassen Lassen Lassen Lassen Lassen 14:30-16:30 Joint with MDS on MPEG-21 IPMP Progress 10861 Response […]: Reference Model for IPMP Assessment - Sang-Hoon Oh, et.al. 17:00 - later Social Event 16:30-17:00 Thursday OpenType as MPEG spec – joint with Systems Persistent Association Technologies, 3DAV, SVC and – joint with Video 09:30-11:00 (Final?) Approval of SVC Requirements Document (Final?) Approval of 3DAV Requirements Document 11:00-12:00 OpenType as MPEG spec – joint with Systems 09:00-09:15 12:30-13:00 13:00-14:00 Joint with JVT on FRExt Profiles (Naming and Levels) Lassen Museum Lassen Kodiak Lassen Cascad e Lunch Symbolic Music Representation – joint with Audio Approval of CfP MAF Joint Meeting with Audio, Video, MDS, Systems (and Wo) 14:30-15:30 MAF FCD MAF Requirements Document? 15:30-16:45 Approval of Study of MPEG-7 Profiles FCD 14:00-14:30 49 Lassen Lassen Lassen Friday Concluding 09:00-10:00 12:30-14:00 14:00-22:10 SVC Requirements – Ulrich Benzler MPEG-4/2 Profiles under Consideration – Kristofer Kjörling M3W Requirements - Jean Gelissen MPEG-21 IPMP Requirements document – Brad Lunch Plenary meeting 50 Lassen Audito MPEG-4 Part 2: Adding Levels 4a and 5 to Simple Visual Profile 11041 MPEG4 Simple-Profile Level 4 and 5 Proposal - Joseph Meehan, e.al. 10910 USNB Contribution: The need for additional levels for Visual SP - USNB Levels like these are already used in industry, without being based on an actual MPEG-defined conformance point. They extend the range of Simple Visual Profile to higher bitrates and resolutions. Adding them to MPEG-4 Visual as compliance points is a good idea. Enough support was shown from industry in m11041. Level 4a is slightly different than 4 in Advanced Simple because VGA resolution is the target. The Video group will start an Amendment. Need to produce and cross-check the bitstreams: TI, Sarnoff, VBrick, Xilinx committed to doing this work. It was agreed that Advanced Simple @ Lx decoder should be able to decode Simple @Lx bitstreams to keep that part of the hierarchy. Part 3: New Audio Profile? A request was put forward in a joint meeting with Audio for the definition of a new MPEG-4 Audio profile that combines AAC, SBR and Parametric Stereo tools. The proposed profile was added to the Profiles under Consideration document (N6490), and the requirements Group asked for support in a resolution. Part 10: AVC FRExt Profiles (Joint discussions with JVT) 11017 Definition of a 4:2:0 / 8-bit Profile for H.264/AVC FRExt - Thomas Wedi, et al. 11116 Liaison Statement from Blu Ray Disk Founders - BD Founders via SC 29 Secretariat 10867 AVC FRExt Level Requirements for D-Cinema and High Quality […] - Tom McMahon The 4:2:2/8 profile was dropped. Several proposals were discussed for merging two profiles into one, possible addressing some factors in the Level definitions, but that approach was rejected. In the end, the following profiles were defined, with their names: 4:2:0/8 bit: High 4:2:0/10: High 10 4:2:2/10: High 4:2:2 4:4:4/12: High 4:4:4 Part 18 (?): OpenType as MPEG-4 part? 10893 SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18 - Wendy Aylsworth, et.al. 10912 Proposed conversion of OpenType to an ISO/IEC standard - A. G. Tescher for USNB OpenType was selected a technology in the past, and met the requirements. At that point it could only be referenced by MPEG because necessary copyrights were not released to ISO for producing and ISO standard. Copyright. There is now a new desire to have this as a formal ISO standard. It is understood that MPEG usually does not rubberstamp external specifications, and also in this case a process would be followed starting with the past assessment in MPEG on font representation technology. There is a requirement to that this new part of the MPEG-4 standard do not break any references, when such references to OpenType are replaced by references to this MPEG-4 part (applies to both MPEG and non-MPEG standards). 51 An assessment (N6440) was written that summarizes the past work and lists past recommendations and conclusions. The new work would start from the past efforts. MPEG-7 10763 10940 10960 11023 11024 AHG on 7 Profiles - Wo Chang, Akio Yamada, Alan Melby 7 User Description Profile Update - Peter van Beek Update M7ITB Testbed and Available Tools for 7 Bitstreams Repository - Wo Chang Some thoughts on 7 Profiling - Masanori SANO 7 Core Description Profile Update - Masanori SANO A study of FCD (N6491) was created that corrects some inconsistencies in the FCD. It also clarified the difference between description profiling and systems profiling: description Profiles collect restrictions on the pure declarative XML. Systems Profiles collect restrictions on what will actually happen to them if they are binarized, transmitted, stored, etc. 11147 Liaison Statement from IEEE-LTSC - IEEE-LTSC MPEG looks forward to receiving the mapping of metadata as described in this liaison contribution. MPEG-21 Part 2: ID for DID document? 10807 Relationship between Digital Items and Digital Item Declarations - Niels Rump, Chris Barlas 10892 Identification of a DIDL Document - Bekaert, DeMartini, Van de Walle, Van de Sompel 11110 Comments on Identification of DID a Document - Gerrard Drury, Ian Burnett The issue of having an ID for a DID document was resolved. The resolution is detailed in the MDS report. Part 4: MPEG-21 IPMP 10813 10860 10865 10866 10945 10850 10858 10990 10832 10839 10854 10855 10856 10857 10862 Overview of responses to Call for Proposals for 21 IPMP - Niels Rump, Simon Watt Response to CfP for 21 IPMP - Ian S Burnett, Gerrard Drury Answer to CfPs for 21 IPMP - J. J. Chae, J. Nam, B. J. Kim, J. W. Hong The DRM Framework for Large-scale Broadcast - Bin Li, et.al. Comments of the proposed document M10865 - J. J. Chae et.al. ENTHRONE answer to the Call for Proposal for 21 IPMP - Serrao, Kudumakis IPMP_Scheme Descriptor and its Processing for DI Protection – ZY Huang et.al. Suggestions on the scope of 21 IPMP Standardization - Ji Ming, e.al. DMAG answer to 21 IPMP Call for Proposals - Eva Rodriguez, et.a. Answer to […]: Medialiving technology - Melanie Dulong de Rosnay, e.al. MOSES and ENTHRONE answer to the 21 IPMP CfP - Panos Kudumakis , et.al. Answer […]: A Right Description Model on Resource Combinations - Hendry, e.al. Answer […] An IPMP Description Tool for Partial Encryption of DI’s - Jeongyeon Lim, et.al. Answer to the CfP on 21 IPMP : REL DIBOs in 21 DIP for 21 IPMP - Hendry, et.al. Answer to the CfP on 21 IPMP - Craig Schultz The MPEG-21 IPMP work was transferred to the MDS group. With relevant experts, this group started to look at integration, analyzing simple uses. That work will continue in an AHG meeting. Please see the MDS report for details. 10861 Response […]: Reference Model for IPMP Assessment - Sang-Hoon Oh, et.al. What was presented in this contribution would not be applicable to the current evaluation of proposals, but could become something along the lines of the PAT Technical Report, but now for IPMP tools. The group decided that more clarity on the nature of MPEG-21 IPMP was needed before the merit of the proposal could be discussed, 52 10874 Improving 21 IPMP Conformance - Experience from 2/4 IPMPX - Spencer Cheng, et.al. Contribution presented interesting tools. Again, the group wanted to first see more clarity on what MPEG-21 IPMP is before making/discussing more concrete proposals. Part 11: Persistent Association Technologies 10876 Summary of Voting on ISO/IEC DTR 21000-1 (2nd Edition) - JTC 1 Secretariat 10887 Summary of Voting on ISO/IEC DTR 21000-11 [SC 29 N 6102] - JTC 1 Secretariat Technical Reports of part 1 and 11 were approved as there were no comments in the respective ballots; both will now be published. 10885 Video Extension to Evaluation Tools for PATs - Jong-Tae Kim, et,.al. This contribution proposes to extend PAT with Video-specific information. See below for the discussion. 10886 The Composition of Test Video Sequences for Evaluation of the robustness of Digital Video Watermarking - IkHwan Cho, Hae Kwang Kim, Weon-Geun Oh, Dong-Seok Jeong Contribution suggests adapting choice of sequences for to watermarking techniques? Inclusion of recommendations on sequences seems a good idea. Individual sequences could be included or referenced depending on their copyright. 10895 Transaction Watermarking Model for PAT - Won-Young Yoo, et.al. No reference model for transactional watermarking yet in the PAT Technical Report (this is also called ‘active fingerprinting’). This was considered a good use case for both audio and video. The contribution provides test parameters for Video transactional watermarks After hearing these contributions, the group discussed extending the PAT work towards video, as had been the original intention. The requirements Group thinks this is a good idea, and it could be done in a second edition if there are enough experts to complete the task. In a joint meeting with Video, this was discussed, and some support was given. The group decided to start the work in an AHG – but the AHG was unfortunately never approved in the final MPEG plenary due to an oversight (the work is now going to be done and contributed to the next meeting by individual MPEG members). A proposal for a Working Draft for a 2nd edition was approved (N6493) At next meeting, we will assess the support for the activity and decide future actions. Part 13: SVC 10822 10901 10995 10998 11067 11106 10932 Scalable Video Coding Requirements for Video Surveillance Systems - Robert Prandolini THOMSON requirements for Scalable Video Coding - Francois Edouard, Vieron Jerome France Telecom Requirements for Scalable Video Coding - Pateux, Amonou, Kervadec Requirements for a scalable video coding standard - Bäse, Hutter, Amon Requirements for SVC for Video Surveillance Applications - Reichel, et.el. Mobile communications industry comments on SVC requirements - Justin Ridge, et.al. Discussion on requirements and applications for Scalable Video Coding - Ulrich Benzler There were many requirements contributions, which is a positive sign indicating interest for the work. Together, these present an analysis of requirements from the different viewpoints of various industries. The break-out group analyzed the requirements and derived an overall prioritization, denoted by ‘shall’, ‘should’, and ‘may’. There were some conflicting requirements; scalability was seen as more important to some than to others. The mobile industry seems to be ready to use it if it exists, but only if it doesn’t compromise efficiency. The surveillance industry seems to be willing to take some decrease in coding efficiency in return for scalability. A table was added to the Requirements Document (N6505) that summarizes the requirements from different constituencies. 53 Wording was added to stress that different industries have different priorities, and that the codec will ideally accommodate these requirements as different modes. 10853 Finnish NB comment: SVC requirements and directions - Mauri Väänänen Finnish NB presented a contribution on requirements. It requests AVC as a base layer and calls attention to the importance of low delay (both are now adequately reflected in the Requirements Document) and remarks that some scenarios are unrealistic, but fails to mention which exactly. 11082 FNB Position on SVC Standardization - French National Body The French NB calls for the work not to be delayed. The meeting confirmed there are no plans to delay the work. Binarization Tuesday 20 July 2004, 15:05 (Binarization) 10774 Requirement for 21 Binarization - Thomas DeMartini Requirement that (de)binarization process is neutral with respect to canonicalization was added to requirements document (N6492) 10848 Application Specific Binary Coding (ASBC) of 21 descriptors for better coding efficiency It was suggested that this could be done using DIXO’s. MDS will study and revisit the request if this not the case 11081 Requirement for 21 DID - Bekaert, De Keukelaere, Van de Sompel, Van de Walle The requirement was changed to 4.2.4.3 Support expressing the equivalence (including bit-equivalence) of Media resources in an unambiguous and interoperable way and accepted in the MPEG-21 Requirements Document. MPEG-21 Outreach 10869 21 Integration and Outreach - Chris Barlas, et.al. The perception among some outside of MPEG (and even some insiders) is that “MPEG-21 is complicated set of specifications”. This work should mitigate that impression by mapping concrete MPEG-21 technologies on actual business practices. The activity would then explain how the different elements can be integrated to suit the needs of a particular industry. The group thought this was an excellent idea. It was decided to start with the motion pictures industries in an AHG. MAF (MPEG-A) 10762 AHG on Multimedia Application Format (MAF) - Wo Chang, Olivier Avaro 10961 MAF Reference Software Workplan Proposal - Wo Chang, Schuyler Quackenbush 10962 MAF File Format Proposal - Wo Chang MAF Requirements The MAF’s are going to FCD at this meeting. We had a discussion on which file format to use, together with Systems, Video and Audio groups. It was decided that the ISO file format, with .mp4 extension, would be most appropriate. The file could contain MPEG-21 specific data and MPEG-4 players without knowledge of MPEG-21 would be able to understand that this is data they don’t understand – and to skip it. It was noted that play lists are more elegantly and compactly done in MPEG-21 than in MPEG-7. A remaining question is whether the MPEG-21 data should be XML or binary or if both would be allowed. 54 Explorations Scalable Audio Coding 10906 USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21 - USNB A proposal for a new work item for scalable audio coding contained different elements. The discussion focused on whether this work would concentrate on: Scalable coding, or Generic Coding, harmonizing Speech and Audio, or both simultaneously Applications would include multicast scenarios, with truncation at points of replication, and applications that don’t know in advance what the source is going to be. Uses cases need to be developed and the desirable compression efficiency, functionality and other benchmarks need to be documented. Comparisons to the state of the art would be included in a requirement study. It was considered too early to issue any public Call for Information at this meeting. MPEG should first get an internal understanding on the goal and merits of such a new work item before inviting external comments., 3DAV A preliminary Call for Evidence (N6494) was approved and issued for Multiview Video Coding. The accompanying requirements (N6501), extracted from the general 3DA requirements, were approved as well. Symbolic Music Representation The Requirements group reviewed and approved the Call for Proposals for Symbolic Music Representation, edited by the Audio Group. The evaluation procedure was still draft, and was therefore put into a separate document. M3W A new version of the requirements document was approved (N6530). It is worth noting that requirements were added for the management of multimedia resources. 55 Annex 6 Report of Systems meeting Source: Title: Editor: Systems Chair and Break-out group Chairs Systems Meeting Report Olivier Avaro (France Telecom R&D) Contributors: Olivier Avaro (France Telecom R&D), Claude Seyrat (Expway), Oliver Baum (Fraunhofer IIS), David Singer (Apple) Overview The main outputs of the meeting from the Systems Sub-group perspective are: No. 6582 6583 6584 6585 6586 6587 6588 6589 6590 6591 6592 6593 6594 6595 6596 6597 6598 6499 6500 6599 6606 6607 Title 13818-1:2000/DCOR.3 Correction for Field Picture Text of ISO/IEC 13818-1:2000/DCOR3 13818-1:2000/Amd.4 Metadata Application Format CP Study Text of ISO/IEC 13818-1:2000/FPDAM4 13818-1:2000/Amd.5 New Audio P&L Signaling DoC on ISO/IEC 13818-1:2000/FPDAM5 Text of ISO/IEC 13818-1:2000/FDAM5 14496-1 :2003/Cor Items for Corrections DoC on ISO/IEC 14496-1/DCOR3 Text of ISO/IEC 14496-1/COR3 14496-1 :2003/Amd.1 Text Profile Descriptor Request of ISO/IEC 14496-1:2004 Amd.1 Text of ISO/IEC 14496-1:2004/PDAM1 14496-11 :2003/Amd.3 Audio BIFS Extensions DoC on ISO/IEC 14496-11/FPDAM3 Text of ISO/IEC 14496-11/FDAM3 14496-11:2003/Amd.4 XMT and MPEG-J Extensions DoC on ISO/IEC 14496-11/PDAM4 Text of ISO/IEC 14496-11/FPDAM4 Text of ISO/IEC 14496-11/COR2 14496-12:2003/Amd.1 ISO File Format Extensions Study Text of DoC on ISO/IEC 14496-12/FPDAM1 Study Text of ISO/IEC 14496-12/FPDAM1 14496-17 Streaming Text Format Study Text of DoC on ISO/IEC 14496-17/FCD Study Text of ISO/IEC 14496-17/FCD 14496-20 LASeR Request of ISO/IEC 14496-20 Text of ISO/IEC 14496-20/CD Core Experiment on LASeR Binary Representation Core Experiment on LASeR Harmonization with SVG WD1.0 of ISO/IEC 14496-20 Reference Software 56 TBP Available No 04/07/23 No 04/07/23 No No 04/07/23 04/07/23 No No 04/07/23 04/07/23 No No 04/07/23 04/07/23 No No 04/07/23 04/07/23 No No No 04/07/23 04/08/13 04/07/23 No No 04/07/23 04/07/30 No No 04/07/23 04/07/30 No No No No No 04/07/23 04/07/23 04/07/23 04/07/23 04/07/23 6608 6609 6610 6611 6612 6613 6530 15938-1 Systems Core Experiments for Systems Extensions MPEG-7 Systems reference software workplan 21000-9 MPEG-21 File Format DoC on ISO/IEC 21000-9/CD Text of ISO/IEC 21000-9/FCD Technology under consideration for 21000-9 21000-16 MPEG-21 Binary Format Text of ISO/IEC 21000-16/CD Explorations and Support Requirements on the MPEG Multimedia Middleware No No 04/07/23 04/07/23 No No No 04/07/23 04/07/30 04/07/30 No 04/07/23 No 04/07/23 General issues General The meeting report from München has been approved. List of standards under development Pr 2 Pt 1 2 4 4 1 1 11 4 4 17 20 21 21 9 16 Edit. Project Description CfP 2000 Amd.4 Metadata Application Format CP 2000 Cor.3 Correction for Field Picture 2004 Amd.1 Text Profile Descriptors 2003 Amd.4 XMT and MPEG-J Extensions 2003 1st Ed. Streaming Text Format 2004 1st Ed. Lightweight Application 04/03 Scene st 200x 1 Ed. File Format 200x 1st Ed. Binary Format WD CD FCD FDIS 03/10 04/03 04/10 04/07 04/10 04/07 05/01 05/07 03/10 03/12 04/07 05/01 03/03 03/07 03/12 04/10 04/07 04/10 05/03 03/12 04/03 04/07 05/01 04/03 04/07 04/10 05/03 Standing Documents Pr Pt Documents No. Meeting 4 13 MPEG IPMP Extensions Overview N6338 04/03 München 21 xx MPEG Multimedia Middleware Context and Objectives N6335 04/03 München Demonstrations None. FAQ The FAQ were updated as needed. 57 AOB None. 58 MPEG-2 Systems (13818-1) 13818-1:2000 Amd.4 Topics 1. ISAN and VISAN Signaling. Contributions M10920: Document not available. In addition, WG11 received feed-back from its members that client bodies for this technology were preparing a thorough review of the current document. In order to benefit from this important feed-back and because there were no opposition, it is decided to delay the progression of this specification until the next meeting. Technical Work in Progress. 13818-1:2000 Amd.5 Topics 1. 2. New Audio Profile and Level Indication; Audio_Type Table split for ISO reserved and User Private Contributions M10921: See DoC and Text of Amd. Technical Work Finalized. 13818-1:2000 Cor. 3 Topics 1. Correction on Field Picture Contributions M10911: USNB Contribution: Suggested corrigendum to 13818-1:2000 related to MPEG-2 field pictures. Suggestion accepted and corrigendum started. Technical Work in Progress. MPEG-2 Exploratory Activities Topics M10907: USNB Contribution: Response to Munich resolution 2.2.3. on the consideration of the potential for definition of a form of ISO/IEC 13818-1 (MPEG-2 Systems) operation in which the PCR requirement is relaxed. Concern regarding potential interoperability problems that could be caused by the relaxation of the PCR requirement (or the creation of a separate profile or similar domain-specific difference in MPEG-2 TS requirements for this purpose). Suggestion to use of the "Private Stream" feature (preferably with registration of the Private Stream type) to support the desired functionality, as the MPEG-2 TS PCR is optional for such streams. Noted. 59 MPEG-4 Systems (14496-1) 14496-1:2003 Cor. 3 M10844 : Summary of Voting on ISO/IEC 14496-1:2001/DCOR 3. GNB comment. Already taken into account in 3rd Ed (considered as editorial). Technical Work Finalized. 14496-1:2003 Amd.1 M10905: Proposal to amend ISO/IEC 14496-1:2004. Proposition accepted. Production of request of CD and CD. Technical Work in Progress. 60 MPEG-4 Scene Description (14496-11) 14496-11:2003 Cor. 2 Topics 1. Miscellaneous Corrigenda Item. Contributions M10845: No comment. Promotion to Cor. Technical Work Finalized. 14496-11:2003 Amd.3 Topics 1. 2. 3. 4. Advanced Audio Buffer Node; AudioChannelConfig; Pre-defined effects using ExterProto; Support for Ambisonic. Contributions M10924, M11028: See DoC and Text of FDAM. M11029: See Integration report. Technical Work Finalized. 14496-11:2003 Amd.4 Topics 1. 2. XMT Extensions; MPEG-J Extensions. Contributions M11109: Update of XMT-A and MPEG-J standards. Proposed re-organization of the XMT-A schema to facilitate maintenance of the specification. Accepted. Proposed updates of MPEG-J APIs. Accepted. Note that it would be good to have the template of the nodes made publicly available. Decision to make it available on the CVS under MPEG-4 Systems 2 as well as the executable that generates the various Systems documentation (Mikael). M10881: KNB comment on 14496-11/PDAM4 (XMT & MPEG-J Extensions). M10787: See DoC and Text of FPDAM. Technical Work in Progress. 61 ISO File Format (14496-12) 14496-12:2003 Amd.1 Topics 1. 2. Support for Static Metadata; Support for IPMP at the File Format Level. Contributions M10927, M10872, M1100: See DoC and Text of FDAM. Considered NB Comments from Sweden, Finland, UK, US, Singapore on 14496-12, prepared DoCR, FDAM in one week. Request approval for the FDAM and a second edition now, contingent on (1) no more NB comments being received and (2) on the FDAM ballot passing. M10930: Proposal for amendment of ISO/IEC 14496-14. Not needed. Registration will be done through the RA. Technical Work Finalized. 62 Streaming Text (14496-17) Topics 1. Coded Representation of Text Stream. Contributions M10913: USNB Contribution: ISO/IEC 14496-17/FCD concerns. Refers to comments made in M10838. See disposition of comments. M10803, M10838: W3C Comments on the MPEG Timed Text specification, Summary of Voting on ISO/IEC FCD 14496-17. See disposition of comments. M11027: Inputs on study text of timed text FCD (part 17). Taken into account in the production of Study text. Technical Work in Progress. 63 Font Compression and Streaming (14496-18) Exploratory Activities Topics 1. OpenType Standardization Contributions M10893, M10912: SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18 and USNB. Proposed conversion of OpenType to an ISO/IEC standard. OpenType was already selected in response to the Call on Font Format Representation and Compression. OpenType was used as an external normative reference. Agreement that OpenType can be standardized if due process is followed. The technology already fit in the scope of the previous Call on Font Representation. Owners of the OpenType solutions shall propose it as an input contribution with appropriate copyright statement. Technical Work in Progress. 64 LASeR (14496-20) Topics 1. Lightweight Application Scene Representation Contributions M10812, M10814, M10815, M10816, M10817, M10818, M10819, M10820: Answers to the CfP on LASeR and SAF. All answers were processed at the Paris meeting and reviewed during the AHG in Redmond as well as in the Systems subgroup. Results of this evaluation process is reflected in M10836 (Report of the LASeR evaluation meeting ), M10833 (Proposed WD 0.1 of ISO/IEC 14496-20, LASeR and SAF), M10834 (Proposed Draft Core Experiment on LASeR Harmonization with SVG), M10835 (Proposed Draft Core Experiment on LASeR Binary Representation) and M10837 (LASeR software). M10884: Proposal on SL-compliant SAF packet headers. This contribution was discussed and used to harmonized the draft WD as much as possible with 14496-1. Results of this discussion is reflected in the LASeR CD. M10982, M10999: Comments on LASeR Harmonization with SVG. Comments on LASeR and SVG. Used to progress the harmonization process with SVG. M11057: FNB comment on LASeR. Noted. The LASeR specification progressed as planned and the WD1.0 was promoted to CD. Technical Work in Progress. 65 MPEG-7 Systems (15938-1) General Joint meeting about MPEG-7 profile M11023: Some thoughts on MPEG-7 Profiling: Some very first proposal about MPEG-7 Systems profiles and levels have been proposed: - levels: AU size, AU granularity, AU synchronization with the media. - Profiles: exclusive use of TeM and BiM, joint use of BiM and TeM. M11004: MPEG-7 Systems extensions, TVAnytime indexing core experiments: Adapt TVAnytime indexing solution to B-Tree indexing and evaluate options (index size and performance). Use the extended test set. The contribution shows that index list and B-tree indexes have complementary usage mostly dependent on application usage. Therefore the contribution recommends not dropping Index list in favour of B-Tree. Contribution m11004 is adopted as a base for a first draft which is included a core experiment about indexing. A core experiments is set up to evaluate the integration within the MPEG-7 Systems framework and to clarify use cases covered by this technology. M11034: CE-Report on Evaluations of the Siemens Index System: The contribution presents results of the core experiments related to indexing BiM bitstreams. M11036: Stream Reordering for Fast Random Access: The contribution presents possible improvements of the indexing framework to provide more random access functionalities. Further work on this item is welcome. Technical Work in Progress. 66 MPEG-21 File Format (21000-9) 21000-9 Topics 1. MPEG-21 File Format Contributions M10914, M10852: Considered NB Comments from US, Korea on 21000-9, prepared DoCR, FCD available in a week. Request NBs to look at the technologies under consideration. Given ongoing work on new tools in MPEG-21 such as IPMP, and Event Reporting, should the file format be delayed in case this work affects it? Or should it proceed on schedule as we expect little or no impact, or the delay would be unacceptable? The ad-hoc recommends proceeding. Systems like the secretariat to be asked to include 14496-12 second edition (see below) with any purchase of 21000-9. See Systems res. Realized, with MDS, that we need a URL fragment syntax for ISO-family files, would like contributions on requirements and solutions. We adjusted the fragment syntax for MPEG-21 files, to leave 'space' for this work. These fragments (the part after a "#" in a URL) might include stream selection, time selection, sub-scene or object selection, selection based on meta-data, and so on. The current file format (Part 12) allows meta-data boxes within (and thus attached to) presentations (moov box) and streams (trak box). This is appropriate for meta-data attached to media-data. It also allows a meta-box at file level when the meta-box contains the primary entry point into the file, such as an MPEG-21 DID. MPEG-7 is currently allowed in all three places. Is there, however, meaning to MPEG-7 meta-data that is not attached to media data? Allowing this effectively defines an MPEG-7 packaged file format, which perhaps is not desired. Technical Work in Progress. 67 MPEG-21 Binary Format (21000-16) 21000-16 Topics 1. Binarization of MPEG-21 Data Contributions M10774: Requirement for MPEG-21 Binarization. Contribution about schema canonicalization requirements. This requirement is already satisfied by BiM. Accepted. based M10848: Application Specific Binary Coding (ASBC) of MPEG-21 descriptors for better coding efficiency maintaining interoperability to regular MPEG-21 decoder: The contribution proposes to use specific schema within the MPEG-21 framework assuming that mapping with MPEG-21 schemas is available. Further work is expected within DIP to understand the applicability of this proposal in MPEG-21. Application specific coding should be evaluated in relation with MPEG-21 DIP. M10974: Report of CE on MPEG-21 Binarisation. This contribution presents the results of the MPEG-21 binarization. Significant testset has been gathered and binarization tests conducted. Several bugs have been identified. Technical Work in Progress. 68 Multimedia Application Formats (23000) Topics 1. 2. 3. Application specific format framework; Usage of MP3 in MP4 with metadata; Usage of JPEG in MP4 with metadata. Contributions M10961, M10962: See REQ and Audio meting report. Technical Work in Progress. 69 Other Exploratory Activities Multimedia Middleware Topics 1. 2. 3. Use cases; Middleware Architecture; Multimedia APIs. Contributions M10900: Contribution to MPEG Multimedia Middleware Requirements v.1.0. Working session to complete the requirements document with multimedia specific requirements. Requirements updated. Technical Work in Progress. 70 Latest References and Publication Status Pr 2 2 Pt 1 1 ISO/IEC 13818-1/Amd.7 Standard No. Issue 2 2 1 1 ISO/IEC 13818-1:2000/COR1 (FlexMux Descr.) ISO/IEC 13818-1:2000/Amd.1 (Metadata on 2) + COR2 N3844 N5867 2 2 1 1 ISO/IEC 13818-1:2000/Amd.2 (Support for IPMP on 2) ISO/IEC 13818-1:2000/Amd.3 (AVC Carriage on MPEG-2) N5604 N5771 2 1 ISO/IEC 13818-1:2000/Amd.5 (New Audio P&L Sig.) N6585 2 4 4 4 4 4 4 4 4 4 4 4 11 1 1 1 1 1 1 1 1 1 1 1 ISO/IEC 13818-1:2003 (IPMP on 2) ISO/IEC 14496-1 (MPEG-4 Systems 1st Ed.) ISO/IEC 14496-1/Amd.1 (MP4, MPEG-J) ISO/IEC 14496-1/Cor.1 ISO/IEC 14496-1:2001 (MPEG-4 Systems 2nd Ed.) ISO/IEC 14496-1:2001/Amd.1 (Flextime) ISO/IEC 14496-1:2001/Cor.1 ISO/IEC 14496-1:2001/Cor.2 ISO/IEC 14496-1:2001/Amd.2 (Textual Format) ISO/IEC 14496-1:2001/Amd.3 (IPMP Extensions) ISO/IEC 14496-1:2001/Amd.4 (SL Extension) ISO/IEC 14496-1:2001/Amd.7 (AVC on 4) N5607 4 4 1 1 ISO/IEC 14496-1:2001/Amd.8 (ObjectType Code Points) ISO/IEC 14496-1:2001/Cor.3 N6202 N6587 ISO/IEC 13818-1:2000 (MPEG-2 Systems 2nd Edition) 00/12 01/01 Pisa 03/07 Trondheim 03/03 Pattaya 03/07 Trondheim 04/07 Redmond 03/03 Pattaya 01/07/20 02/10/26 02/03 N5976 71 03/10 Brisbanne 03/12 Hawaii 04/07 Redmond Status Published Published Doc. with 2000/12 2000/12 Purpose Published Published 2002/03 2003/12 Published FDAM 2004/03 ITTF FDAM 04/04/26 FDAM ITTF FDAM Ballot Published Published Published Published Published Published FDAM FDAM FDAM FDAM Published FDAM 2003/12 1999/12 2001/11 2001/11 2001/11 2002/10 SC29 SC29 SC29 ITTF 2003/12 SC29 FDAM to be issued FDAM FDAM SC29 SC29 Final Text Editing FDAM Ballot FDAM 04/03/22 ISO/IEC 14496-1 (MPEG-4 Systems 3rd Ed.) 4 1 4 4 4 4 6 8 11 11 ISO/IEC 14496-6:2000 ISO/IEC 14496-8 (MPEG-4 on IP Framework) ISO/IEC 14496-11/Cor.1 (Integrated in 3rd Edition) 4 4 4 11 11 11 ISO/IEC 14496-11/Amd.1 (AFX) ISO/IEC 14496-11/Amd.2 (Advanced Text and Graphics) 4 11 4 12 4 12 ISO/IEC 14496-12 (ISO Base Media File N5295 Format) ISO/IEC 14496-12/Amd.1 ISO FF Extension N6596 4 13 ISO/IEC 14496-13 (IPMP-X) N5284 4 14 ISO/IEC 14496-14 (MP4 File Format) N5298 4 15 ISO/IEC 14496-15 (AVC File Format) N5780 4 18 4 19 7 7 7 7 1 1 1 2 ISO/IEC 14496-18 (Font Compression and N6215 Streaming) ISO/IEC 14496-19 (Synthesized Texture N6217 Stream) ISO/IEC 15938-1 (MPEG-7 Systems) N4285 ISO/IEC 15938-1/Amd.1 (MPEG-7 Systems Extensions) N6326 ISO/IEC 15938-1/Cor.1 (MPEG-7 Systems Corrigedum) N6328 ISO/IEC 15938-2 (MPEG-7 DDL) N4288 ISO/IEC 14496-11 Description) (MPEG-4 N5277 N4712 N6203 Scene N5279 N5480 N6205 ISO/IEC 14496-11/Cor.3 Valuator/AFX related N6594 correction ISO/IEC 14496-11/Amd.3 Audio BIFS Extensions N6591 72 02/10 Shanghai Final Text Editing FDIS SC29 Published FDIS COR FDIS 2000/12 SC29 SC29 SC29 Final Text Editing FDAM FDAM COR Editor Editor Editor Integration in 1st Ed. Integration in 1st Ed. Integration in 1st Ed. FDAM Editor Integration in 1st Ed. IS ITTF FDAM ITTF To be published 03/12 Ballot to be issued FDIS ITTF 2004/01 Published FDIS ITTF Ballot to be issued FDIS ITTF FDIS by 04/05/11 03/12 Hawaii FDIS ITTF FDIS to be issued 01/07 Sydney 04/03 Munich 04/03 Munich 01/07 Sydney Published FDAM COR Published 2002/07 Editor SC29 2002/02 02/03 Jeju 03/12 Hawaii 02/10 Shanghai 02/10 Awaji 03/12 Hawaii 04/07 Redmond 04/07 Redmond 02/10 Shanghai 04/07 Redmond 02/10 Shanghai 02/10 Shanghai 03/07 Trondheim 03/12 Hawaii FDIS 04/04/12 Resolutions of Systems Cf. WG11 resolution. List of reviewed contribution N° Title 10774 Requirement for MPEG-21 Binarization 10787 Summary of Voting on ISO/IEC 14496-11/PDAM 4 IEC CDV 62298-1: Teleweb Application -- Part 1: General 10794 Description [SC 29 N 6016] IEC CDV 62298-2: Teleweb application -- Part 2: Delivery methods 10795 [SC 29 N 6017] 10803 W3C Comments on the MPEG Timed Text specification 10812 10813 10814 10815 10816 10817 10818 10819 10820 10833 10834 10835 10836 10837 10838 10844 10845 10848 10852 10862 10872 10872 10881 10884 10893 Authors Thomas DeMartini SC 29 Secretariat IEC TC 100 via SC 29 Secretariat IEC TC 100 via SC 29 Secretariat Glenn Adams et al. Jean-Claude Dufourd Answer to the CfP on LASeR and SAF: Streamezzo format proposal overview Olivier Avaro Niels Rump Overview of responses to Call for Proposals for MPEG-21 IPMP Simon Watt Answer to Call for Proposal on Lightweight Scene Representation Joerg Heuer et al. Answer to the CfP on LASeR and SAF: Streamezzo LASeR format Jean-Claude Dufourd proposal et al. Answer to the CfP on LASeR and SAF: Streamezzo SAF format Jean-Claude Dufourd proposal et al. Answer to the CfP on LASeR and SAF: Streamezzo Test Set and Jean-Claude Dufourd Executables et al. Answer to the CfP on LASeR and SAF A. Cotarmanach et al. Renaud Cazoulat et Answer to the CfP on LASeR and SAF al. Response to the CfP on LASeR : BiM SVG Profile for LASeR Robin Berjon et al. Jean-Claude Dufourd Proposed WD 0.1 of ISO/IEC 14496-20, LASeR and SAF et al. Proposed Draft Core Experiment on LASeR Harmonization with Olivier Avaro et alii SVG Proposed Draft Core Experiment on LASeR Binary Representation Olivier Avaro et alii Report of the LASeR evaluation meeting Young-Kwon Lim LASeR software Olivier Avaro et alii Summary of Voting on ISO/IEC FCD 14496-17 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-1:2001/DCOR 3 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-11/DCOR 2 SC 29 Secretariat Application Specific Binary Coding (ASBC) of MPEG-21 descriptors for better coding efficiency maintaining interoperability Itaru Kaneko et al. to regular MPEG-21 decoder Proposed Resource Reference Box for addressing a sub-part of a Yongju Cho et al. media resource Answer to the CfP on MPEG-21 IPMP Craig Schultz Finnish NB comments on 14496-12 Amd.1 Ye-Kui Wang Finnish NB comments on 14496-12 Amd.1 Ye-Kui Wang KNB comment on 14496-11/PDAM4 (XMT & MPEG-J Extensions) KNB Proposal on SL-compliant SAF packet headers Young-Kwon Lim SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18 Wendy Aylsworth et 74 10900 Contribution to MPEG Multimedia Middleware Requirements v.1.0 10905 Proposal to amend ISO/IEC 14496-1:2004 10907 USNB Contribution: Response to Munich resolution 2.2.3 10911 USNB Contribution: Suggested corrigendum to 13818-1:2000 10912 Proposed conversion of OpenType to an ISO/IEC standard 10913 USNB Contribution: ISO/IEC 14496-17/FCD concerns al. Jean H.A.Gelissen Alexandre Cotarmanac'h Vladimir Levantovsky A. G. Tescher USNB A. G. Tescher USNB A. G. Tescher USNB A. G. Tescher USNB SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat for for for for Summary of Voting on ISO/IEC CD 21000-9 Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 4 Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 5 Summary of Voting on ISO/IEC 14496-11/FPDAM 3 Summary of Voting on ISO/IEC 14496-12/FPDAM 1 & 15444SC 29 Secretariat 10927 12/FPDAM 1 Vladimir 10930 Proposal for amendment of ISO/IEC 14496-14 Levantovsky Wo Chang Schuyler 10961 MAF Reference Software Workplan Proposal Quackenbush Wo Chang 10962 MAF File Format Proposal Christian Timmerer et 10974 Report of CE on MPEG-21 Binarisation al. Yesun Joung et al. 10982 Comments on LASeR Harmonization with SVG Liaison Statement from the Open Mobile Alliance (OMA) [SC 29 N OMA via SC 29 10985 6121] Secretariat Jean-Claude Dufourd 10999 Comments on LASeR and SVG Olivier Avaro Zhongyang Huang et 11000 Metadata protection in ISO Base File Format Amendment al. 11004 MPEG-7 Systems extensions, TVAnytime indexing core experiments Ray Taylor van der Meer 11027 Inputs on study text of timed text FCD (part 17) Juergen Schmidt 11028 Study Text of ISO/IEC 14496-11/2003 FPDAM-3 Oliver Baum Simple Integration Reference Software for MPEG-4 AudioBIFS, Juergen Schmidt 11029 version 3 Klaus Eilts-Grimm Joerg Heuer et al. 11034 CE-Report on Evaluations of the Siemens Index System Joerg Heuer et al. 11036 Stream Reordering for Fast Random Access Jean-Claude Dufourd 11057 FNB comment on LASeR Mikael Bourges11109 Update of XMT-A and MPEG-J standards Sevenier 10914 10920 10921 10924 75 Annex 7 Report of MDS meeting Contact (MPEG Multimedia Description Schemes Sub-group Chair): John R. Smith IBM T. J. Watson Research Center 19 Skyline Drive Hawthorne, NY 10532 USA jrsmith@watson.ibm.com The MPEG Multimedia Description Schemes (MDS) sub-group’s activities included work items for MPEG-7 and MPEG-21 standards as shown in Figure 1. MPEG-7 v.1: • MDS (FDIS) • Profiles • Schema Def. (FDIS) MPEG-7 v.2: • MDS AMD/2 (FDAM) • MDS Cor/1 (COR) • Conf. Ext. (FDAM) MPEG-21: • DID 2nd Ed (FCD) • REL (“Profiles”) • RDD (COR/1) • DIA AMD/1 (PDAM) • DIP (FCD) • Ref SW (FCD) • Conformance (FCD) • Event Reporting (WD) Figure 1. Overview of MPEG Multimedia Description Schemes Sub-Group work items for 68th Munich meeting. The primary work items for the week included the following: MPEG-7: o MPEG-7 Extensions (Part 5): Review NB comments on MPEG-7 MDS FPDAM/2 MPEG-7 MDS AMD/2 FDAM Review NB comments on MPEG-7 MDS DCOR/1 MPEG-7 MDS COR/1 COR o MPEG-7 Conformance (Part 7): Review NB comments on MPEG-7 Conformance FPDAM/1 AMD/1 (Version 2 bitstreams) FDAM 76 o MPEG-7 Schema Definition (Part 10): Review NB Comments on MPEG-7 Schema Definition FCD MPEG-7 Schema Definition FCD Ed. Proj. Title CfP WD CD Study FCD Study FDIS 2002 Amd.1 Systems extensions 02/03 02/07 02/12 02/03 03/07 2001 1st Ed. Visual Descriptors Version 2 02/05 02/12 03/03 03/07 2001 Amd.1 Extensions (Visual) 01/12 02/05 02/10 03/03 2001 1st Ed. Multimedia Description Schemes 01/12 02/05 02/10 02/07 2002 Amd.1 Multimedia Description Schemes Extensions 01/12 02/05 02/10 03/03 2003 Amd.2 Multimedia Description Schemes Extensions 03/07 03/10 04/03 04/07 04/10 2003 Cor.1 Multimedia Description Schemes 03/12 04/03 04/07 2003 1st Ed. Conformance 02/03 03/07 2004 Amd.1 Conformance Extensions 03/03 03/07 03/12 04/03 04/07 01/07 02/03 2002 1st Ed. Extraction and Use of MPEG-7 Descriptions 2004 1st Ed. Schema Definition 03/07 03/10 03/12 04/03 04/07 04/10 Table 2. MPEG-7 work items for MDS Sub-Group for 69th Meeting. MPEG-21: o MPEG-21 Digital Item Declaration (Part 2): Review NB Comments on MPEG-21 DID CD MPEG-21 DID 2nd Ed FCD o MPEG-21 Rights Data Dictionary MPEG-21 RDD COR/1 DCOR o MPEG-21 Digital Item Adaptation (Part 7): MPEG-21 DIA AMD/1 PDAM o MPEG-21 Reference SW (Part 8): Review NB Comments on MPEG-21 Ref. SW CD MPEG-21 Ref. SW FCD o MPEG-21 Digital Item Processing (Part 10): Review NB comments on MPEG-21 DIP CD MPEG-21 DIP FCD (Study of CD) o MPEG-21 Conformance (Part 14): Review contributions MPEG-21 Conformance CD 77 o MPEG-21 Event Reporting (Part 15): Review CE results on MPEG-21 Event Reporting MPEG-21 Event Reporting WD v.2 Part Ed. Proj. Title CfP WD CD / PDAM Study 01/12 02/05 2 200x 2nd Digital Item Declaration Ed. 03/10 04/03 04/07 05/01 3 2002 1st Ed. Digital Item Identification 01/07 02/07 2 2002 1st Ed. Digital Item Declaration 4 200x 1st Ed. IPMP Framework FCD / FPDAM Study FDIS / FDAM 01/12 02/03 01/07 02/05 02/10 5 200x 1st Ed. Rights Expression Language 01/12 02/07 02/12 03/07 6 200x 1st Ed. Rights Data Dictionary 01/12 02/07 02/12 03/07 02/03 02/05 02/12 03/07 7 200x Amd.1 MPEG-21 DIA AMD/1 WD: DIA Conversions and Permissions 03/12 04/07 04/10 05/03 8 200x 1st Ed. Reference Software 03/03 04/03 04/07 05/01 04/07 05/01 04/10 05/01 6 200x Cor.1 Rights Data Dictionary 7 200x 1st Ed. Digital Item Adaptation 10I 200x 1st Ed. Digital Item Processing 02/12 03/03 03/12 14 200x 1st Ed. Conformance 03/10 04/07 15I 200x 1st Ed. Event Reporting 04/03 04/10 04/03 03/10 03/12 Table 2. MPEG-21 work items for MDS Sub-Group for 69th Meeting. MPEG Multimedia Description Schemes (MDS) Group activities Num. Contributions Agenda, Goals and Issues for the Week for Multimedia Description Schemes (MDS) Sub-Group Agenda, Goals and Issues for the Week for Multimedia Description Schemes (MDS) Group John R. Smith During the kick-off session, the workplan for the week for MPEG-7 and MPEG-21 development was discussed and approved. Furthermore, the following points were discussed: Organization of work into main MDS track with BoGs (REL/RDD/DIA/DIP/ER/IPMP) 78 o All work held in main MDS track except where indicated for specific Break-out Groups (BoG) Scheduling of MDS sub-group plenary meetings for Wednesday and Thursday Plan for MPEG-7 Multimedia Description Schemes AMD/2 and COR/1 Plan for MPEG-21 Digital Item Declaration 2nd Edition Plan for MPEG-21 Rights Expression Language Plan for MPEG-21 Rights Data Dictionary Plan for MPEG-21 Digital Item Adaptation Plan for MPEG-21 Digital Item Processing Plan for MPEG-21 Event Reporting Plan for MPEG-21 IPMP Plan for software development for MPEG-21 Schedule of joint meetings Joint Meetings (as of Monday): MPEG-7: o Wed (11h30 - 13h00): MPEG-7 Profiles (with Requirements, Systems, Audio, Video) MPEG-21: o Mon (17h00 - 18h00): MPEG-21 IPMP Handoff (with Requirements, Systems) o Tues (11h00 - 11h30): Media Application Formats (with Requirements, Systems) o Tues (15h00 - 16h30): MPEG-21 Requirements (with Requirements) o Tues (14h00 - 15h00): MPEG-21 Integration (with Requirements) Break-out Groups: Event Reporting BoG: o Time: 09:00 – 11:30 o Place: St. Helens 3 (other room to be announced) o Mandates: Address specific recommendations from AHG and Core experiments Create initial draft of ER v2.0 Start inter-MPEG-21 project communications for ER and its relationship to DID, REL, DIA, IPMP, etc. o Chairs: Andrew Tokmakoff Digital Item Processing (DIP) BoG: o Time: Tues, 11:30 – 15:00 o Place: St. Helens 3 79 o Mandates: Review and develop initial recommendations for NB comments Harmonize DIBOs for REL o Chairs: Gerrard Drury, Frederik IPMP BoG: o Scope: Interoperability across (and within) verticals Interoperability at what levels? Where to draw line (e.g., framework descriptions systems/tools)? o Elements: Framework Descriptions, IPMP information IPMP Systems (high-level) and IPMP Tools (bit-level) Solutions o Start with framework: Enabling and prescriptive Draw together components of MPEG-21 Levels of flexibility (required) May need to support declaration of tools at multiple levels (e.g., high-level, bit-level) o Time: 10:30 – 17:00 Place: Baker 1 o Mandates: Start work on defining framework Interact with experts on DID, DII, REL/RDD, DIP, IPMP: Show how elements work together (current views) – ungoverned DIs Show how elements could work together to support IPMP (future view) – governed DIs o What’s missing? o Identify what IPMP information is needed within DID Re-examine input contributions related to framework Map to requirements, identify capabilities and gaps o Output (Tues PM): Table identifying how proposals meet framework requirements o Chairs: Simon Watt MPEG-21 Media Locators BoG o Time: Wed, 13h00 - 16h00 o Place: St. Helens 3 o Mandates: 80 Examine alternatives: Do not define generic fragment-id scheme – support authoritative schemes only (+ activity to define scheme for MPEG mime-types in context of file format) Define generic AV scheme using M21 URI syntax Define generic AV scheme using MPEG-7 XML media locators o Actions: Create AhG with mandates mapping to BoG recommendations (TBD) o Chairs: Myriam Review of AHG resolutions and action points: Doc No. 10957 Contribution Source AHG on Core Experiments for MPEG-21 DID 2nd Edition Gerrard Drury, Frederik De Keukaleare Myriam Amielh Final CE report on MPEG-21 Media Locator Results: Developed media locator test suite – used to evaluate candidate schemes CSIRA developed Java software for supporting URI-based fragments URI uses XPath grammar for locating steps for logical units Demonstration of locating regions in space and time using URI-based scheme Check ONYX (messaging structure) and Logical models (music industry) Actions: Review CE results during the meeting 11032 CE Results on Addressing Scheme for MPEG-21 using MPEG-7 Media Locators John R. Smith, Alan Melby Results: Developed and evaluated test cases for using MPEG-7 media locator for MPEG-21 Further improved syntax and semantics for including MPEG-7 media locator in MPEG-21 DID Further improved syntax and semantics of logical unit locator for MPEG-7 Actions: BoG this week to determine best solution for MPEG-21 addressing requirements 81 10939 AHG on Core Experiments for MPEG-21 DIP Hendry, Munchurl Kim, Keunsoo Park, Eva Rodriguez, Torres , Jaime Delgado Gerrard Drury, Frederik De Keukaleare, Munchurl Kim CE report for Core Experiment on DIBOs for REL 10873 Victor Torres, Jaime Delgado, Eva Rodriguez MPEG-21 DIP Core Experiments: A contribution to the implementation of DIBOs for REL Results: Explored two solutions for REL related DIBOs Actions: Need effort this week to harmonize two solutions Continue work as mandate of DIP BoG 10766 FX Nuttall, Andrew Tokmakoff AHG on MPEG-21 Event Reporting 11064 Andrew Tokmakoff, Youngjoo Song, Kyunghee Ji, Senator Jeong CE-Report on MPEG-21 Event Reporting Results: Improved Event Reporting working draft Elaborated on syntax and semantics of ER and ERR Actions: Need more interaction with other parts of MPEG-21 Need to more completely define ER and ERR tools Continue in BoG mode this week – produce next version of WD MPEG-21 IPMP Doc No. Contribution Source Results of Call on MPEG-21 IPMP Requirements Results: Completed handoff of MPEG-21 IPMP activities to MDS subgroup (from Requirements) Questions: What shall be scope of MPEG-21 IPMP standardization – framework, metadata, tools, end-to-end solutions? Actions: Start intensive BoG activities this week – mandates to be established first thing on Tues AM. MPEG-21 DID Comments: Doc Contribution Source 82 No. 10889 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-2 [SC 29 N 6107] 10971 Christian Timmerer, on behalf of the Austrian NB ANB comments on 21000-2 CD 2nd Edition Results: NB comments on MPEG-21 DID Questions: Media locator comments to be addressed in BoG Actions: Meet with NB members and resolve open issues Produce DID 2nd Edition FCD at this meeting MPEG-21 DID Media Locators: Doc No. Contribution Source 10957 Myriam Amielh 11032 John R. Smith, Alan Melby 11118 Myriam Amielh Final CE report on MPEG-21 Media Locator CE Results on Addressing Scheme for MPEG-21 using MPEG-7 Media Locators Issues relating to the use of URI Fragment Identifiers in MPEG-21 Results: Reviewed results of CE on Media locators for MPEG-21 using two approaches – one using MPEG-7 standards based tools and the other using proprietary URI-based scheme. Questions: Issues were raised about URI-based scheme because of incompatibilities with existing W3C/IETF practices on URI-fragments MPEG cannot define a URI-compatible fragment scheme for media types that are not under MPEG control, e.g., Quicktime Actions: Adopt MPEG-7 based scheme into MPEG-21 DID specification Continue to explore URI-based schemes and applicability to MPEG media types MPEG-21 RDD Doc No. Contribution Source 10786 ITTF via SC 29 Secretariat Table of Replies on ISO/IEC FDIS 21000-6 [SC 29 N 5981] 83 11013 Chris Barlas 11077 Thomas DeMartini, Jeroen Bekaert ISO/IEC 21000-6 COR/1 WD v.1 Editor's Input Herbert Van de Sompel, Status of mpegRA activity Results: Minor issue on MPEG-21 RDD spec. – error and inconsistency in Fig. 1 Questions: Questions about status of MPEG-21 registration authority – seemingly no actions have been taken by appointed RA Actions: Correct figure for RDD COR/1 RA will respond and report on status MPEG-21 DIA AMD/1 Editing Doc No. Contribution Source 10831 Thomas DeMartini Editor's Input: DIA AMD/1 WDv2.1 10978 Christian Timmerer, Hermann Hellwagner Comments on DIA AMD1 WDv2 Results: Minor comments on DIA AMD/1 Questions: Not all editors present – release next draft with minor revisions Actions: Produce DIA PDAM/1 MPEG-21 DIA AMD/1 Proposals Doc No. Contribution Source 10996 Ingo Wolf, Bernhard Feiten, Teodora GuenkovaLuy, Andreas Schorr, Franz Hauck, Andreas J. Kassler MPEG-21 DIA based delivery using SDPng and RTP 11030 Mariam Kimiaei Asadi, Jean-claude Dufourd Possible missing features in MPEG-21 DIA 11086 Christian Timmerer, Klaus Jannach, Hermann Hellwagner Contribution to DIA AMD1 WDv2 Leopold, Dietmar Results: Delivery based contribution for DIA using SFPng and RTP (relevant for testbed) Contribution for DIA tools for describing rich text capabilities Actions: Continue to explore rich text DIA description in AHG following this 84 meeting – consider adopting for future DIA MPEG-21 Requirements Doc No. Contribution Source 10774 Thomas DeMartini Requirement for MPEG-21 Binarization 10807 Niels Rump, Chris Barlas Relationship between Digital Items and Digital Item Declarations 10892 Jeroen Bekaert, Thomas DeMartini, Rik Van de Walle, Herbert Van de Sompel Identification of a DIDL Document 11081 Jeroen Bekaert, Frederik De Keukelaere, Herbert Van de Sompel, Rik Van de Walle Requirement for MPEG-21 DID 11110 Gerrard Drury, Ian Burnett Comments on Identification of DID a Document Results: Issues raised about identification of DID XML documents (as opposed to DII of Digital items) Very different points of view expressed from rights holder community vs. library science/data management community Actions: More discussion and possible compromise needed In end, compromise is to use DID metadata field for including identifiers for DID XML documents MPEG-21 BSD Proposals: Doc No. Contribution Source 11087 Joerg Heuer, Gabriel Panis, Andreas Hutter Considerations for efficient Adaptation based on MPEG-21 DIA Resource 11091 Debargha Mukherjee, Huisheng Wang, Sam Liu On BSD Transformation Instructions Streaming Implementation and updates Results: Update on activities on DIA resource adaptations in streaming environments and streaming implementations of BSD transformations Actions: Explore further in form of CE and consider for future DIA MPEG-21 DIP Proposals: Doc No. Contribution Source 85 - MPEG-21 DIP Core Experiments: A contribution to the implementation of DIBOs for REL 10873 Victor Torres, Jaime Delgado, Eva Rodriguez 10939 Hendry, Munchurl Kim, Keunsoo Rodriguez, Torres , Jaime Delgado 10963 Myriam Amielh, Ernest Wan, Gerrard Drury, Ian Burnett Park, Eva CE report for Core Experiment on DIBOs for REL Proposed DIBO for playing a Fragment Results: Contributions for DIP including rights related DIBos Questions: There may be some advantages for separating DIP into governed vs. ungoverned, similar to DIA; although, proponents of DIP rights related tools would not like to delay those tools Actions: Adopt revisions into current draft MPEG-21 DIP Editing: Doc No. Contribution Source 10797 SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-10 [SC 29 N 6103] 10973 Christian Timmerer, on behalf of the Austrian NB ANB comments on 21000-10 CD 11113 Gerrard Drury, Ian Burnett Response to Comments on DIP CD Results: Large number of NB comments in MPEG-21 DIP CD Some issues difficult to resolve such as the interface design for DIP tools Actions: BoG and NB representatives to continue working on open issues Final decision on DIP to be made at end of week MPEG-21 Conformance: Doc No. Contribution Source 10891 Eva Rodriguez, Jaime Delgado, Silvia Llorente Revised REL Interpretation Conformance after verification of Test Cases Results: New contribution adopted for REL aspect of MPEG-21 conformance Questions: Little effort has been made to date on DID, DIA conformance; although, conformance for these parts may not be very extensive, e.g., 86 similar to MPEG-7 for XML metadata Actions: Need more serious effort on MPEG-21 conformance – who? 87 Summary of Results on MPEG Multimedia Description Schemes (MDS) work items: Results on MDS MPEG-7 work items: 1. MPEG-7 MDS (Part 5): MPEG-7 Multimedia Description Schemes (Part 5): o Disposed of National Body comments on MDS DCOR/1 (clarification of semantics when multiple profile & level indicators are signaled) o All National Bodies approved disposition o Output: MPEG-7 MDS COR/1 COR MPEG-7 MDS User Preference Extensions (Part 5): o Disposed of NB comments on FPDAM/2 (updates & corrections of syntax) o All National Bodies approved disposition o Output: MPEG-7 MDS AMD/2 FDAM 2. MPEG-7 Conformance (Part 7) Disposed of NB comments on FPDAM/1 (finalization of MPEG-7 AMD conformance bit-streams) All National Bodies approved disposition Editing period requested to collect final bit-streams from respective MPEG-7 groups Output: MPEG-7 Conformance FDAM/1 3. MPEG-7 Schema Definition (Part 10) Disposed of NB Comments on FCD (synchronization of tools across MPEG-7 parts) All National Bodies approved disposition Output: MPEG-7 Schema Definition FDIS Results on MDS MPEG-21 work items: 1. Analyzed recommendations of AHGs and Core Experiments. 2. MPEG-21 Part 2 – Digital Item Declaration: Disposed of NB comments on CD (all National Bodies approved) Adopted <Fragment> element for locating fragments of resources using MPEG-7 media locators and URI-authoritative fragment-id schemes Decision to support identifier for DIDL XML documents using DIDL metadata field – clearly distinct from the DII of the Digital Item Established AHG on Media locators: 88 Exploring URI-authoritative fragment-id schemes (e.g., for MPEG mimetypes; use within MPEG-21 and interaction with MPEG-7 media locator solutions) Output: MPEG-21 DID 2nd Ed FCD 3. MPEG-21 Rights Data Dictionary (RDD): Bug fix to Figure 1 (not consistent with text) Output: MPEG-21 RDD COR/1 DCOR 4. MPEG-21 Part 7 – Digital Item Adaptation: Promoted DIA AMD/1 to PDAM (minor editorial revisions) o Provides normative tools for describing conversion capabilities and suggested conversions for digital item (or component) o Provides example informative set of conversions and their mapping & term specialization in RDD Established new DIA Core Experiments: o CE on Text Capabilities of Terminals – description of font and richtext capabilities of terminals and use for adaptation o CE on Conversion Parameters – DIA support for multi-step adaptations o CE on Bitstream Adaptation in Constrained and Streaming Environments Output: o MPEG-21 DIA AMD/1 PDAM, o MPEG-21 DIA COR/1 DCOR 5. MPEG-21 IPMP SW (Part 4): Extensive interaction of DID, DII, REL/RDD, DIP, IPMP experts: o Examined how MPEG-21 elements work together (ungoverned view) o Examined how MPEG-21 elements could to work together to support IPMP (governed view) – starting point of framework Established initial basis for MPEG-21 IPMP framework: o Starting from DIDL extension proposal from m10860 – defines governed-versions of DIDL constructs within MPEG-21 Digital Item Declaration, e.g., <Container> and <IPMP_Container>, etc. o Starting point of IPMP descriptors from proposals m10832, m10858 and m10865 Established IPMP AHG: o Further developing IPMP DIDL extensions, schema for IPMP information o Revising MPEG-21 IPMP working draft – documenting initial framework 89 o AHG Meetings will be held on 24-26 Aug in Mountain View and weekend prior to 70th MPEG meeting Output: MPEG-21 IPMP WD v.1 6. MPEG-21 Reference SW (Part 8): Disposed of NB comments on CD (all National Bodies approved) Adopted new SW contributions on Mobile MPEG-21 browser and Integration SW for REL, DID and DIA Output: MPEG-21 Ref. SW FCD 7. MPEG-21 Part 10 – Digital Item Processing: Did not fully dispose of NB comments on CD (~150 comments) o Proposed change of API too extensive to be evaluated in Redmond o Produced Draft DoC and Study of CD o Delaying MPEG-21 DIP FCD until 70th meeting Revising DIP to operate on DID entities (not DIDL XML elements) Harmonization of solutions for REL-related DIBOs Clarification of DIP text to better define its purpose and relationship to other MPEG-21 parts Established DIP AHG to work on: o Signaling of DIP profiles o Evaluating API revisions o Implementing PlayResource DIBO and DIXOs Output: MPEG-21 DIP Study of CD 8. MPEG-21 Part 15 – Event Reporting: Further developed Event Reporting and its relationship to DID, REL, DIA, IPMP, etc. Developed solutions for representing Event Reports and Event Report Requests in Digital Items using DIDL Descriptor element More fully defined data fields of Event Report and Event Report Request elements Demonstrated of Event Reporting software integrated with DID, REL, DIP Output: MPEG-21 Event Reporting WD v.2 9. Edited and approved output documents (WD, CD, AHGs, new CEs, etc.) 90 List of MDS Output documents: MPEG-7: No. 6633 6634 6635 6636 Title TBP 15938-5 MPEG-7 Multimedia Description Schemes DoC on ISO/IEC 15938-5 FPDAM/2 N ISO/IEC 15938-5 FDAM/2 “MDS User Preference N Extensions” DoC on ISO/IEC 15938-5 DCOR/1 N ISO/IEC 15938-5 COR/1 N No. Available 04/07/23 04/07/23 04/07/23 04/08/09 Title 15938-7 MPEG-7 Conformance 6637 DoC on ISO/IEC 15938-7 FPDAM/1 6638 ISO/IEC 15938-7 FDAM/1 TBP Available N N 04/07/23 04/08/16 No. TBP Available N N 04/07/23 04/09/13 TBP Available N 04/07/23 N 04/07/31 Title 21000-3 MPEG-21 Digital Item Identification 6643 Status of Registration Authority for DII TBP Available N 04/07/23 No. TBP Available Title 15938-10 MPEG-7 Schema definition 6639 DoC on ISO/IEC 15938-10 FCD 6640 ISO/IEC 15938-10 FDIS “Schema Definition” MPEG-21: No. Title 21000-2 MPEG-21 Digital Item Declaration DoC on 21000-2 CD 2nd Edition – Digital 6641 Declaration 6642 ISO/IEC 21000-2 DID 2nd Edition FCD No. Title 21000-4 MPEG-21 IPMP 91 Item 6644 ISO/IEC 21000-4 WD v.1 “IPMP” N 04/07/23 Title 21000-5 MPEG-21 Rights Expression Language 6645 MPEG-21 REL/RDD Software Implementation Plan v.7 TBP Available N 04/07/23 No. TBP Available N 04/07/23 No. Title 21000-6 MPEG-21 Rights Data Dictionary 6646 ISO/IEC 21000-6 DCOR/1 No. 6647 6648 6649 6650 6651 6652 Title TBP 21000-7 MPEG-21 Digital Item Adaptation MPEG-21 DIA PDAM/1 “Conversions and Permissions” N ISO/IEC 21000-7 COR/1 WD v.1 N MPEG-21 DIA Software Implementation Plan v.8 N Workplan for Core Experiment on Text Capabilities of N Terminals Workplan for Core Experiment on Conversion Parameters N Workplan for Core Experiment on Bitstream Adaptation N in Constrained and Streaming Environments No. Title 21000-10 MPEG-21 Digital Item Processing 6653 Draft DoC on ISO/IEC 21000-10 CD Study of ISO/IEC 21000-10 CD “Digital 6654 Processing” 6655 MPEG-21 DIP Software Implementation Plan v.3 No. Title 21000-15 MPEG-21 Event Reporting 6656 ISO/IEC 21000-15 WD v.2 “Event Reporting” 92 Item Available 04/07/23 04/07/23 04/07/23 04/07/23 04/07/23 04/07/23 TBP Available N N 04/07/23 04/09/03 N 04/07/23 TBP Available N 04/07/31 List of AHGs approved by the MDS group: N6657 Mandates Chairman Co Chairs Duration Meetings Reflector Subscribe N6658 Mandate: Chairman: Duration: Meetings: Reflector: Subscribe: N6659 Mandate: AHG on MPEG-21 Media Locators 1. Investigate solutions for an authoritative URI fragment identifier scheme for mpeg media types 2. Discuss and collect comments on the collaborative solution using MPEG-7 metadata-based and URI-based schemes for DID 3. Update the DID reference software to support <Fragment> element and study the impact of the new element 4. Explore requirements for addressing schemes for mpeg and nonmpeg mime types 5. Jointly explore conventions for describing slices of composites with MPEG 21, SMIL, X3D Myriam Amielh (myriam.amielh@cisra.canon.com.au) Gerrard Drury (gerrard@enikos.com) YongJu Cho (yongjucho@etri.re.kr) Until the 70th Meeting Pre-meeting to be held in Palma on the Saturday or Sunday prior the 70th meeting. mpeg-21-list@imec.be Please use the prefix [medialoc] Send email to owner-mpeg-21-list@imec.be AHG on MPEG-21 IPMP 1. To further review the proposals to identify relevant technologies for inclusion in the working draft. 2. To further develop the IPMP_DIDL extensions 3. To develop a schema for IPMP information To make recommendations on 1), 2) and 3) to the 70th Meeting Simon Watt Until 70th meeting Meetings will be held: 24-26 Aug in Mountain View in Palma on the day prior to the 70th Meeting mpeg-21@listserv.imec.be message titles prefixed [IPMP] To subscribe, go to http://listserv.imec.be/mailman/listinfo/mpeg21 AHG on MPEG-21 DIA 1. Carry out Core Experiments on DIA and make recommendations 93 Chairs Duration: Meetings: to modify and improve the MPEG-21 DIA AMD/1 PDAM. 2. Investigate the integration of the PDAM schema into the ISO/IEC 21000-7 schema. 3. Produce the editor’s draft of PDAM. Christian Timmerer (christian.timmerer_at_itec.uni-klu.ac.at) Thomas DeMartini (Thomas.DeMartini_at_CONTENTGUARD.COM) Until the 70th Meeting. AHG Meeting to be held on the weekend prior to 70 th meeting. Other business will be conducted by e-mail or telephone conference. Reflector: Subscribe: N6660 mpeg21-uma_at_merl.com To subscribe send email to chairman. Mandates 1. Carry out editing of DIP Study of CD according to draft disposition NB comments on CD. 2. Encourage contributions on improving MPEG-21 DIP Study of CD. 3. Develop mechanisms that allow signaling of MPEG-21 DIP profile information. 4. For use cases provided in the Draft DoC for demonstrate implementations of the concepts of the PlayResource DIBO or DIXOs. Gerrard Drury (gerrardx@xenikos.com) Frederik De Keukaleare (Frederik.DeKeukelaerex@xugent.be) Munchurl Kim (mkimx@xicu.ac.kr) Until the 70th Meeting AhG Meeting to be held on the Sunday prior to 70th meeting. Other business to be conducted by email or phone. mpeg-21-dipx@xuow.edu.au See http://mailinglists.uow.edu.au/mailman/listinfo/mpeg-21-dip Chairman Co Chair Duration Meetings Reflector Subscribe N6661 Mandate: Chairs: Duration: Meetings: AHG on MPEG-21 DIP 14.1.1 AhG on MPEG-21 Event Reporting 1. Finish the editing of WD 2.0 2. Continue developing the reference software, as to comply with WD 2.0 3. Make recommendations on possible improvements to WD 2.0 4. contribute an editors’ draft for the next meeting FX Nuttall (fx at nuttall.org) Andrew Tokmakoff (tokmakoff at telin.nl) Until the 70th Meeting A pre- meeting will be held on the weekend before the Palma meeting. 94 Reflector: Subscribe: Other business will be conducted by E-mail or telephone conference. mpeg-21-event-reporting@lists.telin.nl See http://lists.telin.nl/mailman/listinfo/mpeg-21-event-reporting 95 MPEG MDS group schedule for 69th meeting: MDS Sub-Group Schedule MPEG MDS Chair: John R. Smith Number MPEG-7 and MPEG-21 v.3.2 Source Title Monday Morning (9h00-13h00) MPEG Plenary STD NOTES ALL JRS ALL JRS ALL JRS MPEG- JRS Plenary room Monday Afternoon (14h00-20h00) Kick-off of MPEG MDS activities (14h00-14h30) Agenda, Goals and Issues for the Week for MDS Group Review of AHG resolutions, CE results and action points (14h3016h30) Hood 2 (MDS Room) John R. Smith Hood 2 (MDS Room) AHG on Core Experiments for MPEG21 DID 2nd Edition Gerrard Drury, Frederik De Keukaleare 10957 Myriam Amielh Final CE report on MPEG-21 Media Locator 11032 10939 John R. Smith, Alan Melby AHG on Core Experiments for MPEG21 DIP Hendry, Munchurl Kim, Keunsoo Park, Eva Rodriguez, Torres , Jaime Delgado CE Results on Addressing Scheme for MPEG-21 using MPEG-7 Media Locators Gerrard Drury, Frederik De Keukaleare, Munchurl Kim CE report for Core Experiment on DIBOs for REL 10873 Victor Torres, Jaime Delgado, Eva Rodriguez MPEG-21 DIP Core Experiments: A contribution to the implementation of DIBOs for REL FX Nuttall, Andrew Tokmakoff Andrew Tokmakoff, Youngjoo Song, Kyunghee Ji, Senator Jeong AHG on MPEG-21 Event Reporting 10766 11064 Define BoGs and Mandates (16h30-17h00) MPEG-7, REL, RDD, DID, DIA, DIP, ER, IPMP MPEG-21 IPMP (17h00- 18h00) CE-Report on MPEG-21 Event Reporting Hood 2 (MDS Room) BOG Room = St. Helens 3 Lassen Room (Requirements) 96 with Requirements, Systems 21 Tuesday Morning (09h00-13h00) MPEG-21 Event Reporting (ER) BoG (09h00- 11h30) MPEG-21 IPMP (09h00 - 09h30) MPEG-21 DID Comments (09h30 - 10h00) 10889 10971 SC 29 Secretariat Christian Timmerer, on behalf of the Austrian NB MPEG-21 DID Media Locators (10h00 - 11h00) St Helens 3 MPEG21 Hood 2 (MDS Room) MPEG21 JRS Hood 2 (MDS Room) MPEG21 JRS MPEG21 JRS Summary of Voting on ISO/IEC CD 21000-2 [SC 29 N 6107] ANB comments on 21000-2 CD 2nd Edition Hood 2 (MDS Room) 10957 Myriam Amielh Final CE report on MPEG-21 Media Locator 11032 John R. Smith, Alan Melby CE Results on Addressing Scheme for MPEG-21 using MPEG-7 Media Locators 11118 Myriam Amielh Issues relating to the use of URI Fragment Identifiers in MPEG-21 MPEG-21 IPMP BoG (10h3017h00) Baker 1 Media Application Formats (11h00- 11h30) with Req., Video, Audio, Systems Lassen Room (Requirements) 10961 Wo Chang, Schuyler Quackenbush MAF Reference Software Workplan Proposal 10962 Wo Chang MAF File Format Proposal MPEG-21 Digital Item Processing (DIP) BoG (11h30- 15h00) MPEG-21 RDD (11h30 - 12h00) MPEG21 MAF St Helens 3 MPEG21 Hood 2 (MDS Room) MPEG21 97 JRS JRS 10786 ITTF via SC 29 Secretariat 11013 Chris Barlas Thomas DeMartini, Herbert Van de Sompel, Jeroen Bekaert 11077 Table of Replies on ISO/IEC FDIS 21000-6 [SC 29 N 5981] ISO/IEC 21000-6 COR/1 WD v.1 Editor's Input Status of mpegRA activity Tuesday Afternoon (14h0020h00) MPEG-21 DIA AMD/1 Editing (13h00- 14h00) 10831 10978 Thomas DeMartini Christian Timmerer, Hermann Hellwagner MPEG-21 DIA AMD/1 Proposals (14h00- 15h00) 10996 11030 11086 Ingo Wolf, Bernhard Feiten, Teodora Guenkova-Luy, Andreas Schorr, Franz Hauck, Andreas J. Kassler Mariam Kimiaei Asadi, Jean-claude Dufourd Christian Timmerer, Klaus Leopold, Dietmar Jannach, Hermann Hellwagner MPEG-21 Requirements (15h0016h30) w. Requirements, Systems 10774 Thomas DeMartini 10807 11081 Niels Rump, Chris Barlas Jeroen Bekaert, Thomas DeMartini, Rik Van de Walle, Herbert Van de Sompel Jeroen Bekaert, Frederik De Keukelaere, Herbert Van de Sompel, Rik Van de Walle 11110 Gerrard Drury, Ian Burnett 10892 MPEG-21 Event Reporting (16h30 - 17h00) 10766 11064 FX Nuttall, Andrew Tokmakoff Andrew Tokmakoff, Youngjoo Song, Kyunghee Ji, Senator Jeong MPEG-21 IPMP (17h00 - 18h00) Hood 2 (MDS Room) MPEG21 JRS MPEG21 JRS MPEG21 JRS MPEG21 IB MPEG21 JRS Editor's Input: DIA AMD/1 WDv2.1 Comments on DIA AMD1 WDv2 Hood 2 (MDS Room) MPEG-21 DIA based delivery using SDPng and RTP Possible missing features in MPEG-21 DIA Contribution to DIA AMD1 WDv2 Lassen Room (Requirements) Requirement for MPEG-21 Binarization Relationship between Digital Items and Digital Item Declarations Identification of a DIDL Document Requirement for MPEG-21 DID Comments on Identification of DID a Document Hood 2 (MDS Room) AHG on MPEG-21 Event Reporting CE-Report on MPEG-21 Event Reporting Lassen Room (Requirements) 98 MPEG-21 DIA BSD Proposals (18h00- 18h30) Hood 2 (MDS Room) 11087 Joerg Heuer, Gabriel Panis, Andreas Hutter Considerations for efficient Resource Adaptation based on MPEG-21 DIA 11091 Debargha Mukherjee, Huisheng Wang, Sam Liu On BSD Transformation Instructions Streaming Implementation and updates MPEG21 JRS Wednesday Morning (09h0013h00) MPEG Plenary (9h00-11h00) MPEG-21 IPMP BoG (11h3016h30) MPEG-21 DIP Proposals (11h30 12h30) 10873 10939 10963 Victor Torres, Jaime Delgado, Eva Rodriguez Hendry, Munchurl Kim, Keunsoo Park, Eva Rodriguez, Torres , Jaime Delgado Myriam Amielh, Ernest Wan, Gerrard Drury, Ian Burnett MPEG-7 Profiles (11h30 - 13h00) with Req., Video, Audio, Systems Plenary room MPEG Plenary Baker 1 MPEG21 Hood 2 (MDS Room) MPEG21 IB MPEG7 JRS MPEG-21 DIP Core Experiments: A contribution to the implementation of DIBOs for REL CE report for Core Experiment on DIBOs for REL Proposed DIBO for playing a Fragment Lassen Room (Requirements) 10763 Wo Chang, Akio Yamada, Alan Melby AHG on MPEG-7 Profiles 10940 Peter van Beek MPEG-7 User Description Profile Update 11023 Masanori SANO Some thoughts on MPEG-7 Profiling 11024 Masanori SANO MPEG-7 Core Description Profile Update Wednesday Afternoon (14h0017h30) MPEG-21 DID Media Locators BoG (13h00 - 16h00) MPEG-21 IPMP BoG (11h3016h30) MPEG-21 DIP Editing (13h00 14h00) 10797 SC 29 Secretariat St. Helens 3 (BoG Room) MPEG21 Baker 1 MPEG21 Hood 2 (MDS Room) MPEG21 Summary of Voting on ISO/IEC CD 21000-10 [SC 29 N 6103] 99 IB 10973 Christian Timmerer, on behalf of the Austrian NB ANB comments on 21000-10 CD 11113 Gerrard Drury, Ian Burnett Response to Comments on DIP CD MPEG-21 Integration (14h00 15h00) with Requirements, Integration MPEG-21 Conformance (15h00 16h00) with Integration 10891 Eva Rodriguez, Jaime Delgado, Silvia Llorente MPEG-21 DIP BoG (16h00 17h00) MPEG-21 IPMP (16h30 - 17h00) Lassen Room (Requirements) MPEG21 IB Hood 2 (MDS Room) MPEG21 IB Revised REL Interpretation Conformance after verification of Test Cases St. Helens 3 (BoG Room) MPEG21 Lassen Room (Requirements) MPEG21 Baker 1 MPEG21 (Systems Room) MPEG21 IB St. Helens 3 (BoG Room) MPEG21 IB MPEG7 JRS JRS MPEG Social Event (17h00 midnight) Thursday Morning (09h00-12h30) MPEG-21 IPMP BoG (09h0016h00) MPEG-21 File Format (09h00 10h00) with Systems MPEG-21 DIP Editing (10h00 11h00) 10963 10797 Myriam Amielh, Ernest Wan, Gerrard Drury, Ian Burnett 10973 SC 29 Secretariat Christian Timmerer, on behalf of the Austrian NB 11113 Gerrard Drury, Ian Burnett MPEG-7 MDS Extensions (09h00 - 10h00) 10790 ITTF via SC 29 Secretariat Proposed DIBO for playing a Fragment Summary of Voting on ISO/IEC CD 21000-10 [SC 29 N 6103] ANB comments on 21000-10 CD Response to Comments on DIP CD Hood 2 (MDS Room) Table of Replies on ISO/IEC 159385:2003/FDAM 1 [SC 29 N 6001] 100 10925 11121 SC 29 Secretariat John R. Smith, Alan K. Melby MPEG-7 MDS COR/1 (10h00 10h30) 10846 SC 29 Secretariat Summary of Voting on ISO/IEC 159385:2003/FPDAM 2 Revised Logical Media Locator for MPEG-7 & MPEG-21 Hood 2 (MDS Room) SC 29 Secretariat MPEG-7 Conformance Extensions (10h30 - 11h00) 10806 SC 29 Secretariat MPEG-21 Ref. SW (11h00 12h00) with Integration Hood 2 (MDS Room) JRS MPEG7 JRS MPEG21 JRS MPEG21 JRS Summary of Voting on ISO/IEC 159387/FPDAM 1 [SC 29 N 6046] Hood 2 (MDS Room) SC 29 Secretariat Summary of Voting on ISO/IEC CD 21000-8 [SC 29 N 6075] 10864 Xin Wang, Venugopal Venkatraman, Thomas DeMartini Simple Integration Reference Software for MPEG-21 REL, DID and DIA Shane Lauf, Ian S Burnett Jeho Nam, Hyuk-Min Kwon , ManBae Kim, Seungji Yang, Truong Cong Thang, Rin-Chul Kim, Hae-Kwang Kim Mobile MPEG-21 browser implementation 10871 MPEG7 Summary of Voting on ISO/IEC FCD 15938-10 10847 10942 JRS Summary of Voting on ISO/IEC 159385:2003/DCOR 1 [SC 29 N 6072] MPEG-7 Schema Definition (10h30 - 11h00) Hood 2 (MDS Room) 10926 MPEG7 Updated Status of MPEG-21 DIA Utility Software Modules Thursday Afternoon (14h0019h00) MDS Liaison Responses (13h00 14h00) Hood 2 (MDS Room) 10783 IEC TC 100 via SC 29 Secretariat 10784 ITU-T SG 17 via SC 29 Secretariat IEC CDV 62328-3: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 3: Broadcasting system specific recording structure -- ISDB [SC 29 N 5963] Liaison Statement from ITU-T SG 17 [SC 29 N 5968] 10897 TVA via SC 29 Secretariat Liaison Statement from the TV-Anytime Forum [SC 29 N 6114] 11147 IEEE LTSC via SC 29 Secretariat Liaison Statement from IEEE LTSC Media Application Formats (14h00 - 15h00) with Requirements Requirements 101 IB MPEG-21 DIP BoG (14h00 15h00) MPEG-21 REL (14h00 - 15h00) 10855 Hendry, Kyung-Ae Cha, Munchurl Kim, Keun Soo Park St. Helens 3 (BoG Room) MPEG21 Hood 2 (MDS Room) MPEG21 Answer to the CfP on MPEG-21 IPMP : A Right Description Model on Resource Combinations Plenary MDS and Reports of BoG (15h00 - 16h00) Hood 2 (MDS Room) Review of Output documents, AHGs, CEs, DoC, Std (16h0018h00) Hood 2 (MDS Room) Friday Morning (09h00-13h00) Wrapping up (09h00 - 13h00) Approval of resolutions, AHGs and Output documents Friday Afternoon (14h00-21h00) MPEG Plenary Contact: John R. Smith x IB MDS Plenary Hood 2 (MDS Room) MDS Plenary Plenary room MPEG Plenary 102 Annex 8 Report of Video meeting Source: Jens-Rainer Ohm, Miroslaw Bober Source: Jens-Rainer Ohm Contributors: Miroslaw Bober, Aljoscha Smolic, Euee S. Jang MPEG-4 New Levels in Visual Simple Profile A request was made for two new levels in Visual Simple Profile. It was emphasized that actually solutions that use the SP for image resolutions larger than CIF presently already exist in the market, but are not actually supported as conformance points. In a joint meeting with the Requirements subgroup, it was therefore decided to start an amendment, both for the standard text (14496-2:2004 Amd.2) and conformance (14496-4:2004 Amd.10) parts. It is planned to go for FPDAM in October and to FDAM in January 2005 meetings. It was considered important that the new levels are defined as compatible with the Advanced Simple Profile, such that eg. SP@L4 could be decoded by an ASP@L4 device. Documents reviewed: M10910 A. G. Tescher for USNB USNB Contribution: The need for additional levels for Visual SP M11041 Joseph Meehan, Minhua Zhou, Jennifer MPEG4 Simple-Profile Level 4 and 5 Webb, Felix Fernandes Proposal New Version of MPEG-4 Visual List of Problems Reported Version 13 of the document "MPEG-4 Visual List of Problems Reported" (N6514) was issued. One issue related to text part (14496-2:2004) was added which is a typo in symbolic code and may therefore lead to mis-interpretation. In general, all remaining issues are of low priority, to be resolved in a later corrigendum. All known bugs in Momusys and Microsoft parts of the reference software are fixed at this time. Conformance Corrigendum WD2.0 Fixing of Conformance streams being listed as erroneous in the WD 1.0 from previous meeting is still at a very early stage. A website to upload and retrieve corrected bitstream has been installed, but only one additional contribution was made in this period. Therefore, only a small update was made towards WD 2.0 (N6515) The further procedure of this corrigendum is planned as follows: – – – The DCOR will be issued October 2004; All bitstreams that are not available until then will be flagged as to be removed from the conformance part (14496-4); As no conformance would exist any more, this would imply a follow-up action where the related profiles and levels would have to be removed from the standard text (14496-2) at the time the conformance corrigendum is issued (Jan. 2005). As of today, this would affect all video profiles 103 except for the two Studio Profiles. Simple Scalable and Error-resilient Simple Scalable Profiles would not be affected directly, but they would not have a base layer after removal of Simple Profile, which would make them useless. Documents reviewed: M10958 Yoshihiro Miyamoto Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition AVC In Redmond, a JVT meeting took place in parallel with the Video Subgroup. Main topics in MPEG4 part 10 (AVC) were related to the Fidelity Range Extensions amendment (FDAM in N6539), edition 3 (N6540), conformance (N6532, N6533, N6534) and software (N6535, N6536, N6537).The video subgroup recommended approval of all the JVT-related documents by MPEG. Output documents related to MPEG-4 Video and AVC No. Title TBP Available 14496-2 MPEG-4 Visual N6495 Request for ISO/IEC 14496-2:2004 Amd.2 No Text of ISO/IEC 14496-2:2004 PDAM2 New Levels in Simple No N6496 Profile N6514 MPEG-4 Visual: List of Problems Reported version 13.0 Yes 04/07/21 04/07/21 04/07/23 14496-4 MPEG-4 Conformance N6497 Request for ISO/IEC 14496-4:2004 Amd.10 Text of ISO/IEC 14496-4:2004 PDAM10 Conformance Extensions N6498 for New Levels of Visual Simple Profile N6532 Disposition of Comments on ISO/IEC 14496-4:2004 FPDAM6 N6533 Text of ISO/IEC 14496-4:2004 FDAM6 AVC Conformance N6534 Text of ISO/IEC 14496-4:2004 PDAM9 AVC FRExt Conformance N6515 WD 2.0 of 14496-4 Visual Bitstreams Conformance Corrigendum No No 04/07/21 04/07/21 No No No Yes 04/09/15 04/09/15 04/09/15 04/07/23 14496-5 MPEG-4 Reference Software N6535 Disposition of Comments on ISO/IEC 14496-5:2004 FPDAM6 No N6536 Text of ISO/IEC 14496-5:2004 FDAM6 AVC Reference Software No Text of ISO/IEC 14496-5:2004 PDAM8 AVC FRExt Reference No N6537 Software 04/09/15 04/09/15 04/09/15 14496-10 Advanced Video Coding N6538 Disposition of NB Ballot Comments on ISO/IEC Yes 14496-10:2004/FPDAM1 AVC Professional Extensions N6539 Text of ISO/IEC 14496-10:2004/FDAM1 AVC Fidelity Range No Extensions N6540 Text of ISO/IEC 14496-10 Advanced Video Coding 3rd Edition No 04/08/31 04/08/31 04/08/31 MPEG-7 MPEG-7 related work in Redmond The MPEG-7 breakout group was active during the whole week. Input documents as reviewed are listed in the subsequent table. 104 M10778 SC 37 via SC 29 Secretariat M10779 M10806 M10842 M10916 M10917 M10933 M10938 M10947 M10948 M10949 M10950 M10951 M10953 M10955 M10956 M10977 M10979 M10980 M10981 M10986 ISO/IEC FCD 19794-6: Information technology -Biometric data interchange formats -- Part 6: Iris image data [SC 29 N 5958] SC 37 via SC 29 Secretariat SC 37 NP on Vascular Biometric Image Interchange Format [SC 29 N 5959] SC 29 Secretariat Summary of Voting on ISO/IEC 15938-7/FPDAM 1 [SC 29 N 6046] ITTF via SC 29 Secretariat Table of Replies on ISO/IEC 15938-3:2002/FDAM 1 [SC 29 N 6063] SC 29 Secretariat Summary of Voting on ISO/IEC 15938-6:2003/FPDAM 1 JTC 1 Secretariat via SC 29 Summary of Voting on ISO/IEC TR 15938-8/DAM 1 Secretariat Karol Wnukowicz, Dominant Color Temperature Descriptor Wladyslaw Skarbek Robert O'Callaghan, Preliminary Results on Situation/View-Based Clustering Miroslaw Bober Sang-Kyun Kim, Seungji Consideration on the clustering evaluation method for Yang, Yong Man Ro, Ji-Yeun situation/view based photo clustering experiment (VCEKim 1) Sang-Kyun Kim, Seungji CE Report for situation/view based photo clustering Yang, Yong Man Ro, Ji-Yeun experiment (VCE-1) Kim Sang-Kyun Kim, Seungji GT set proposed for situation/view based photo Yang, Yong Man Ro, Ji-Yeun clustering experiment (VCE-1) Kim Sang-Kyun Kim, Seungji Consideration on the photo categorization scheme Yang, Yong Man Ro, Ji-Yeun (VCE-2) Kim Sang-Kyun Kim, Seungji Model set and GT set for the photo categorization Yang, Yong Man Ro, Ji-Yeun experiment (VCE-2) Kim Sang-Kyun Kim, Seungji Consideration of face based photo clustering and Yang, Yong Man Ro, Ji-Yeun retrieval Kim Akio Yamada, Sang-Kyun MPEG-7 Visual XM Document version 20.1 Kim Akio Yamada, Sang-Kyun WD 1.1 of MPEG-7 New Visual Extensions Kim Soo-Jun Park, Myung Gil Cross verification of Model set and GT set for the photo Jang categorization experiment (VCE-2) Soo-Jun Park, Myung Gil Cross verification of GT set proposed for situation/view Jang based photo clustering experiment (VCE-1) Soo-Jun Park, Myung Gil Cross verification reprot of situation/view based photo Jang clustering experiment (VCE-1) Soo-Jun Park, Myung Gil Dataset of VCE-1 and 2 Jang Soo-Jun Park, Chee Sun Won A proposal for a hierarchical grouping of digital photos CE 105 M10778 SC 37 via SC 29 Secretariat ISO/IEC FCD 19794-6: Information technology -Biometric data interchange formats -- Part 6: Iris image data [SC 29 N 5958] The recommendations of the AHG were approved. Two Core Experiments (on Situation/view based image clustering and Categorisation of images) will continue. Two new Core Experiments will start: the first one on Dominant Colour Temperature descriptor and the second one on use of AFR descriptor for ID-based annotation of images. The description of CE is in the output document N6518. The library of images for experimentation was further extended. Joint meeting was held on file formats for the Photo Album MAF – it was agreed that the latest ISO-based file format can support both media-centric and meta-centric items. We reviewed updated and issued WD 2.0 of the MPEG-7 new visual extensions. Also, Visual XM document version 21 was reviewed, updated and issued. Output documents related to MPEG-7 Visual No. Title TBP Available 15938-3 MPEG-7 Visual N6516 WD 2.0 of MPEG-7 New Visual Extensions N6517 MPEG-7 Visual XM Document version 21.0 N6518 Description of Core Experiments for MPEG-7 New Visual Extensions No No No 04/07/23 04/07/23 04/07/23 MPEG-21 Scalable Video Coding The first task was review and interpretation of CE results. It was inherently clear that Core Experiments 1 and 2 were mainly targeting the compression performance over wider ranges of spatial, temporal & SNR resolutions, while keeping the effort for encoding/decoding as low as possible. Therefore, the following conditions had been defined in Munich, to be equally used in CE 1 and CE 2: • Test 1 scenario: 3 spatial & 3 temporal resolutions at 6 rate points • Test 2 scenario: 2 spatial & 3 temporal resolutions at 5 rate points • 4 sequences in each test In addition, Core Experiment 3 investigated possible mappings of PSNR and visual perception by performing an in-depth analysis of the CfP results. As a result from this CE, it can be concluded that in cases where SVC algorithms of rather different nature are compared, a useful mapping of subjective and PSNR seems to be impossible. There may be some indicators that PSNR is useful for two different variants of the same algorithm, provided that a comparison can be made against a "high rate reference" (which should be free of visible distortions) as the optimum decoding result. This would, for example, not be useful for the comparison of de-blocking and other post-processing algorithms. Due to the result of this CE, it became clear that it would be necessary to perform subjective viewing tests, for which a new procedure of expert viewing had been proposed (M 10935). 106 The following CEs had been executed: • CE1: MCTF/2D Wavelet solutions. For each of the following sub-experiments, bitstreams were provided for both Test 1 and Test 2 scenarios. Participants had agreed on one best solution for each sub-experiment during the AHG pre-meeting. All CE1 results were obtained by the software provided by MSRA, or extensions thereof (see AHG report M10758 for more details). – 1a: Scalable motion information. The participants agreed that the improvement achieved is not significant in terms of visual quality, Therefore, 1a did not participate in the expert viewing tests. As scalable motion is partially integrated in the original MSRA algorithm, this was taken as a placeholder. – 1b: Spatial transforms. Only one result was reported, which did not show any significant visual improvement yet, according to the participants' judgement. 1b was therefore skipped from the viewing tests. – 1c: Intra coding. The participants selected a 'best choice' for visual improvement, which moderately applies over most rates. – 1d: Introduction of base layer. In this CE, it was shown that the MCTF/2D Wavelet algorithm can be significantly improved by introduction of an AVC (compliant) base layer at the lowest QCIF rate. It was reported that also an improvement of the CIF resolutions is achieved, while no significant decrease in quality at the highest (4CIF) spatial resolution was observed. The participants were able to select a "best choice" of the different methods investigated. – 1e: De-blocking in MC. The participants selected a 'best choice' for visual improvement, which moderately applies over most rates. Unlike originally planned, it was not possible to combine the best results from the different sub-experiments. Therefore, these were compared against each other and against the CE2 methods in the experts viewing tests. It could however be assumed that a combination of the different best results would improve the overall performance of the MCTF/2DWT algorithms. • CE2: AVC-based and -extending solutions. CE results were brought by using two different algorithms, one (2a) being an MCTF-extension of AVC without base-layer compatibility, the other two (2b and 2c) using a conformant AVC base layer with scalability extensions. Unfortunatelly, the 2c proponents still used the old rate/resolution settings from the previous CfP, such that it was not possible to compare with any other algorithms. Two different software implementations (HHI, University Póznan) were used in CE2. – 2a: AVC+MCTF+Differential Pyramid (Test scenarios 1 and 2). Results were reported on sub-experiments 2.1-2.4, a combination of these was provided for the experts viewing tests. – 2b: AVC+SNR scalability (Test Scenario 2). Results were reported on sub-experiments 2.5. AVC B-slice pyramid (UMCTF-like) was used. It was decided to compare the results of 1a (original MSRA algorithm), 1c, 1d, 1e, 2a and 2b in the experts viewing tests. It was found that the best performance overall is achieved by the algorithm from 2a (AVC+MCTF+Differential Pyramid). This applies for the wide range of test points, however some detail loss can be observed in two sequences at 4-CIF resolution, as compared to the MCTF/2DWT algorithms. On the other hand, the latter ones produce significantly more artifacts, in particular at low rates. These artifacts are again reduced by the introduction of an AVC base layer (experiment 1d). 1c and 1e are at many points judged better than 1a (all three of them without base layer). 2a also outperformed 2b at most rate/resolution points that were available, where however the comparison is difficult due to the fact that 2b only provided results for Test Scenario 2. The Results of the visual assessment are documented in N6513. From the discussions during the Munich meeting, it was considered important to map the capabilities of scalable codecs with application requirements. A considerable number of input 107 documents was received on this topic, which were summarized in a new version of the SVC applications and requirements document (N6505), and used in the weighting of different algorithms' capabilities, for the purpose of the WD decision that was planned for the Redmond meeting. In general it was found, that different SVC application domains (such as surveillance and mobile services) emphasize different requirements to be of central focus (e.g. surveillance: Support for many combinations of spatial/temporal/SNR scalability; mobile: Compression performance must be comparable or better than single layer). Therefore, one main driving factors for the standardization of SVC is for sure the good compression performance, which should however come with minimum penalty when additional functionality is supported. A solution that performs good at some rate points, but significantly worse at others would not be a good choice. Exactly such behaviour had been the reason to reject other algorithms from the results of the CfP. Objections were raised that the CEs that were run prior to the Redmond meeting might not bring evidence about all possible/useful combinations of scalability, FGS or medium-grain scalability (MGS) capabilities, capabilities for ROI access etc. Proponents of all solutions claimed they can fulfill such additional functionalities. On the other hand, evidence is clearly shown from this reduced set of rate/resolution points that technology exists that can perform high-quality decoding from truncated bitstreams over wide ranges of rates. Therefore, from the results of the past round of Core Experiments, the solution 2a must be regarded as the current "benchmark" of the SVC standardization process. As it could however happen that another algorithm performs significantly better at intermediate rate points or more flexible combinations of spatial/temporal/SNR scalability (as to be proven by evidence from future Core Experiments), a certain danger exists that this benchmark might partially or completely be exchanged by another solution. It is however a part of the MPEG standards success comes due to the fact that stable solutions are developed (not exchanging complete concepts at stages of WD or beyond, as it may indeed be practice in other standardization bodies). Therefore, it was widely agreed in the closing plenary to describe the benchmark algorithm of CE 2a in a document entitled "Technologies under Consideration for Working Draft 1.0 of ISO/IEC 21000-13 Scalable Video Coding" (N6519) ("TuCfWD"). This describes the MCTF process and the differential encoding methods with reference to parts of AVC edition 3. As a complement, the Scalable Video Model V 2.0 (N6520) was approved. This document • describes the requirements for and capabilities of the SVC software (to be used in core experiments and later be developed into the standard reference software) • Describes the different capabilities of scalability combinations to be supported and to be easily implemented (including known technical solutions at high level, such as 2D+t, t+2D, quantization, entropy coding etc.) • describes the encoding and decoding processes assigned with specific tools of the benchmark ("TuCfWD") more precisely It was agreed in the video group that presently, SVC CEs should be developed from the basis of the SVM document, i.e. to admit a CE it should fit into the high-level framework of the SVM. In a later stage, this can be developed into a description of non-normative processes related to SVC (similar to MPEG-4 Visual VM or MPEG-7 Visual XM). The Software to be used in the CEs can be regarded as instantiation of the SVM. It should support easy implementation of the capabilities described in the SVM, as well as extensions thereof. As a part thereof, software exactly mapping the "TuCfWD" benchmark was donated by FhG-HHI under MPEG licensing rules. In fact, not all perspectives of the SVM may presently be supported by the software pacakages provided so far (MSRA, HHI). In the development of the standard, it will be necessary to further develop into one consistent reference software, which would however be premature to start before the WD decision is taken. Due to the importance of this, it was decided to 108 establish an AHG responsible for maintenance of the SVM and the SVC software to be used in the CEs, where already both packages will be run in combination in some activities. This AHG should also discuss concepts about possible integration of only one package. The previous round of Core Experiments showed a number of deficiencies, which are only partially explainable by the fact that the SVC standardization process is just starting its transition into the convergence/collaboration phase. In particular, it must be stated that many timelines were missed, and the instability of the CE document could be the reason for some mis-interpretations that happened. The following guidelines for the CE document and the description of the single CEs were therefore agreed; it was furthermore agreed that a more precise document describing the SVC CE process will be developed by the next meeting. The CE document shall describe precisely for each CE - a tool or combination of tools that shall be experimented - the purpose of this tool (or combination of tools) that is challenging the benchmark, shall improve the benchmark or shall provide functionality that the benchmark is not supporting - the test sequences and test points used in the experimentation (mapping useful application requirements) - the timeline and responsibilities, partners, cross-check parties etc. - the software configuration (e.g. providing configuration files) that shall be used - criteria to evaluate this CE Interrelationship of different CEs must be considered, which can best be achieved by using common test sequences and test points (whenever possible) to make results comparable. These common experimental conditions with lowest possible number of test points must be kept fixed (if reasonable) to be able to track the progress that is made from one meeting to the next. For this purpose, it is reasonable to retain the sequence/rate/resolution definitions used in the Test 1 and 2 Scenarios of previous round. It is known that these provide operating points for viewing tests with distinguishable results. In addition, it was agreed that it will be necessary to add more test points. These will be used to explore the performance of algorithms for a wider variety of scalability combinations. To make this possible without being forced to compare a large number of results visually, additional points from a table (t.b.d. in the CE document) will be selected randomly. This selection will only be made after the bitstreams, bitstream extractors and decoders have been provided. Therefore, it is expected that it will not be possible to tune an algorithm for optimum performance only at pre-selected rate points. Core Experiments newly defined may use any of the software package that have been made available, combinations or extensions thereof. The CEs can be clustered into three different categories: • CE 1: The purpose of this CE is to compare complete algorithms, layered combinations of algorithms or combinations of tools into algorithms. Only a complete solution that has brought evidence by participating CE 1 can be accepted into WD by the next meeting. If a solution from one of the other CEs (2-6) intends to be approved for WD, it must become readily integrated into an algorithm proposed in CE 1 and show CE 1 evidence in time for the next meeting. CE 1 should provide results from the fixed rate/resolution conditions (as from Munich) and the new procedure of randomly selected points. Results of CE 1 will again be compared by the same procedure of experts viewing tests. • CE 2-6: The purpose of these CEs is to compare evidence of single tools, mostly in terms of compression performance improvement. The purpose of these CEs is to find promising techniques that are worthwhile to become integrated into CE 1 by the mid of the period, or need further investigation in future CEs. Whenever possible, these CEs should stick to the 109 Test 1 and 2 Scenarios of previous round, to minimize the effort. When useful for the purpose of a specific CE, it might also be subsets or extensions thereof. • CE 7-8: The purpose of these CEs is to explore additional functionality that are useful from specific application perspectives. The list of second and third category CEs is as follows (see details in CE document, N6521): • CE 2: Base-layer investigation • CE 3: Coding efficiency vs. low-delay constraints • CE 4: Adaptation of MCTF update step • CE 5: Spatial scalability • CE 6: SNR scalability and FGS • CE 7: Non-linear adaptation – Explores the capability of different "traces" of multiple adaptations (e.g. for erosion storage) • CE 8: Error resiliency and robustness – Explores behaviour of SVC in presence of channel errors – Typically IP, 3G networks – Usage of MPEG-21 resource delivery testbed planned Due to the lack of time during the meeting, N6521 needs further improvement, and a 2 weeks editing period is requested. It is consensus in the group that any experiments which do not provide the refined description with sufficient precision to guarantee success will be cancelled. In addition to the reports about CE results, which were treated with highest priority, a number of technical input documents were reviewed, for which some notes are shortly summarized here. A complete list of titles can be found below under table c): M11131. Modify EBCOT such that not the directional correlation is used in temporal lowpass frame encoding, instead directional prediction is performed. Directional angles are estimated locally, each macroblock uses only one prediction direction. Gives up to 2 dB for Barbara in JPEG2000 (less in others), and 0.5 dB in Foreman for MSRA MCTF. No other sequences investigated. M10904. Goal: Design better lowpass filters for aliasing cancellation. Used the filters only for SD>CIF conversion, CIF->QCIF was again done by 9/7. In City sequence, loss of 0.5 dB on SD, gain of 1 dB at CIF. M11096) Joint estimation for multiple rate points, some visual gain at highest QCIF rate M10902. Accuracy scalability of motion vectors, modification of the estimation. Gain of up to 0.75 dB at highest rate (City, other sequences much lower, usually 0.1..0.2) M11016. Motion coding based on prediction, differences handled by bit-plane coding. Rate distortion optimization, distortion criterion is difference between "true" H frame and H frame as generated by scalable motion representation. Implemented in SDMCTF of VUB. Gain of up to 2 dB at lowest rate for sequences with complex motion, less for sequences with simple motion. Also integrated into MSRA software; similar gain. All results only in context of quality scalability at CIF resolution. M11100. Coarse-to-fine and fine-to-coarse prediction of motion vectors, Laplacian pyramid approach. CotoFi: Slight increase of PSNR if QCIF motion vectors are used for interpolative prediction of CIF resolution. FitoCo: Usage of decimated CIF motion vectors improves performance at CIF (Foreman 1dB, other sequences less), but predictive coding from decimated vectors leads to some loss at CIF. However, a larger number of blocks is used at QCIF when the decimated vectors are used. M11039. Five different intra prediction or interpolation modes. Usually gain at low bit rates and in cases of complex motion (eventually already at near transition towards "bad quality"?). M10875. Propose different temporal scalability structures in AVC (p-frame, b-frame, hierarchical bframe). Up to three layers, moderate loss as compared to non-lossless. 110 M11126. 2D+t scheme: problems are high-subband leak and mismatch, non-exchangeability between s+t. Different methods are investigated (incl. ODWT). Approach that selects additional highpass coefficient to prevent drift appears most promising. Additional buffers necessary for the upsampling to full resolution (overcomplete). Request for investigation in CE. M10993. MSRA barbell lifting uses bilinear interpolation in update step, in case of motion discontinuities artifacts can occur. In case of homogeneous motion, 2D+t and t+2D would be equivalent. In case of motion discontinuity, additional highpass coefficients would have to be transmitted to make it equivalent. Have implemented in reference software. Encoder not changed, only decoder, DWT interpolation used rather than sinc. Gain approx. 0.1 dB. Small gain visually at data rates tested M10997. Propose hybrid layered compression with AVC base and MCTF enhancement. Shows clear improvement, also in cases of low delay. "Should become basis approach in SVC". M11084. Investigate different structures wrt delay, e.g. 5/3, Haar etc. E.g. by not performing update, the delay can be bounded. Generally, performance increases with increased delay. Find that it is better to keep the update, usually gives better performance in case of equal delay. This is of course sequence dependent. M11045. spatial and temporal transforms not interchangeable. Use overcomplete representation to solve the problem. Tendency: At low rates IBMCTF better by up to 4 dB, at high rates usually 0.5 dB worse than SDMCTF. M11130. Problem in 2D+t: shift variance of wavelet transform. In principle similar to a completeto-overcomplete transform. Use AVC codecs to code the single subbands. Loss as compared to t+2D relatively low (but SNR ??) Propose CE to study other structures such as 2D+t or 2D+t+2D. M10868. Application (JPIP, similar to the military surveillance) which cannot be done without scalability. Ghosting artifacts if motion trajectory is not appropriate. Adaptively adapt the update step to circumvent this problem, which even gives sometimes higher compression performance. Spatial scalability: No interchangeability. Efficient spatial scalability cannot be achieved without 2D+t. 2D+t shows higher aliasing than t+2D, but latter one is inferior when motion model fails. Best would be to combine both. Use MJPEG2000 variant which extends the blocks into the third dimension, such that adaptation becomes better. Joint meetings were held with JPEG and VCEG, the purpose of which was to inform the other bodies about progress in the SVC standardization process. Unfortunately, when the meetings were held, it was not yet possible to give any concrete information about progress in technology selection. Therefore, only information about the status of CE results (including the algorithms behind) could be given, and the results of experts viewing were shortly imported. Both groups showed high interest in SVC, in particular raised by the fact that the solutions investigated are using or extending parts of their own standardization work. Documents reviewed: a) General M10935 Vittorio Barboncini, Tobias Oelbaum M11012 DANAE Consortium M11108 Justin Ridge, Marta Karczewicz, Yiliang Bao, Shawn Wang A Multimedia material Visual quality ranking procedure based on Single or Multiple Viewing Licensing status of software in SVC standardization Comment regarding SVC software selection b) Core Experiments 111 M10931 M10989 Ulrich Benzler, Mathias Wien Han-Kuang Hsu, Chia-Yang Tsai, Hsiang-Cheh Huang, Hsueh-Ming Hang, Tihao Chiang Takahiro Kimoto, Yoshihiro Miyamoto Julien Reichel, Guillaume Baud, Francesco Ziliani Diego Santa Cruz, Julien Reichel, Francesco Ziliani Francesco Ziliani M11010 Konstantin Hanke M11011 Konstantin Hanke M11020 Thomas Wedi M11040 Mathias Wien M11042 Woo-Jin Han M11043 Heiko Schwarz, Detlev Marpe, Thomas Wiegand Woo-Jin Han, Sang-Chang Cha Heiko Schwarz, Detlev Marpe, Thomas Wiegand Woo-Jin Han, Ho-Jin Ha M10934 M10946 M10987 M10988 M11047 M11048 M11049 M11050 M11051 M11052 M11054 M11055 M11056 M11069 M11074 M11085 Woo-Jin Han, Sang-Chang Cha, Jae-Young Lee Heiko Schwarz, Detlev Marpe, Thomas Wiegand Heiko Schwarz, Detlev Marpe, Thomas Wiegand Woo-Jin Han Sang-Chang Cha Woo-Jin Han, Ho-Jin Ha Woo-Jin Han, Sang-Chang Cha, Jae-Young Lee Vatis Jörn Ostermann Davide Maestroni, Marco Tagliasacchi, Stefano Tubaro Gregoire Pau, Beatrice Results of SVC CE3 (Quality Evaluation) Response to CE1b in SVC-- SB-Reach Method for Entropy Coding Response to SVC Core Experiment 1d. Introduction of a Base-Layer Responses of CE1e in SVC: Adaptive update step in MCTF Responses of CE1d in SVC: Base Layer Summary of responces to Ce1d: Introduction of a Baser Layer SVC CE1e - Verification of Visiowave Results on Adaptive Update Step in MCTF Response to SVC CE1e - Spatial Highpass Transition Filtering Verification of HHI Results for Core Experiments on AVC-Based Scalable Video Coding CE2.4 Adaptive Spatial Transforms: Verification of HHI results Verification of SAIT results for SVC on CE1a Motion Scalability SVC Core Experiment 2.1: Inter-layer prediction of motion and residual data Verification of OES/ITRI results for SVC on CE1c Intra Prediction SVC Core Experiment 2.2: Influence of the update step on the coding efficiency Verification of VisioWave results for SVC on CE1d Base Layer Verification of MSRA results for SVC on CE1e Deblocking SVC Core Experiment 2.3: Spatial interpolation SVC Core Experiment 2.4: Adaptive Spatial Transforms Responses of SVC CE1c Intra Predictionl; Pixelinterpolated prediction Responses of SVC CE1d Base Layer; R-D optimized base-layering Responses of SVC CE1e Deblocking; In-loop prediction smoothing verification of HHI results for core experiment on scalible video coding Responses of CE1d in SVC: Base Layer Cross-verification of RWTH results on SVC CE-1e 112 M11095 M11099 M11101 M11107 M11120 M11122 M11123 M11124 M11125 M11127 Pesquet-Popescu Diego Santa Cruz Rafal Lange, Marek Domanski Laukasz Blaszak, Marek Domanski, Rafal Lange, Adam Luczak Justin Ridge, Marta Karczewicz, Yiliang Bao, Shawn Wang Francois Edouard Giovanni Cordara Ji Jizheng Xu M11136 Xiong Jizheng Xu Song Jizheng Xu Ji Jizheng Xu Debin Zhao Feng Wu Xiong Jizheng Xu Feng Wu Song Jizheng Xu Hongkai Xiong Feng Wu Feng Pan, Yin Sun M11137 Joohee Kim, Hyeyeon Kim M11138 HsinHao Chen M11139 Giovanni Cordara M11128 M11129 Cross-verification of results for SVC on CE1d Response to SVC CE2: inter-layer motion information prediction Response to SVC CE2: testing of SNR scalability technologies Extension to AVC-based scalable video coding CE1a : cross verification of MSRA proposal CE1a: TILAB-PdM solution Verification of NCTU results for SVC on CE1b, entropy coding Verification of TILAB/PdM results for SVC on CE1a Verification of SUMSUNG results for SVC on CE1c Responses of CE1d in SVC: Base layer Responses of CE1a in SVC: Scalable Motion Responses of CE1e in SVC: Adaptive update based on human vision system SVC CE1e - Verification of MSRA Results on MCTF adaptation in the temporal update step Responses to SVC CE1a: scalable motion information coding Verification Report of Samsung results for SVC on CE1c: Intra-prediction CE1a : cross verification of Samsung proposal c) Other technical input M10868 M10875 M10902 M10904 M10993 M10997 M11016 David Taubman, Nagita Mehrseresht, Raymond Leung Shijun Sun Francois Edouard, Boisson Guillaume, Vieron Jerome, Bottreau Vincent, Guillemot Christine Vincent Bottreau, Christine Guillemot, Rashid Ansari, Edouard Francois Pateux, Amonou, Kervadec Ihor Kirenko, Rene van der Vleuten, Fons Bruls Joeri Barbarien, Adrian Munteanu, Yiannis SVC Technical Contribution: Overview of recent technology developments at UNSW Temporal Scalable Coding Using AVC Coding Tools Evaluation of Motion accuracy scalability - SVC Core experiment 1a SVC Technical Contribution to Transform using Three Lifting Steps CE1b: A generic framework for MCTF-based coding Flexible Scalable Video Compression Prediction-based scalable motion vector coding 113 Spatial M11039 M11045 M11084 M11096 M11100 M11119 M11126 M11130 M11131 Andreopoulos, Fabio Verdicchio, Jan Cornelis, Peter Schelkens Leszek Cieplinski, Soroush Ghanbari Y. Andreopoulos, A. Munteanu, M. van der Schaar, J. Cornelis, P. Schelkens Gregoire Pau, Beatrice Pesquet-Popescu, Mihaela van der Schaar, Jerome Vieron Thomas Rusert, Mathias Wien Deepak Turaga, Ali Tabatabai, Minh Do Hsin-Hao Chen, Guo-Zua Wu, Yi-Jung Wang Xiong, Jizheng Xu, Feng Wu Zhang, Jizheng Xu, Hongkai Xiong, Feng Wu Zhang, Wenpeng Ding, Jizheng Xu, Hanqin Lu, Feng Wu Preliminary Results of SVC CE1c Comparison Between t+2D and 2D+t Architectures with Advanced Motion Compensated Temporal Filtering Delay-Performance Trade-Offs in MotionCompensated Scalable Subband Video Compression Multi-Layered Motion Estimation with Constrained Enhancement (SVC CE1a) Multiresolution Representation of Motion Information for Scalable Video Coding Proposed CE for Exploiting the Spatial Correlation within the Low-Pass Frames Spatial Scalability in 3D Wavelet Coding with Spatial Domain MCTF Encoder Sub-pixel phase over-complete sub-band transform Responses of CE1b in SVC: Direction prediction for spatial transform d) Requirements M10822 M10853 M10901 M10909 M10932 M10941 M10995 M10998 M11067 M11082 Robert Prandolini Scalable Video Coding Requirements for Video Surveillance Systems Mauri Väänänen Finnish NB comment: SVC requirements and directions Francois Edouard, Vieron Discussion on requirements and applications of Jerome Scalable Video Coding A. G. Tescher for USNB USNB Contribution: Response to Munich resolution 2.2.2 Ulrich Benzler Discussion on requirements and applications for Scalable Video Coding Sachin Deshpande HTTP Agent-Driven Content Negotiation for Scalable Video Coding Pateux, Amonou, Kervadec France Telecom Requirements for Scalable Video Coding Gero Bäse, Andreas Hutter, Requirements for a scalable video coding standard Peter Amon Julien Reichel, Francesco Requirements for Scalable Video Coding for Video Ziliani Surveillance Applications French National Body FNB Position on SVC Standardization 114 M11097 M11106 M11133 Ali Tabatabai, Rohit Puri Justin Ridge Multiple description coding for generalized layering Mobile communications industry comments on SVC requirements Guillemot, Liebl, Discussion on requirements and applications of Stockhammer, Jenkac Scalable Video Coding for MBMS Output documents related to MPEG-21 SVC No. Title TBP Available 21000-13 Scalable Video Coding N6519 N6520 N6521 N6513 N6505 Technologies under Consideration for Working Draft of ISO/IEC 21000-13 Scalable Video Coding Scalable Video Model Version 2.0 Description of Core Experiments in MPEG-21 Scalable Video Coding Results of the visual assessment of the results of the CEs on Scalable Video Coding Technology Applications and Requirements of Scalable Video Coding No 04/07/23 No No 04/08/06 04/08/06 No 04/07/23 No 04/07/23 Explorations 3D AV Coding Multiview video coding (MVC) is a “tool” needed for new and emerging applications such as Free Viewpoint Video (FVV) or 3D-TV. A straight-forward solution would be simulcast of AVC streams. By input brought to this and previous meetings, initial evidence is given that dedicated MVC methods could outperform AVC simulcast. To prove this, a formal Call for Evidence (CfE) shall be issued, which may lead to a subsequent CfP on MVC. Such new technology should expose significant improvement of coding efficiency compared to AVC simulcast, which means significant improvement of PSNR results and/or significant improvement of visual quality, to be measured most probably by expert viewing (similar to the procedure employed in SVC development) in the CfE. Elaboration of an appropriate testing methodology is of high importance in this context. A proposal was made in M10870 to use DSIS compared to original, which would give a scaled and quantified test result. This would however be difficult to perform in reviewing CfE results during an MPEG meeting (maybe later in formal subjective tests when it comes to a CfP). A-B comparison of anchors against proposals by a more coarse decision (better, equal, worse) would provide the evidence that is needed, and could easily be performed by an experts viewing procedure. It is of high importance also to judge the quality distribution over all camera views of a data set. This means that proponents shall provide detailed PSNR results such as – Plots of PSNR over frame for each sequence of each data set – Mean PSNR over each sequence of each data set – Mean PSNR over all sequences of each data set This needs to be produced also for the anchors. Results have to be made available for the complete test data set. The proponents shall report – detailed PSNR results (as above) – algorithms – complexity in relation to AVC (informative, brief) – target application 115 For the purpose of the CfE, 10 test sequence sets with 5-16 views were provided and encoded using AVC simulcast anchors. If each set of sequences would have to be encoded at 3 bitrates, this would make the comparison of 210 sequences for each proposal necessary. To reduce this effort, only two views shall be selected randomly for the viewing. Additionally, results bringing evidence about the interrelation between compression and view interpolation could be submitted. The following timeline is planned – Preliminary Call for Evidence issued in Redmond (public) – Preliminary results are requested for Palma meeting to further refine testing methodology when necessary – Final Call for Evidence issued in October – Results expected for January 2005 Technical input was reviewed as follows: M10929 showed the effect of a spatio-temporal prediction scheme (kind-of multi-frame prediction), Flamenco and Xmas test sequences were chosen. Large gains are reported for Xmas. Subsampling is performed by omitting views, gain decreases with camera distance. No gain for Flamenco, gain increases with temporal subsampling. M10976 resumes the GoGOP proposal from last meeting, presents extended spatio-temporal prediction structure. Reports gain of over 1 dB for most sequences of Race2 data set, also visual quality is improved. M11014 uses the Aquarium sequence and evaluates spatial and temporal frame differences before and after compensation. It presents a projective transform (rectification) and evaluates residual error before and after transformation, which is reduced. M11132 proposes illumination compensation (IC) for MVC, compares ST method with and without IC and reports gain from IC in some (sparse) cases. It compares also to AVC simulcast and reports gain for some sequences Documents reviewed: M10870 Marco Rittermann M10894 M10928 M10929 M10943 M10952 M10970 M10975 M10976 A Proposal for Testing Multi-View Video Coding Stephan Würmlin, Michael Waschbüsch, Image-space Free-viewpoint Video Edouard Lamboray, Peter Kaufmann, Aljoscha Smolic, Markus Gross Wook-Joong Kim, Euee. S. Jang Consideration on the MAF for omnidirectional AV Ulrich Fecker, Andre Kaup Transposed Picture Ordering for Dynamic Light Field Coding Sun Lifeng, Zhang Hu, Yang Shiqiang, Results for EE3 on evaluation of MAC Cheng Xiaoyu, Li Fang for stereoscopic video coding (contributors not present) Cheng Xiaoyu Consideration on Quality Measure for Multiview Video (contributors not present) Li Fang, Sun Lifeng, Yang Shiqiang Consideration on Synthesis Method for Multiview Video Hideaki Kimata, Masaki Kitahara Anchor bitstreams for experiments on multiple view video coding (3DAV) Hideaki Kimata, Masaki Kitahara Preliminary results on multiple view video coding (3DAV) 116 M11014 Masayuki Tanimoto, Toshiaki Fujii Utilization of inter-view correlation for multiple view video coding M11132 Chen Jae, Hoon Kim, Joaquín López, Illumination Compensation for Multi Antonio Ortega View Compression Video Coding Tools Repository Two breakout meetings were held to discuss VCTR matters during the MPEG week. Three contributions are reviewed. A joint meeting with Implementation Study Group was also arranged to discuss issues regarding software and hardware implementation aspects of this work. Throughout the discussion, the updates are made to the Study 2.0 document as an output. Some highlights of VCTR discussions are: What is the Repository? - Is a collection of decoding functional units extracted from existing MPEG standards and updated with new tools whose addition has been considered beneficial by MPEG. What is a Decoder Configuration? - A collection of functional units drawn from the repository. A decoder configuration may be an existing MPEG standard or a new standard that includes new functional units. Intra-only video coding as a starting point – it is decided to pursue VCTR from intra-only video coding first. It is expected to extend VCTR further to encompass inter-frame coding and other functionalities in the future. Remaining issues – There are some remaining open issues such as software implementation of VCTR and detailed picture of VCTR. These remaining issues will be discussed through the continuing AhG activity till October. Details on VCTR can be found in Study 2.0 document (N6522). Documents reviewed: M10966 Euee S. Jang, Lee, Cho, Lee M11142 C.J. Tsai M11143 Kohtaro Asai Initial thoughts on VCTR activity Universal Video Codec Architecture Suggestions Exercise of intra-only video coding tools repository Output documents related to Explorations No. Title TBP Available 3D AV N6494 Preliminary Call for Evidence on Multiple View Video Coding Yes N6501 Applications and Requirements of Multiple View Video Coding Yes Video Coding Tools Repository N6522 Study of Video Coding Tools Repository No 04/07/23 04/07/23 04/07/23 Miscellanea A joint meeting was held with Requirements on issues of Persistent Association Technologies (PAT). It was identified that some technical aspects fall for sure into the competence of the Video 117 group; on the other hand, aspects such as visibility of watermarks that seem to be more important at this moment from a requirements perspective, should rather be discussed with the Test group. Documents reviewed M10885 Jong-Tae Kim, Weon-Geun Oh, HaeKwang Kim, Heung-Kyu Lee, Young-Ho Seo M10886 Ik-Hwan Cho, Hae Kwang Kim, WeonGeun Oh, Dong-Seok Jeong Video Extension to Evaluation Tools for Persistent Association Technologies Composition of Test Video Sequences for Evaluation of the robustness of PAT AHGs established by the Video Subgroup No. 6523 6524 6525 6526 6527 6528 6529 Title AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software AHG on Description Tools for New MPEG-7 Visual Extensions AHG on Core Experiments in Scalable Video Coding AHG on Scalable Video Model and SVC Software AHG on 3DAV Coding AHG on Video Coding Tools Repository 118 Mtg N N Y Y N Y Y Annex 9 Report of Audio meeting Source: S. Quackenbush, Chair, Audio Subgroup 1 OPENING OF THE MEETING ........................................................................................................... 121 2 ADMINISTRATIVE MATTERS ........................................................................................................... 121 2.1 Approval of previous meeting report ......................................................................................................... 121 2.2 Approval of agenda and allocation of contributions ................................................................................. 121 2.3 Communications from the Chair ................................................................................................................ 121 2.4 Joint meetings............................................................................................................................................... 121 2.5 Received National Body Comments and Liaison matters ......................................................................... 121 2.6 Task Groups ................................................................................................................................................. 121 3 AHG MEETINGS ................................................................................................................................ 121 3.1 Synthetic Music Representation (Sunday 0900 – 1800) ............................................................................ 122 3.2 MPEG-4 Lossless Coding (Sunday 1000-1200) ......................................................................................... 122 3.3 Spatial Audio Coding (Sunday 1200-1800) ................................................................................................ 123 4 AUDIO PLENARY, JOINT MEETING AND TASK GROUP ACTIVITIES ......................................... 125 4.1 Review of AHG reports ............................................................................................................................... 125 4.2 Received national body comments and liaison matters ............................................................................ 125 4.3 Audio plenary discussions ........................................................................................................................... 125 4.3.1 Parametric Stereo Verification Test Report ........................................................................................... 125 4.3.2 Spatial Audio Evaluation ....................................................................................................................... 126 4.4 Joint Meetings .............................................................................................................................................. 126 4.4.1 With Requirements, Systems and MDS on MAF Tue 1100-1130 ......................................................... 126 4.4.2 With Requirements on US NB Comment Tue 1130-1200 ..................................................................... 126 4.4.3 With Systems on Audio Codec Behavior, Wed 1600-1700 ................................................................... 127 4.4.4 With Systems on AU ballot comments on MAF, Thu 1230-1400 ......................................................... 127 4.4.5 With Requirements New Profiles and SMR CfP Thu 1400-1430 .......................................................... 127 4.5 Task Group discussions ............................................................................................................................... 127 4.5.1 HE-AAC ................................................................................................................................................ 127 119 4.5.2 4.5.3 4.5.4 4.5.5 4.5.6 4.5.7 4.5.8 4.5.9 5 Layer III ................................................................................................................................................. 128 MPEG-4 Lossless Audio Coding ........................................................................................................... 128 MPEG-7 Audio ...................................................................................................................................... 129 MPEG-A ................................................................................................................................................ 129 MPEG-4 Audio ...................................................................................................................................... 129 Spatial Audio Coding ............................................................................................................................. 130 Symbolic Music Representation............................................................................................................. 130 Scalable Audio Coding .......................................................................................................................... 130 MEETING DELIVERABLES .............................................................................................................. 130 5.1 Press statement ............................................................................................................................................. 130 5.2 Dispositions of Comments ........................................................................................................................... 130 5.3 Responses to Liaison and NB comments .................................................................................................... 130 5.4 Recommendations for final plenary ........................................................................................................... 130 5.5 Establishment of Ad-hoc Groups ................................................................................................................ 130 5.6 Approval of output documents ................................................................................................................... 131 6 FUTURE ACTIVITIES ........................................................................................................................ 131 6.1 Schedule of future meetings ........................................................................................................................ 131 6.2 Agenda for next meeting ............................................................................................................................. 131 6.3 All other business ......................................................................................................................................... 131 6.4 Closing of the meeting ................................................................................................................................. 131 ANNEX A PARTICIPANTS ................................................................................................................... 132 ANNEX B AUDIO CONTRIBUTIONS AND SCHEDULE ..................................................................... 133 ANNEX C TASK GROUPS ................................................................................................................... 139 ANNEX D OUTPUT DOCUMENTS ...................................................................................................... 141 ANNEX E AGENDA FOR THE 70TH MPEG AUDIO MEETING ........................................................... 143 120 Opening of the meeting The MPEG Audio Subgroup meeting was held during the 69th meeting of WG11, July 19-23, 2004, Redmond, WA, USA. The list of participants is given in Annex A. Administrative matters Approval of previous meeting report The 68th Audio Subgroup meeting report had been previously distributed by e-mail and was approved. Approval of agenda and allocation of contributions The agenda and schedule for the meeting was discussed, edited and approved. It shows the documents contributed to this meeting and presented to the Audio Subgroup, either in the task groups or in Audio plenary. The Chair brought relevant documents from Requirements, Systems and MDS to the attention of the group. It was revised in the course of the week to reflect the progress of the meeting, and the final version is shown in Annex B. Communications from the Chair The Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary. Joint meetings The joint meetings with below. Groups Audio, Req, Sys, MDS Audio, Req Audio, Systems Audio, Req Audio, Req Audio over the course of the week are listed here and are reported on What 10944, AUNB Comments 10962, MAF file format USNB Comment 11080, Audio Codec Behavior AUNB DoC Review SMR CfP requirements Review new profile proposals Where Audio Day Tue Time 1100-1130 Audio Audio Audio Audio Tue Wed Thu Thu 1130-1200 1600-1700 1230-1400 1400-1430 Received National Body Comments and Liaison matters The NB Comments and Liaison documents for the meeting that require a response are as shown below. No. Title Response by 10906 USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21 S. Quackenbush 10991 SgNB Comment on the Lossless Audio Coding Work S. Quackenbush 11102 FNB Position Paper on MPEG applications, context and objectives S. Quackenbush Task Groups Task groups were convened for the duration of the MPEG meeting, as shown in Annex C Results of task group activities are reported below. AhG meetings 121 In order to obtain a compete view of the business of this MPEG meeting, discussion of contributions in AhG meetings are recorded in this section of the Audio report. Synthetic Music Representation (Sunday 0900 – 1800) Micheal Good, Recordare, presented 11083 Michael Good Response to Draft Call for Proposals N6457 There was considerable discussion of this document and of the CfP and the Evaluation document. Paolo Nesi presented the following documents: Comments on Symbolic Music 11002 James Ingram Representation requirements Paolo Nesi Pierfrancesco Bellini Examples of matching SMR aspects and 11021 Jerome Barthelemy available technologies James Ingram Neil McKenzie Paolo Nesi Giorgio Zoia Pierfrancesco Bellini Draft Evaluation Criteria for Assessing 11019 Jerome Barthelemy SMR Proposals James Ingram David Crombie Paolo Nesi Giorgio Zoia Study on Draft CfP on Symbolic Music 11025 James Ingram Representation Piefrancesco Bellini MPEG-4 Lossless Coding (Sunday 1000-1200) Ralf Geiger, FhG, presented Ralf Geiger 11079 Juergen Herre On the Performance of MPEG-4 SLS RM4 Rongshan Yu, I2R, presented 11059 Rongshan Yu Crosscheck on FhG’s Proposed Core Experiment for MPEG-4 Audio Scalable to Lossless (SLS) Coding The Audio Chair proposed that Audio Subgroup document the current performance and complexity of SLS and ALS as a Task Group activity. The various authors each presented: Rongshan Yu Susanto Rahardja Reduce Complexity for MPEG-4 Audio 11062 Xiao Lin Scalable Lossless (SLS) Coding Haibin Huang Proposed Core Experiment on Higher 11063 Tilman Liebchen Predictor Orders in MPEG-4 ALS Proposed CE on Additional Enhancements 11114 Yuriy A. Reznik for Lossless Audio Coding 122 Spatial Audio Coding (Sunday 1200-1800) Werner Oomen presented Heiko Purnhagen CT/Philips contribution to CfP on spatial 11001 Werner Oomen audio coding Philips and CT presented their submission in response to the CfP on spatial audio coding (M11001). The Philips/CT architecture is completely based on the parametric strereo technology as standardised in Amd2. Philips/CT presented informal test results for all the 3 configurations that will be evaluated prior to the next meeting. Additionally, the document contained input on this evaluation process. Listening test participants were given careful instructions with respect to assessment of coding distortions and sound stage distortions. Three test results were presented for 5-1-5 and 5-2-5 with AAC core and 48 kb/s with HE-AAC core. Proposals for evaluation of multi-channel material Use 5.0 material only Use 44.1 kHz material only Evaluation of downmixed material Use band-limited ITU downmixes as lowpass anchors Use RMS values for normalization of downmixes Selection criterion 1. mean quality is paramount 2. Consistency of individual items (select technology that maximizes the minimum performance) 3. Complexity 4. Features Spatial side information bitrate Higher for 5-1-5 and 5-2-5, e.g. 32 kb/s total Lower rates will be tested by 48 kb/s HE-AAC test scenario 48 kb/s test will use a single integrated bitstream (with side information muxed into the main bitstream) so that one can insure that the AAC input buffer requirements are met. Test material categories “orchestral” sound stage “synthetic” sound stage movie sound track (i.e. strong center channel dialog) “pathological” material (e.g. castpan or applause) Jim Johnston, Microsoft, noted that it would be very good if some of the test items represented acoustic soundfields as result from actual recordings. Many currently available test items are mixed from discrete voices which may not represent a soundfield of an actual performance. Kok-Seng Chong presented Naoya Tanaka Technical Description and Performance 11015 Kok-Seng Chong Test Results of Panasonic Spatial Audio Kazuhiro Iida Coding This document presented listening test results for 6-1-6 and 6-2-6 modes using an AAC core. It noted that the bandwidth of the proposed technology was limited due the bandwidth of the AAC core. Side information rate was less than 24 kb/s for 6-1-6 and less than 32 kb/s for 6-2-6. They matched the level of the Dolby Prologic II signal to that of the other processed test items via multilistener subjective assessment. 123 Kazuhiro Iida presented comments on the evaluation process. The perception of multi-channel signals have three attributes: Spatial (soundstage) Temporal (reverberation) Qualitative (e.g. timber) He proposes that listening test responses try to capture Spatial attribute (e.g via a separate response panel) Timber (e.g. via a conventional MUSHRA response panel) There was some very interesting discussion on low anchors: low “frequency” filtered or low “space” filtered. The Audio Chair suggested that it might be best if the Audio Subgroup not make the CfP evaluation into a research project on low anchors for spatial audio coding. Juergen Herre, FhG, presented Juergen Herre Christof Faller 11075 C. Spenger Fraunhofer/Agere Submission to Spatial Audio CfP J. Hilpert K. Linzmeier Proposed the following general system characteristics That the technology be “coder-agnostic.” One outcome of this position is that the technology needs to adapt to a range of coder frame lengths. That the system does not depend on a given downmix procedure. One extreme of this position is that the technology support arbitrary, externally generated downmixes of the multichannel signal, most significantly as done by an expert sound engineer. Side information rate was less than 20 kb/s for 5-1-5 and below 24 kb/s for 5-2-5. The presentation suggested that the evaluation might want to consider multiple technology solutions that may present complexity/quality tradeoffs. Mark Vinton presented Matt Fellers Mark Vinton 11090 Mark Davis Grant Davidson Dolby Laboratories Submission to CfP on MPEG-4 Spatial Audio Coding Listening test used 16 kb/s for side information and 64 kb/s AAC for encoding the downmix. The test evaluated two systems for n-1-n and one system for n-2-n. Dolby is able to make available a new 5.1 test item (“Stomp”) for this MPEG work. Dolby’s only comment on evaluation process is that the currently proposed Test 3 should instead use a “black box” encoder rather than a “user-optimized” encoder. Juergen Herre presented 11076 Juergen Herre Evaluation of Spatial Audio Coding Schemes This contribution made two points concerning evaluation. First point is that systems that exploit spatial coding may be optimal at one listener position but not another. Hence it proposes that systems be evaluated for “off-center” listening positions, or at least that a “sanity check” be conducted at off-center listening positions. This may be implemented as additional listener instructions and associated listener comments. The second point is that support for external downmixes (e.g. hand-crafted stereo mixes) is very important for success in the marketplace. Potential customers that currently rely on such hand-crafted stereo mixes may be reluctant to adopt a technology that has been tested only on automatically generated stereo mixes. FhG has made available two sets of handcrafted material, one stressing the instruments present in the downmix, the other stressing the soundstage of the downmix. The goal in using these downmixes is twofold: first to test that a “well-behaved” hand-crafted downmix can lead to a highly acceptable multichannel signal; the second is that a “pathological” hand-crafted downmix (e.g. missing an instrument) does not result in a multichannel signal with artefacts due to the missing instrument. 124 Finally, the contribution observes that certain test items will stress the core coder (i.e. AAC at 64 kb/s/channel) to the extent that the core coder distortion will dominate the spatial audio coder presentation. FhG endorses evaluation using 5.1 (i.e. subwoofer) signals. Discussion of evaluation Paul Jessop, IFPI, stated that many respected mastering studios only produce separate hand-crafted stereo and multichannel mixes. He suspects that technology that can only present automated stereo downmix from the multichannel signal will not be endorsed by artists or mastering engineers and hence might not be accepted in the marketplace. Werner Oomen, Philips, stated that a significant number of SACDs have their associated stereo mixes generated automatically. Furthermore, he noted that many hand-crafted downmixes may involve dubs to analog tape, such that they are no longer exactly time-aligned with the 5-channel mix. This may argue for two use cases: Compatible with hand-crafted downmixes. Ultimate compression of 5-channel signal, in which case downmix signal does not have to be evaluated. Jim Johnston, Microsoft, noted that he endorses off-axis evaluation. He also recommends that material be selected so that it is well-behaved in off-axis listening. Schuyler Quackenbush, Audio Research Labs, presented Schuyler DRAFT Procedures for the Evaluation of Spatial Audio Coding Quackenbush Systems This draft document will be discussed during the MPEG week. 11065 Audio plenary, joint meeting and task group activities Review of AHG reports There were no requests to review any of the AHG reports. Received national body comments and liaison matters The Audio Chair presented the NB Comments listed in Section 0. Audio plenary discussions Parametric Audio Coding Verification Test Report Werner Oomen presented 11005 Martin Link Subjective results formal verification test MPEG4-Ext2. (Parametric) Martin Link from the IRT has conducted the formal verification test for Amd2 (parametric). FhG provided the AAC coded items. The tests have been performed for mono and stereo at bitrates around 20kbps total, using headphones with 26 subjects. The raw test results were submitted as an input document to the meeting (M11005). From these test results it could be concluded that the acceptance criteria were met for stereo. For mono, there were two items that performed statistically significant worse than AAC on the same bit-rate. It was noted that one of these items was bandlimited. Overall, the parametric coder performance was comparable to AAC when the latter was running at 25% higher bit-rate. Werner Oomen presented 11037 Werner Oomen Complementary information to Formal verification test parametric Philips brought informal test results (M11037) illustrating the relative performance of parametric at 24kbps stereo compared to AAC at 32kbps stereo. Furthermore, this input showed the capabilities of the parametric stereo tool. For the same bitrate there is only a slight decrease in quality for mono 125 compared to stereo. The audio subgroup agreed to incorporate the information given in M11037 into the final test report (N6675) under the heading “discussion.” Spatial Audio Evaluation This was the most important work for the week, and the task group spent considerable time editing the text so that it expressed a consensus view. The result is in N6691, “Workplan for the Evaluation of Spatial Audio Coding.” Responses Joint Meetings With Requirements, Systems and MDS on MAF Tue 1100-1130 Review of AHG report Part 1 will give an overview of the framework of the MPEG Application Format, while subsequent parts will specify the application formats themselves. It is envisioned that the reference code for this specification will be only the “glue” code that is required to integrate the various parts of the MPEG specifications (and there associated reference software). The file format could be MPEG-4 (*.mp4) or MPEG-21 (*.m21) or one file that is both. On MAF 10961 Wo Chang, Schuyler Quackenbush MAF Reference Software Workplan Proposal 10962 Wo Chang MAF File Format Proposal We expect that there will be two MAF-1 implementations in October. A workplan was presented, and it was noted that either Osmo4 or mplayer player could be used as a playback vehicle. Quackenbush reviewed the anticipated DoC for the MAF Music Player CD text, which is summarized here: MP4 file containing a song MP21 file containing a song MP21 file that is collection of songs (included as actual MP4 files in mdat area) MP21 DiD that declares a playlist Inclusion of binary metadata Olivier Alvaro suggested that it might be interesting to include explicit presentation information as part of the document. There was some discussion, but the consensus was that it would be appropriate to keep things simple at this stage. With Requirements on US NB Comment Tue 1130-1200 Jim Johnston, Microsoft, presented A. G. Tescher for USNB Contribution: Proposed CfP for Scalable Audio under 10906 USNB MPEG 21 The goal of the proposed work item would be to see what performance could be achieved if there was No requirement for low-latency (i.e. the system would not be used for two-way interactive communication) No requirement for MPEG-backward-compatability. And to see if, given this scenario, there is a compression scheme that could approach the performance of the best speech coders and the best music coders. Because the MPEG week was very busy, a complete discussion of this task was deferred to an AhG 6668, AHG On Exploration of Scalable Audio and Speech Coding. It is envisioned that the evidence that would motivate a new work item would be: Use case scenarios o one to many in radio broadcast networks Compression efficiency required for success in the marketplace 126 Compelling functionalities o bandwidth shedding in the network via simple frame truncation Yuriy Resnik, Realnetworks, noted that we must define “scalability,” For example, is it “midstream” (i.e. in-network) scalability or is it a scalable representation on “disk” by which a server could stream at various rates. Contact Voiceage/Erikson on whether AMR-WB+ can be made available for MPEG use With Systems on Audio Codec Behavior, Wed 1600-1700 The group reviewed m11080, “Description of Audio Codec Behavior” and made some corrections to the text, which is available as N6682, “Timestamps and Audio Codec Behavior.” The document concludes that Systems must adjust time stamps in the case that the audio decoder can operate in a regular (higher delay) or “backward compatible” (lower delay) modes. With Systems on AU ballot comments on MAF, Thu 1230-1400 The group met over lunch and competed the DoC for the Music Player CD text. The following items will be incorporated in the FCD text: MP4 file containing a song MP21 file containing a song MP21 file that is collection of songs (included as actual MP4 files in mdat area) MP21 DiD that declares a playlist With Requirements New Profiles and SMR CfP Thu 1400-1430 Kristofer Kjörling presented the proposed HEAAC V2 profile, which was discussed. It is necessary to register statements of support in order to motivate creation of a new profile. Requirements will sponsor a resolution asking for statements of support as contributions to the next MPEG meeting. The Audio subgroup will document the proposal in a new version of N6384, “MPEG-4 profiles under consideration,” which will be an output of this meeting. The Requirements Chair noted that a request for amendment and associated amendment text must be approved at the Wednesday Plenary of the next MPEG meeting in order to progress as quickly as possible. Paulo Nesi presented CfP on SMR, which was approved by Requirements. However, the Requirements Chair requested that the WG11 IPR policy be explained in a short paragraph in the Call and also as an attachment to the Call. Task Group discussions HE-AAC Kristofer Kjörling, Coding Technologies, presented ITTF via SC 29 Table of Replies on ISO/IEC 15938-3:2002/FDAM 1 [SC 29 N 10842 Secretariat 6063] 10921 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 5 New profile proposal combining HE-AAC and Parametric 11008 Kristofer Kjörling Stereo The proposed profile was discussed, and the conclusion was to add it to the WG11 document “New Profiles under Consideration.” Andreas Schneider, Coding Technologies, presented Per Ekstrand 11009 Andreas Schneider Proposed additions to Sbr conformance testing Kristofer Kjörling 127 This was discussed. The Audio Chair noted that it is not possible for Conformance to modify a standard, which this seems to be doing. The consensus was that the Reference Code be modified to teach how to realize the filterbank options and that Conformance be modified as proposed to test the various filterbank realization options. Layer III Ralph Sperschneider, FhG, presented Ralph 10804 Study on ISO/IEC 14496-3:2001/FPDAM 3 (MP3onMP4) Sperschneider 10809 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-3/FPDAM 3 [SC 29 N 6047] 10922 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 2 Summary of Voting on ISO/IEC TR 1381810788 SC 29 Secretariat 5:1997/Amd.1:1999/DCOR 2 [SC 29 N 5998] The proposed changes, except that the proposed 96 kHz sampling rate, were accepted into the MP3onMP4 FDAM text. This included a mechanism to extend the audioObjectType field. MPEG-4 Lossless Audio Coding ALS The various authors each presented: Tilman Verification Report on MPEG-4 ALS Core Experiment 5 (Coding of 11060 Liebchen LPC Coefficients) Verification Report on MPEG-4 ALS Core Experiment 4 (Coding of 11112 Yuriy A. Reznik Random Access Frames) Noboru Harada Proposal of CE for improved floating-point compression in ALS (Audio 10968 Yongshan Yu Lossless Coding) Yutaka Proposal of CE on Multi channel extension for ALS (Audio Lossless 10969 Kamamoto Coding) Noboru Harada SLS The various authors each presented: Rongshan Yu Xiao Lin Proposed WD3 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable 11058 Susanto Lossless Coding (SLS) Rahardja Haibin Huang Tilman Liebchen Proposed Text of ISO/IEC 14496-3:2001/PDAM 4, Audio Lossless 11061 Yuriy A. Coding (ALS) Reznik Proposed WD4 of ISO/IEC 14496-3:2001/AMD 5, Audio Scalable 11078 Ralf Geiger Lossless Coding (SLS) Oversampled Audio At this meeting the Lossless coding of oversampled audio progressed to FPDAM (N6674). Since there were no ballot comments, there was no DoC. Discussion on ALS and SLS 128 The task group members did a huge amount of work during the MPEG week to gather information on performance and computational complexity. The results are found in N6676, “Status of Performance and Complexity of MPEG Lossless Audio Coding Architectures.” Compression performance of both systems is very similar, so that the data set does not permit us to resolve any differences between the performances of the two systems. Tillman wishes to reference performance of initial submissions. ALS might address very different markets, e.g. the professional digital audio workstation marketplace, in which processors are floating-point CISC, and the embedded processor market, in which processors are 32-bit integer RISC processors. SLS is envisioned to address the embedded market. It was agreed that the Performance Report will not sum the multiplies and additions into a “Total” column, since some platforms (e.g. RISC) may realize these as separate instructions, while other platforms (e.g. DSP chips) may realize these as a single instruction. In general, the document will refrain from drawing conclusions, but rather just present complexity numbers for various architecture and operating point configurations. Jim Johnston, Microsoft, presented a list of CDs that he felt would be appropriate for expanding the lossless coding data set. His proposal was that: Everyone purchase CDs and rip them using “eac” (exact audio copy – freeware) and document rip using cksum. Process using ALS and SLS technology using various parameter settings. MPEG-7 Audio Matthias Gruhne, FhG, presented 10806 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-7/FPDAM 1 [SC 29 N 6046] 10916 SC 29 Secretariat Summary of Voting on ISO/IEC 15938-6:2003/FPDAM 1 Matthias Gruhne 11033 Proposed Core Experiment on Audio Rhythm Patterns Jan Rohden The Audio subgroup agreed to accept the proposed core experiment. MPEG-A Schuyler Quackenbush, Audio Research Labs, presented 10878 SC 29 Secretariat Summary of Voting on NP MPEG-A [SC 29 N 6099] 10879 SC 29 Secretariat Summary of Voting on CD MPEG-A [SC 29 N 6101] 11006 Adam Lindsay ID3v2 Tags in MPEG-A Most of the discussion of this topic occurred in the joint meeting with Systems (see Section 0). MPEG-4 Audio The various authors of each contribution presented: ITTF via SC 29 10841 Table of Replies on ISO/IEC 14496-3:2001/FDAM 2 [SC 29 N 6062] Secretariat Eunmi Oh 11018 Proposed changes in MPEG-4 BSAC multi-channel audio coding Miyoung Kim JungHoe Kim 11026 SangWook Kim Comments on MPEG-4 BSAC Conformance Eunmi Oh Juergen Schmidt Simple Integration Reference Software for MPEG-4 AudioBIFS, 11029 Klaus Eiltsversion 3 Grimm Werner Oomen 11035 Proposed corrigenda to AMD2, (parametric) Heiko Purnhagen 129 Ralph Problem with buffer fullness derivation in the case of Sperschneider number_of_raw_data_blocks_in_frame>0 and protection_absent=0 Ralph 11072 Status on MPEG-4 Audio Conformance Sperschneider Ralph 11073 Proposed ISO/IEC 14496-3:2004 (Audio 3rd Edition) Sperschneider Due to the very full Audio schedule, there was not sufficient time to discuss and decide on the proposals made in m11018 or m11029. 11071 Spatial Audio Coding On Tuesday afternoon the task group listened to proponent submissions in the Microsoft 5.1 channel listening room. On Wednesday afternoon the task group selected test material for use in evaluating the Spatial Audio Coding Call for Proposals. The test items will be: Number Name Category Remarks 1 pops music (back: direct) 2 chostakovitch music (back: direct) 3 poulenc music (back: direct) 4 jackson1 music (back: ambience) 5 rock concert music (back: ambience) 6 indie2 movie sound 7 Stomp movie sound LFE available 8 ARL applause pathological & ambience 9 BBC applause pathological & ambience 10 glock pathological & ambience 11 fountain music pathological & ambience Symbolic Music Representation The SMR Call for Proposals document and the Draft Evaluation document both had extensive editing by the task group Tuesday and Wednesday in the MPEG week. This resulted in significantly better text in the CfP and a much clearer articulation of the evaluation process. The Draft Evaluation document will be included in the CfP public package. Meeting deliverables Press statement The Audio part of the press statement was prepared, but there was not sufficient time for it to be reviewed. Dispositions of Comments All DoC were prepared and reviewed. Responses to Liaison and NB comments There were no liaison responses. The response to the NB were prepared and approved. Recommendations for final plenary The Audio recommendations were presented and approved. Establishment of Ad-hoc Groups The following ad-hoc groups were established by the Audio subgroup: 130 No. 6664 6696 6665 6666 6667 6668 Title AHG on Audio Standards Maintenance AHG on MPEG-7 Audio AHG on Spatial Audio Coding AHG on MPEG-4 Lossless Audio Coding AHG on Symbolic Music Representation AHG On Exploration of Scalable Audio and Speech Coding Mtg No No Yes Yes Yes Yes Approval of output documents All output documents, shown in Annex D, were presented in Audio plenary and were approved. Future activities Schedule of future meetings Ad Hoc group meetings are indicated in Section 0. Unless otherwise indicated, Ad Hoc group meetings will be held at the location of the next MPEG meeting on the weekend preceding that meeting. Agenda for next meeting The agenda for the next MPEG meeting is shown in Annex E All other business There was none. Closing of the meeting The 69th Audio Subgroup meeting was adjourned Friday at 14:00. 131 Annex A Participants First Name Schuyler Kristofer Heiko Bernhard Ingo Khosrow Matt Mark Giorgio Jeongil Bernhard Jürgen Ralph Ralf Matthias Cotarmanac’h Susanto Lin Rongshan James Mauri Toshiyuki Takehiro Yutaka Sua Hong Werner Yuriy Sang-Wook Eunmi Boehm Tilman Dai Dai Last Name Quackenbush Kjörling Purnhagen Feiten Wolf Lashkari Fellers Vinton Zoia Seo Grill Herre Sperschneider Geiger Gruhne Alexandre Rahardja Xiao Yu Johnston Väänänen Nomura Moriya Kamamoto Neo Oomen Reznik Kim Oh Johannes Liebchen Yang YANG Country USA S S DE DE USA USA USA CH KR DE DE DE DE DE FR SG SG SG USA FIN JP JP JP SG NL USA KR KR CE DE USA USA Affiliation ARL Coding Technologies Coding Technologies Deutsche Telekom Deutsche Telekom DoCoMo USA Labs Dolby Dolby EPFL ETRI FhG IIS FhG IIS FhG IIS FhG IIS AEMT FhG IIS AEMT France Telecom R&D I2R I2R I2R Microsoft Nokia Res. Center NEC NTT NTT/The Univ. of Tokyo Panasonic Philips RealNetworks Samsung Samsung Thomson TU Berlin Vidiator Technology Vidiator Technology (US) Inc Annex B Audio Contributions and Schedule Time Agenda Item Number Title Sunday 0900-1800 Michael Good 11002 James Ingram 11019 11025 1000-1200 11079 11059 Paolo Nesi Pierfrancesco Bellini Jerome Barthelemy James Ingram Neil McKenzie Paolo Nesi Giorgio Zoia Pierfrancesco Bellini Jerome Barthelemy James Ingram David Crombie Paolo Nesi Giorgio Zoia James Ingram Piefrancesco Bellini Ralf Geiger Juergen Herre Rongshan Yu Susanto Rahardja Xiao Lin Haibin Huang Examples of matching SMR aspects and available technologies X Draft Evaluation Criteria for Assessing SMR Proposals X Study on Draft CfP on Symbolic Music Representation On the Performance of MPEG-4 SLS RM4 Crosscheck on FhG’s Proposed Core Experiment for MPEG-4 Audio Scalable to Lossless (SLS) Coding X X X Reduce Complexity for MPEG-4 Audio Scalable Lossless (SLS) Coding CT/Philips contribution to CfP on spatial audio coding Technical Description and Performance Test Results of Panasonic Spatial Audio Coding X Christof Faller C. Spenger J. Hilpert K. Linzmeier Fraunhofer/Agere Submission to Spatial Audio CfP Yuriy A. Reznik 11075 X Heiko Purnhagen Werner Oomen Naoya Tanaka Kok-Seng Chong Kazuhiro Iida Juergen Herre 11114 11015 X X Tilman Liebchen 11001 X Proposed Core Experiment on Higher Predictor Orders in MPEG-4 ALS Proposed CE on Additional Enhancements for Lossless Audio Coding 11063 1300-1700 Response to Draft Call for Proposals N6457 Comments on Symbolic Music Representation requirements AHG on Lossless Coding Rongshan Yu 11062 Source AHG on Symbolic Music Representation 11083 11021 MPEG2/4/7 X AHG on Spatial Audio Coding 133 X X SMR Time Agenda Item Number Title Source Matt Fellers Mark Vinton Mark Davis Dolby Laboratories Submission to CfP on MPEG-4 Spatial Audio Coding 11090 MPEG2/4/7 X Grant Davidson 11076 Juergen Herre 11065 Schuyler Quackenbush Monday 0900-1330 1330-1430 1430-1800 Evaluation of Spatial Audio Coding Schemes DRAFT Procedures for the Evaluation of Spatial Audio Coding Systems X X MPEG Plenary Lunch Audio Plenary Audio Chair Opening of the meeting Administrative matters Approval of agenda Approval of 68th MPEG meeting report X X X Communications from the Chair - Review of Sun Chairs meeting Allocation of contributions to agenda and schedule Joint meetings Review of AhG reports 10767 S. Quackenbush 10768 Tilman Liebchen 10769 Paolo Nesi Giorgio Zoia Task groups and mandates National body comments 10906 A. G. Tescher for USNB 10991 LEE 11102 FNB 1400-1600 1600-1630 Martin Link 11037 Werner Oomen 1800- X X AHG on Spatial Audio Coding AHG on MPEG-4 Lossless Audio Coding X AHG on Symbolic Music Representation X USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21 SgNB Comment on the Lossless Audio Coding Work FNB Position Paper on MPEG applications, context and objectives Plenary discussions SGNB comment FNB comment USNB comment MPEG-4 Issues 11005 1700-1800 X X X X X X X X X Subjective results formal verification test MPEG4-Ext2. (Parametric) Complementary information to Formal verification test parametric Spatial CfP Evaluation HOD Meeting 134 X X SMR Time Agenda Item Number Title Source Audio Plenary Outline plan for the day Audio Chair Tuesday 0900 0800-1230 Symbolic Music Representation 0900-1130 MPEG-4 10841 11018 11026 11029 11035 ITTF via SC 29 Secretariat Eunmi Oh Miyoung Kim JungHoe Kim SangWook Kim Eunmi Oh Juergen Schmidt Klaus Eilts-Grimm Werner Oomen Heiko Purnhagen 11071 Ralph Sperschneider 11072 Ralph Sperschneider 11073 Ralph Sperschneider 1100-1130 MPEG2/4/7 Table of Replies on ISO/IEC 144963:2001/FDAM 2 [SC 29 N 6062] Proposed changes in MPEG-4 BSAC multi-channel audio coding Comments on MPEG-4 BSAC Conformance Simple Integration Reference Software for MPEG-4 AudioBIFS, version 3 Proposed corrigenda to AMD2, (parametric) Problem with buffer fullness derivation in the case of number_of_raw_data_blocks_in_frame>0 and protection_absent=0 Status on MPEG-4 Audio Conformance Proposed ISO/IEC 14496-3:2004 (Audio 3rd Edition) Joint with Sys, MDS, Req Wo Chang, Schuyler Quackenbush Multimedia Application Format 10962 Wo Chang MAF File Format Proposal 1130-1200 Joint with Req US NB Comment A. G. Tescher for USNB USNB Contribution: Proposed CfP for Scalable Audio under MPEG 21 Spatial Coding listening session Microsoft listening room 10961 10906 1300-1700 1200-1300 1300-1500 11060 11112 MAF Reference Software Workplan Proposal X X X X X X X Req X X Audio X Lunch Lossless Coding Tilman Liebchen Yuriy A. Reznik 10968 Noboru Harada Yongshan Yu 10969 Yutaka Kamamoto Noboru Harada Verification Report on MPEG-4 ALS Core Experiment 5 (Coding of LPC Coefficients) Verification Report on MPEG-4 ALS Core Experiment 4 (Coding of Random Access Frames) Proposal of CE for improved floatingpoint compression in ALS (Audio Lossless Coding) Proposal of CE on Multi channel extension for ALS (Audio Lossless Coding) 135 X X X X SMR Time Agenda Item Number Title Source Rongshan Yu Proposed WD3 of ISO/IEC 144963:2001/AMD 5, Audio Scalable Lossless Coding (SLS) Proposed Text of ISO/IEC 144963:2001/PDAM 4, Audio Lossless Coding (ALS) Proposed WD4 of ISO/IEC 144963:2001/AMD 5, Audio Scalable Lossless Coding (SLS) 11058 11061 11078 1830-1900 1800-1900 1900- Wednesday 0900-1100 1100-1130 1130-1300 Xiao Lin Susanto Rahardja Haibin Huang Tilman Liebchen Yuriy A. Reznik Ralf Geiger MPEG2/4/7 X X X Audio Plenary Status for Chairs Meeting Liaison Meeting Chairs Meeting MPEG Plenary Audio Plenary Report on Chairs meeting and outline of plan for the day Audio Chair Layer III 10804 Ralph Sperschneider 10809 SC 29 Secretariat 10922 SC 29 Secretariat Study on ISO/IEC 144963:2001/FPDAM 3 (MP3onMP4) Summary of Voting on ISO/IEC 144963/FPDAM 3 [SC 29 N 6047] Summary of Voting on ISO/IEC 138184:200X/FPDAM 2 X X X MPEG-2 AAC 10788 1300-1700 1300-1400 1400-1500 10842 SC 29 Secretariat Summary of Voting on ISO/IEC TR 13818-5:1997/Amd.1:1999/DCOR 2 [SC 29 N 5998] Spatial Coding listening session Microsoft listening room Lunch HE-AAC ITTF via SC 29 Secretariat 10921 SC 29 Secretariat 11008 Kristofer Kjörling 11009 Per Ekstrand Andreas Schneider Kristofer Kjörling 1500-1600 X Table of Replies on ISO/IEC 159383:2002/FDAM 1 [SC 29 N 6063] Summary of Voting on ISO/IEC 138181:2000/FPDAM 5 New profile proposal combining HEAAC and Parametric Stereo X X X X Proposed additions to Sbr conformance testing MPEG-7 10806 SC 29 Secretariat 10916 SC 29 Secretariat Summary of Voting on ISO/IEC 159387/FPDAM 1 [SC 29 N 6046] Summary of Voting on ISO/IEC 159386:2003/FPDAM 1 136 X X SMR Time Agenda Item Number Title Source Matthias Gruhne Jan Rohden Proposed Core Experiment on Audio Rhythm Patterns 11033 1600-1700 SC 29 Secretariat 10879 SC 29 Secretariat 11006 Adam Lindsay 11080 1800-2200 X MPEG-A 10878 1600-1700 MPEG2/4/7 Summary of Voting on NP MPEG-A [SC 29 N 6099] Summary of Voting on CD MPEG-A [SC 29 N 6101] ID3v2 Tags in MPEG-A Joint with Systems S. Quackenbush H. Purnhagen X X X Audio X Description of Audio Codec Behavior Social Thursday 1230-1400 10944 1300-1400 1400-1430 1830-1900 1900- Joint with Systems AUNB AUNB Comments on MPEG-A CD Lunch Joint with Req Proposed new profiles SMR At Requirements (Lassen) Audio Plenary Review list of deliverables Review list of AHGs Status for Chairs Meeting Chairs Meeting Audio Chair 0938 Friday 0900-1300 Audio Plenary Report on Chairs meeting and outline of plan for the day Discussion of unallocated contributions Meeting deliverables Press statement Dispositions of comments Responses to NB comments Liaison statements Recommendations for final plenary Establishment of new Ad-hoc groups Approval of output documents Future activities Audio Chair 137 SMR Time Agenda Item Number Title MPEG2/4/7 Source Agenda for next meeting A.O.B. Closing of the Audio meeting 1300-1400 Lunch 1400- MPEG Plenary 138 SMR Annex C Task Groups 1. HE-AAC Chair: Heiko Purnhagen 13818-1:2000/AMD 5:200x FDAM 14496-5:XXX/AMD 6 FDAM Mandates: 1.1. Review contributions 1.2. Produce final text of 13818-1:2000/FDAM 5:2004 “New audio profile and level signaling” 1.3. Insure that HE-AAC code is available as part of 14496-5:XXX/AMD 6 “Advanced Video Coding and HE-AAC Audio reference software” 2. Layer III Chair: R. Sperschneider 13818-4:200X/AMD 2:2000x FDAM 14496-3:2001/AMD 3 FDAM Mandates: 2.1. Produce DoC on 13818-4:200X/ FPDAM 2:200x “Audio Conformance Extensions” 2.2. Produce text of 13818-4:200X/ FDAM 2:200x “Audio Conformance Extensions” 2.3. Produce final text of Draft 11172-3:xxxx/ FDAM 3 “MPEG-1 Access Units” 2.4. Produce “Study on MPEG-1 LIII new sampling rates” 3. Lossless Coding Chair: S. Quackenbush 14496-3:2001/AMD 4 TBD 14496-3:2001/AMD 5 TBD Mandates: 3.1. Review contributions 3.2. Compile latest performance results 3.3. Discuss next steps for work 4. MPEG-7 Chair: Matthias Gruhne 15938-6:200X/AMD 1 FDAM 15938-7:200X/AMD 1 FDAM Mandates: 4.1. Review contributions 4.2. Insure that reference software and conformance descriptions are available 4.3. Produce final text of 15938-7:200X/ FDAM 1 “Audio conformance extensions” 5. MPEG-A Chair: S. Quackenbush 24736 FCD Mandates: 5.1. Review contributions 5.2. Move to part 2 (part 1 is “Introduction”) 5.3. Prepare DoC on 24736:200X CD, “Player Application Format” 5.4. Prepare text of 24736:200X FCD, “Player Application Format” 139 6. MPEG-4 Audio Issues Chair: S. Quackenbush Mandates: 6.1. Review contributions 6.2. Produce “Formal Verification Report on MPEG-4 Parametric Audio Coding” 6.3. Discuss MPEG-4 Audio conformance issues and revise status as necessary 6.4. Discuss and possibly revise “Timestamps and Audio Codec Behavior” 6.5. Discuss Proposed ISO/IEC 14496-3:2004 (Audio 3rd Edition) 6.6. Discuss FNB comment on Audio overview 7. Spatial Audio Coding Chair: S. Quackenbush Mandates: 7.1. Review submissions to the CfP 7.2. Select Evaluation Test Material 7.3. Produce “Workplan for the Evaluation of Spatial Audio Coding Systems” 8. Symbolic Music Representation Chair: P. Nesi Mandates: 8.1. Review contributions 8.2. Produce “DRAFT Procedures for the Evaluation of Symbolic Music Representation” 8.3. Produce “Call for Proposals for Symbolic Music Representation” 9. Scalable Audio Coding Chair: J. Johnston Mandates: 9.1. Review and respond to USNB comment 9.2. Draft workplan for exploration Standards under Development: Name Description Progress to 13818-1:2000/AMD 5:200x New audio profile and level signaling and changes to audio type FDAM 13818-4:200X/AMD 2:2000x Audio Conformance Extensions (new bitstreams for Audio LIII) FDAM 14496-3:2001/AMD 3 MPEG-1 Access Units and New sampling rates FDAM 14496-3:2001/AMD 4 ASL CD 14496-3:2001/AMD 5 SLS CD 14496-5:XXX/AMD 6 Advanced Video Coding and HE-AAC Audio reference software FDAM 15938-6:200X/AMD 1 Audio software extensions FDAM 15938-7:200X/AMD 1 Audio conformance extensions FDAM 24736-1:200X MPEG-A: Music Player Application Format CD Note: FDAM is final document (no more comments!) 140 Annex D Output Documents MPEG-2 No. Title TBP Available 13818-7 MPEG-2 AAC 23/7/04 6669 Text of 13818-7:2004/DCOR 1 “AAC ADTS buffer fullness correction” MPEG-4 No. 6670 6671 6672 6673 6674 6675 6676 6677 6678 6679 6680 6681 6682 Title TBP Available 14496-3 MPEG-4 Audio DoC on 14496-3:2001/FPDAM 3, MPEG-1/2 Audio in MPEG-4 23/7/04 Text of 14496-3:2001/FDAM 3, MPEG-1/2 Audio in MPEG-4 23/9/04 Text of 14496-3:2001/PDAM 4, Audio Lossless Coding (ALS) 30/8/04 Text of 14496-3:2001/PDAM 5, Scalable Lossless Coding (SLS) 30/8/04 Text of 14496-3:2001/FPDAM 6, Lossless coding of 1-bit oversampled 6/8/04 signals Formal Verification Report on MPEG-4 Parametric Audio Coding 23/7/04 Status of Performance and Complexity of MPEG Lossless Audio 23/7/04 Coding Architectures Proposed 3rd Edition of 14496-3 23/9/04 Study on High-Sampling Rate for MPEG-1/2 Layer III 23/9/04 Proposed Enhancements to MPEG-4 BSAC multi-channel 23/7/04 Workplan for Audio Lossless Coding (ALS) 23/7/04 Workplan for Scalable Lossless Coding (SLS) 23/7/04 Timestamps and Audio Codec Behavior 23/9/04 No. Title 14496-4 MPEG-4 Conformance 6683 Status of MPEG-4 Audio Conformance 6684 Proposed New Audio Conformance Bitstreams for BSAC TBP Available 23/7/04 23/7/04 MPEG-7 No. Title 15938-4 MPEG-7 Audio 6685 Workplan for Audio Rhythmic Pattern TBP Available 23/7/04 MPEG Application Formats No. Title 23001-1 Application Formats: Introduction 6686 Introduction to MPEG Application Formats TBP Available No. TBP Available Title 23001-2 Application Formats: Music Player 141 23/7/04 6687 DoC on 23001-1:200X CD, “Player Application Format” 6688 Text of 23001-1:200X FCD, “Player Application Format” xxxx Request for Subdivision of ISO/IEC 23000-1 Yes 23/7/04 23/9/04 23/7/04 Explorations and support No. Title Music notation 6689 Call for Proposals for Symbolic Music Representation 6690 DRAFT SMR Evaluation Procedure TBP Available No. TBP Available Title Spatial audio coding 6691 Workplan for the Evaluation of Spatial Audio Coding Responses 142 Yes Yes 23/7/04 23/7/04 6/8/04 Annex E Agenda for the 70th MPEG Audio Meeting Agenda Item 1. Opening of the meeting 2. Administrative matters 2.1. Approval of agenda 2.2. Approval of 69th meeting report 2.3. Communications from the Chair 2.4. Allocation of contributions 2.5. Joint meetings 2.6. Review of AhG reports 2.7. Review of task groups and mandates 2.8. Received national body comments and liaison matters 2.9. Plenary issues 3. Task group activities 3.1. MPEG Maintenance 3.2. MPEG-4 Lossless Coding 3.3. MPEG-7 Audio 3.4. MPEG-Music Player Application Format 3.5. Spatial Audio Coding 3.6. Music Notation 4. Discussion of unallocated contributions 5. Meeting deliverables 5.1. Press statement 5.2. Dispositions of comments 5.3. Responses to NB comments 5.4. Responses to Liaison statements 5.5. Recommendations for final plenary 5.6. Establishment of new Ad-hoc groups 5.7. Approval of output documents 6. Future activities 6.1. Agenda for next meeting 7. A.O.B. 8. Closing of the meeting 143 Annex 10 Report of SNHC meeting Source: Mikaël Bourges-Sévenier (Mindego Inc.) Opening of the Meeting Approval of the agenda Goals for the week The goals of this week are: Finalize ISO/IEC 14496-5/FDAM7 AFX reference software Issue ISO/IEC 14496-16/PDAM1 with new tools available in reference software Start ISO/IEC 14496-21 WD 1.0 Update ISO/IEC 14496-11/FPDAM4 with XMT-A reorganized and augmented with all AFX encoding tools represented in XML. 144 Schedule Time Monday Tuesday :00 08 :30 10965 3DMC 09 :00 :30 10937 urban rep 10 :00 :30 10994 - CE Graphics API MPEG Plenary shadow 11 :00 Architecture :30 11031 - CE multitex 12 :00 :30 11038 - point Lunch break 13 :00 :30 Graphics API 11066 Lunch break 14 :00 :30 morphing Architecture 11022 - SMR Roll call, agenda appearances 10898 15 :00 FAQ, web site, ref sw, conf. :30 PointTexture Graphics Arch. :00 Solids (2 16 :30 contribs) 3DAV 11109 + 10881 17 :00 XMT (6 :30 contribs) Liaison 18 :00 :30 19 :00 :30 20 :00 :30 Chairs 21 :00 :30 22 :00 :30 Wednesday MPEG Plenary Thursday Friday Graphics API MPEG-J extensions Document review Presentation review Document number attribution … last items... AFX document updates Lunch break Lunch break Lunch break Review of XMT Graphics API Review of WD MPEG-J XMT for AFX extensions Review PDAM: ref. soft., AMD1 LaSeR overview (in SNHC) Liaison Social event Chairs 145 MPEG Plenary Allocation of joint meetings Sub-Groups Systems Monday Tuesday 17:00-18:00 XMT, MPEG-J Wednesday 16:00-17:00 LaSeR Thursday Requirements MPEG-7 Video Video/3DAV MDS Rooms allocation SNHC Rainier 1, Break-out (Graphics): Rainier 2 Systems Hood 1 Requirements Lassen Chairs/HoD/Liaisons Lassen Allocation of contributions N° D1 Title Schedule Monday MPEG Plenary Report of AhG on MPEG-J extensions D1 D1 09h00-14h00 Mikaël Sévenier D1 15h00-16h00 15:00 15:30 D1 16h00-19h00 16:00 Mikaël Patrick SNHC 10936 Simplification of AFX/SolidRep node 11134 Solid implementation into IM1 MPEG Gen. Bourges- SNHC Agenda, FAQ, Web site AFX Reference software, integration issues Activity Alain Mignot Pierre Garneau Jeremie Farret Olivier Bellis 146 SNHC Gen. AFX Friday N° Title Schedule 10880 Update of XMT-A for AFX 10882 10899 11046 11068 Gyeong Ja Jang James D. K. Kim Updates on the reference software of AFX Gyeong Ja Jang Encoder James D. K. Kim Update on XMT-A specification for Gyeong Ja Jang encoding parameter of PointTexture Shinjun Lee Compression James D.K. Kim Mahnjin Han Proposal for the XMT-A specifications for Alexandru Salomie MeshGrid Adrian Munteanu Rudi Deklerck Peter Schelkens Textual BBA Marius Preda Francoise Preteux 17:00 SNHC D1 16h00-19h00 16:00 Comments on MPEG-4 part 21 MPEG-J extension for rendering 11111 Considerations for MPEG-J extensions for rendering 11003 D2 Tuesday SNHC On the status of 3D Mesh Compression in MPEG-4 Proposal for multi-resolution urban 10937 representation CE - Shadow: Preliminary Results on 10994 Reference Software Implementation View-Dependent Multi-Texturing for 11031 MPEG-4 AFX, Syntax and semantics 10965 Itaru Kaneko Mark Callow Mikael BourgesSevenier Vishy Swaminathan Euee S. Jang, Ja Kim Patrick Gioia Jérôme Royan D2 D2 9:00 – 13:00 9:00 10:00 11:00 Helge Drumm Karsten Müller Aljoscha Smolic 12:00 147 Activity Graphics AFX N° Title Schedule Activity specification update Results on Reference Software 11038 Implementation on Point based Rendering for MPEG-4 AFX Stephan Würmlin Christopher Lee Matthias Zwicker Michael Waschbüsch Markus Gross Hanspeter Pfister SNHC Marius Preda Françoise Preteux 11066 Morphing Appearances Olivier Marre 11022 Graphic functionality in MPEG-4 and Giorgio Zoia Symbolic Music Representation Pierfrancesco Bellini Jerome Barthelemy Paolo Nesi Addition to PointTexture Compression for Mahnjin Han 10898 future extensions Systems 11109 XMT and MPEG-J updates 10881 KNB on XMT and MPEG-J updates D3 D4 D2 14:00 – 17:00 14:00 AFX 15:00 16:00 D2 17:00 – 18:00 Graphics D3 D3 09h00-11h00 D3 11h00-16h00 MPEG Gen. Graphics Mikaël BourgesSévenier Mahnjin Han Wednesday MPEG Plenary SNHC Part 21 architecture discussions SNHC LaSeR overview 12:30 Olivier Avaro Jean-Claude Dufourd Thursday D3 16h00-17h00 16:00 D4 148 General N° D5 Title SNHC Part 21 architecture discussions SNHC AFX document review Part 21 architecture Friday SNHC Schedule Activity D4 9h00-13h00 AFX AFX Document number attribution D4 14h00-18h00 14:00 15:00 D5 D5 9h00-11h00 9:00 MPEG Plenary D5 14h00-22h00 MPEG Gen. 149 SNHC Gen. General issues Web site The SNHC Web site is http://www.sait.samsung.co.kr/snhc/ AFX Reference software The AFX Reference Software has been transferred to NIST and is available via CVS at 1. Register your login/password at http://mpeg.nist.gov/reg/login_new.php 2. :pserver:<your login>@mpeg.nist.gov:/big/mpegcvs 3. <your password> 4. Checkout "MPEG-4/Systems2/IM1" module (case sensitive). The AFX-related code is in OpenGL/AFX and conformance samples are in Tests/AFX. AFX encoder and other tools We create MPEG-4/SNHC/AFX_Encoders repository in CVS server. Add an informative note in AFX/AMD1 Reference software document about this tool. New tools added since March: DIBR v2 (splats), morphing, point-texture compression, multitexturing, Solids Miscellaneous The MPEG node templates used to be maintained by MPEG-4 Systems editors. It has been decided to upload them into CVS repository. Mikaël Bourges-Sévenier will upload into CVS the executables of his programs to generate node coding tables and XMT-A Schema (BIFS part). XMT-A Schema organized in 4 parts will be uploaded into CVS. Standards from SNHC In red, status reached at this meeting. In yellow, status reached at next meeting. Projects that reached International Standard status have been removed. Std Pt Edit. Project Description 4 5 2003 Amd.7 4 11 2003 Amd.4 4 16 2004 Cor.1 4 16 2004 Amd.1 4 21 2005 CfP WD CD FCD FDIS PDAM FPDAM FDAM DCOR COR 02/10 02/12 03/12 04/07 03/12 04/07 05/01 AFX Reference SW XMT and MPEG-J extensions AFX Corrigendum 04/03 04/07 AFX extension 03/07 04/07 MPEG-J extensions 03/12 04/07 04/10 for rendering 150 05/01 05/01 05/01 05/07 05/07 AFX activities Specifications updates The list of modifications for existing specifications handled by SNHC is as follows. Part 5/AMD7 Solid Modeling framework has been added. Part 11/AMD4 Monolithic XMT-A schema reorganized in a modular manner. All nodes from MPEG-4 Part 11 and Part 16 have been added, up to Part 11 AMD6 and Part 16/AMD1. AFX node specific encoding hints and parameters added. Part 16/COR1 Light-field mapping and Particle systems have been removed. Part 16/AMD1 Finalized: Multitexturing framework, Point-based representation, Morphing Part 21/WD 1.0 Just started: uses JSR-184 and JSR-239. MPEG-J is augmented to support these APIs and interface with MPEG-4 Systems terminal. Conformance and reference software M: 10936 Simplification of AFX/SolidRep node Alain Mignot, Pierre Garneau Proposal: - Reduce the complexity of using the SolidRep by adding support of solid operations directly at the scene graph node level; thus no need of using the script node. - keep only the logic operators (3) from the 45 operators currently standardized. - a new node proposed: SolidRepV2 which contains the solidOp field indicating the operation attached to the node. Resolution: Create a CE on differences between script with SolidRepV1 and SolidRepV2 with the following goals: - What is the extra cost for using script node for solid? - What are the limitations when not using the script but having the SolidRepV2? Jeremie (SGDL) and Alain (SolidSpace) participate to the CE and edit the CE description. M11134: Solid implementation into IM1, Jeremie Farret, Olivier Bellis - renew involvement of SGDL in MPEG-4 normalization - implementation of Solid representation in AFX reference software - full support for script node (new java script library is available) Resolution: validate the implementation and check that all the conformance bitstreams for all the AFX tools are working (action done on Thursday morning in the SNHC plenary) 151 Naming problem: change symbols for operators in strings; advantages: light update of the java script parser, solve ambiguities methods. Resolution: update the DCOR with the operators names for the sake of the non-ambiguities. M10880: Update of XMT-A for AFX, Gyeong Ja Jang, James Kim Proposal: - add DIBR encoding hints in bitwrapper; - add DIBRDecoderInfo in AFXConfigType - change the place of the AFXConfigType; put it in the object descriptor part Resolution: All the proposed modifications are accepted. M10882: Updates on the reference software of AFX Encoder, Gyeong Ja Jang, James Kim Proposal: - add support for multiple BitWrapper parser - add support for octreeImage encoding Resolution: Upload the software in the CVS as part of MPEG-4 reference software. Add the description of the tool and hints to be used and updated. M10899: Updates on XMT-A specification for encoding parameter of PointTexture Compression, Gyeong Ja Jang, Shinjun Lee, James Kim, Mahnjin Han Proposal: Add the element PointTextureEncodingParameter and the associated attribute in the BitWrapper encoding parameters section. Resolution: Accepted M10899: Proposal for the XMT-A specifications for MeshGrid, Alexandru Salomie, Adrian Munteanu, Rudi Deklerck, Peter Schelkens Proposal: - Add the MeshGridEncodingParameters element in the BitWrapper encoding parameters section. - Add the MeshGridDecodingSpecificIndo element in the AFX decoder specific section. Resolution: Accepted M10899: Textual BBA, Marius Preda, Francoise Preteux Proposal: - Add the description of the BBA related elements in the XMT-A, including textual animation parameters and encoding parameters Resolution: - Accepted 152 - Check the schema with Intellij M10965 – On the status of 3DMC in MPEG-4 3DMC provides 30-40 times compression of IndexedFaceSet node. The major supporters were IBM and Samsung. 3DMC reached IS status since 2001 but no commercial application exists so far. IBM and Samsung said informally that they have no immediate plan to deploy this technology. Technical issues Coverage of 3D models 3DMC cannot support non-manifolds or non-orientable meshes without breaking the model into multiple components. Lossless/near lossless compression High quality compression of 3D models for archiving and distribution is in high demands but this may not have been well understood in the original design of 3DMC. Lossless feature is available in AFX VM but promotion unclear. Vertex order change For non-rigid deformations of models, vertex order must be preserved. 3DMC does change vertex order. Possible solutions 1. 3DMC encoder could output the changed vertex order information so the compression of interpolator etc. so 3DMC encoder would drive the encoding of the entire scene (BIFS, Scripts, MPEG-J) 2. Transmit the changed order of vertex. This is n log n information, so an overhead increase 3. Use 3DMC only for rigid-body animation. Then vertex order doesn’t matter 4. Redesign 3DMC Resolution Gather industry interest before starting a new 3DMC. Contributions would be expected in further meetings. M10937 – Proposal for multi-resolution urban representation We need progressive transmission and adaptive rendering during navigation. For such adaptation, the scene is really a polygon soup of building blocks that are refined at interactive frame rate. With such contents, it is easy to navigate inside a city but much harder to have fly over views because in a city many occlusions enables less polygons to be sent to the card while on fly over, there are no such occlusions. The scene is represented as a hierarchical representation of building blocks (i.e. real buildings). The leaves (buildings) are rendered. The refinement applies at the footprint of the buildings, which are contours represented as line segments (hence only position is needed). Messages are sent to the server to refine these contours during navigation. To represent the building, extra information such as height, textures are sent. As navigation progresses the root contours are split into multiple contours. 153 The proposal doesn’t expose geometry information that could be helpful to combine with other 3D models. Resolution Start a CE on this representation to understand how such contours could be used in a BIFS scene M10994 – CE - Shadow: Preliminary Results on Reference Software Implementation, Helge Drumm Report: - The work on implementation in the AFX reference software is not completed; - Implementation in Iavas MPEG-4 player (in Java) - Add in the AFX reference software some light related issues which were missing in the implementation; Proposal: Simplify the node interface in order to simplify the implementation. Resolution: Keep the CE open with the following goal: - indicate which functionalities are not supported anymore by the simplified node; - what is the cost of keeping the initial node? Only an implementation issue or some theoretical aspects are also involved. M11031 – View-Dependent Multi-Texturing for MPEG-4 AFX, Syntax and semantics specification update, Karsten Müller, Aljoscha Smolic Proposal: Update the Multitexturing node: Change the “weight” field with the “cameraVector”. Advantages: not need of using the script node but multitexturing directly implemented by the player. Resolution: Adopt the new node as part of the CD of AFX Amd1. M11038 – Results on Reference Software Implementation on Point based Rendering for MPEG-4 AFX, Stephan Würmlin, Christopher Lee, Matthias Zwicker, Michael Waschbüsch, Markus Gross, Hanspeter Pfister Proposal: Implementation of the DIBRV2 nodes in the reference software Resolution: Validate the implementation, DIBRv2 nodes go in CD of AFX Amd1 M11038 – Addition to PointTexture Compression for future extensions, Mahnjin Han Proposal: add a flag isExtension in order to support future compression scheme. Resolution: Accepted M11066 – Morphing Appearances, Marius Preda, Françoise Preteux, Olivier Marre Proposal: 154 - Update the MorphShape node for supporting morphing for the appearance field by changing the type of the targetShapes from the MFGeometryNode into MFShapeNode - Implemntation of the new node in the reference software Resolution: - validate the implementation, MorphShape node go in the CD of AFX Amd1. MPEG-4 Part 21 M11003 – Comments on MPEG-4 Part 21 HI Corp. strongly supports standardization of MPEG-4 Part 21 or Graphics API. M3G has been found as the best starting point for Graphics API during 68th meeting and the AhG meeting in Tokyo in May. MPEG-4 Part 21 should not be too attached to one specification. HI has about 30M devices and their experience is that each operator has strong control of the specification and they often prefer the latest version of the API. So every year a new version provides new features. Therefore, locking into one API is not a good idea. HI Corp. proposed a simpler version of APIs that is not M3G but already publicly royalty-free available. Conformance and reference software HI can provide a binary version of their optimized renderer. Non-synthetic 3D rendering In 3DAV, capture of 3D information from images is being worked on. In many apps, mixing synthetic and non-synthetic objects is useful and therefore the APIs should be unified. Fog and depth effects are needed, environment mapping Proposal HI suggests looking at old version of the API, which still has many apps being developed. The new version of the API is M3G. Mobile manufacturers have embraced M3G, which is now available on phones shipping this summer. Discussion M3G is the right starting point for this activity but M3G being controlled by its own standard body is an issue. MPEG/SNHC should establish liaison with M3G. However, M3G (JSR-184) is finished and hence the group is closed, so no liaison or working relationship is possible. Many participants expressed concerned about M3G future because of Nokia’s licensing. Likewise, it is unclear if M3G will be updated in a near future even with basic features present in OpenGL ES but apparently forgotten in M3G. Informal conversion with JSR-184 Chairman seems to indicate extensions will happen but probably not this year. In conclusion of this proposal, an M3G like graphics API is needed but not necessarily M3G itself alone. Commonality of various APIs in the market must be studied. 155 M11111 – Considerations for MPEG-4 Part 21 This contribution details missing features in M3G and possible solutions. It also raises some issues related to the integration of MPEG-4 systems with M3G. The proposal simply intends to start the discussion on these issues. 3DAV needs Video Timing + synchronization Multi-texturing Point rendering M11022 – Symbolic Music Representation (SMR) Needs to represent music notation: Lines, path, curves Color support Text support Selection of notes or groups of notes according to rules of symbolic music. Synchronization of audio-visual elements: playback + animation sync’d etc… Conclusion Using Part 21, SMR can be easily rendered. This path seems easier to use than describing the complete framework in BIFS. MPEG-4 Part 21 architecture Supporting JSR-184 and JSR-239 During 68th meeting, we selected JSR-184 as the starting point of MPEG-4 Part 21. During the AhG meeting in May, we found it was, technically-speaking a good choice even though some technologies were missing and the licensing model didn't seem to please many participants. In the last 10-15 years, many high-level APIs (e.g. with a scene graph) have been proposed but almost none has survived more than 2 years in the market; developers and especially game developers seem to agree only at low-level. In other words, developers like to design their own scene graph, scene management and so on for their applications. JSR-184 (M3G) is one example of a high-level API and, if history repeats, may not survive long. On the other hand, OpenGL ES is finalized and is becoming available in software and in hardware (chips) today. In the long run, OpenGL ES has better chance to survive as the long history of OpenGL suggests (almost 20 years!). Therefore, it is important to support both M3G and Java bindings to OpenGL ES. Such bindings are not finalized yet but will be by the end of the year as part of JSR-239. Some participants believe that M3G will be used for simple applications but complex games will use JSR-239. It is also worth to mention that on desktops, a thin layer for OpenGL ES on top of OpenGL is already freely available, making applications using OpenGL ES working from embedded devices to desktops. Finally, almost all implementations of JSR-184 are implemented on top of OpenGL ES. For devices with no OpenGL ES support (as there are already millions in Japanese market) JSR-184 can be implemented on top of a proprietary rasterizer. 156 In conclusion, JSR-184 must be supported for applications using its high-level API. For general applications, JSR-239 must be supported. The choice of using one or the other will be the responsibility of the application developer. We will establish a liaison to JSR-239 so to access its specification and provide them feedback on the interfacing requirements we need, if any. Figure 1 summarizes this discussion. Application (MPEGlet) Java (sent to terminal) MPEG-J (ISO/IEC 14496-11) Other SG (incl. BIFS) JSR-184 Java (in terminal) Native (in terminal) MPEG terminal (Systems / Decoders) JSR-239 OpenGL ES Proprietary rasterizer Figure 1 – Block diagram of MPEG terminal with graphics enabled MPEGlets. What remains to be done is the interfacing with an MPEG-4 terminal i.e. the so-called MPEG-J extensions. But first, we describe the architecture that enables all applications. Architecture After many discussions, Figure 2 summarizes the MPEG terminal architecture using MPEGlets. Compare to MPEG-4 Systems (ISO/IEC 14496-1) architecture, Compositor and Renderer are arranged in a different manner albeit their definitions are the same: A renderer is used to draw synthetic operations (2D/3D graphics) into an image (or pixels buffer), A compositor is used to mix (or to compose) zero or more pixel buffers to create a final image. As specified in ISO/IEC 14496-11, an MPEGlet is received from an MPEG-4 stream and placed into a decoding buffer (this is a Java class implementing MPEGlet interface alone or within a Java archive (jar)). From the decoding buffer (DB), the Java Virtual Machine (JVM) starts the MPEGlet. In MPEG-4 Part 11, an MPEGlet has no access to graphic resources and has been thought as an application running in the background controlling the terminal. As such, it can access the BIFS scene graph, modify it, and receive events from it. The BIFS compositor then renders its scene graph and a final image is produced; this happens at every frame. In MPEG-4 Part 21, we view an MPEGlet has a video decoder i.e. a component producing pixel buffers. The MPEGlet can draw into a pixel buffer using JSR-184 or JSR-239. The MPEGlet can also control the compositing process. In the simplest compositing case, the video buffer would be in the background and the MPEGlet pixel buffer will be drawn on top; transparent areas would show the video image underneath. The MPEGlet can also access composition buffers (i.e. pixel buffers) of other video decoders and use them as textures mapped onto synthetic 2D/3D objects. 157 DB Video Dec pixels DeMux Compositing Compositing DB MPEGlet Graphics operations (Decoding Buffers) Final image pixels (Composition Buffers) Renderer Renderer JSR-239/184 JSR-239/184 Figure 2 – MPEG terminal architecture with MPEGlets. With this architecture in mind, the existing MPEG-J API defined in ISO/IEC 14496-11 can be reused with possibly minor modifications and more importantly with extensions for renderer, composition buffers, and compositing access. Since all media must be composed given time constraints, MPEG-J must also be extended with timing and synchronization. MPEG-J extensions Timing and synchronization In order to synchronize composition buffers with an MPEGlet, we need timing information from the buffers. Q: Do we need to query time or be event triggered? A: Different scenarios are possible and it seems both features should be supported. We need CTS, an abstraction to media position (in time and in sample). It is not clear if decoding buffers (and hence DTS) is needed. Composition buffer access If we want to use pixels from a visual decoder, we need an abstraction to CBs. Efficient rendering Renderers need to be bound to a composition buffer for rendering. The compositor is the component managing the buffers to produce the final image. Therefore, an MPEGlet should ask the Compositor for one or more composition buffers, which in turn may provide a software or hardware accelerated buffer that match the MPEGlet requirements and the available resources in the terminal. We need an abstraction from MpegjTerminal to access the compositor. We need a facility in the Compositor to create buffers with some configuration hints. At each frame, an MPEGlet should be able to bind to a pixel buffer, draw whatever rendering commands, release this pixel buffer. This mechanism is already possible with JSR-184, we must ensure it is also the case with JSR-239. MPEGlets initialization The MPEGlet interface (ISO/IEC 14496-11) is simply a Runnable. In other words, an MPEGlet is a task running in a thread. In order to initialize hardware accelerated pixel buffers, an application must access native rendering peers. In the last section, we described that through the MpegjTerminal, an MPEGlet can access the Compositor and create hardware accelerated buffers since the Compositor makes the final image and hence has access to native rendering peers. 158 User interaction An application wouldn't be interactive without keyboard, mouse or other devices access. Java provides such mechanisms for keyboard and mouse so there is no need to define anything if we support J2ME, J2SE, J2EE, and whatever profiles of each Java edition. Misc. From this discussion, it seems some areas must be queried by an MPEGlet in order to discover what a terminal supports. For example, one might want to know if the terminal supports JSR-184 and/or JSR-239. Rendering and Compositing properties should be queried so that an MPEGlet can adapt its processing. This remains to be discussed. MPEG-4 Part 20 – LaSeR (overview) LaSeR stands for Lightweight scene representation. LaSeR is based on W3C Scalar Vector Graphics but is much smaller. It has features such as being able to move from one scene to another and preserve the status of the scene. Node features Laser shapes is just polygons (actually, 2D filled contours) and polylines. SVG path will be added later. No picking at this moment but will be added during CE harmonizing Laser and SVG. AnimateXXX is like SVG without splines. AnimateActivate to animate ID of nodes like a Switch with a sequence. Cursor is to emulate a stylus with keys on a phone. TextInput is an interface with character input in a phone. xxxKey nodes are configurations for other elements but may not remain for alignment with SVG. No Inline (as with SVG Tiny) No script (conditional + action is enough) File format and OD enhancements The binary syntax is like BIFS but without context. So you can decode a command without memory of previous scene. Simple Aggregation Format (SAF) SAF is a way to package scene + audio + video to do cheap streaming over HTTP. Mapping to over transport mechanism is very easy with this format. Cache mechanism: CacheObject Enables objects to remains in the cache of the phone for faster access. End of stream signaling Missing in MPEG-4, used to reclaim memory and kill decoders OD enhancements SimpleDecoderConfig = like DecoderConfig but simpler SimpleDecoderSpecificInfo = just the header of the stream Notes 159 JSR-226 is aligned with SVG 1.1 and would be useful for a Java access to LaSeR scene. Main targeted applications portals, services (traffic, maps, weather…), database interrogation, stock quotes, decoration of video clips (e.g buttons to start/stop clips), news service (BBC trying this LaSeR application now) etc… Designed for mobiles applications. Conclusion MPEG-4 Part 20 (LaSeR) is a simplified version of SVG Tiny with a binary representation simpler than BIFS. It is designed to be a sort of "Flash for mobiles" within a simplified MPEG-4 terminal implementation. Therefore, LaSeR is simplified 2D version of BIFS designed for mobiles harmonized with SVG. Resolutions of SNHC Output documents No. Title TBP Available Editor 14496-16 MPEG-4 Animation Framework eXtension (AFX) 6543 AFX Reference software FPDAM7 No 04/07/23 Patrick Gioia 6544 6545 6546 6547 6548 6572 14496-16 MPEG-4 Animation Framework eXtension (AFX) ISO/IEC 14496-16/PDAM1 ISO/IEC 14496-16/DCOR1 AFX CE description AFX VM 15.0 SNHC FAQ 12.0 Request for ISO/IEC 14496-16/AMD1 14496-21 MPEG-J extensions for rendering 6549 ISO/IEC 14496-21 WD 1.0 No No No No Yes No 04/07/23 04/07/23 04/07/30 04/07/30 04/07/23 04/07/23 Marius Preda Marius Preda Marius Preda Marius Preda No 04/08/06 Mikaël Sévenier Marius Preda Bourges- Resolutions MPEG-4 Part 5 The SNHC subgroup approves the integration of Solid Modeling into the AFX reference software. Part 16 The SNHC subgroup informs that, following 68th meeting resolutions, Solid Modeling framework remains in ISO/IEC 14496-16 and Light-Field Mapping and Particle Systems are removed by corrigendum. The SNHC subgroup informs that XMT and MPEG-J representations for AFX tools are available in ISO/IEC 14496-11/AMD4. Part 21 160 The SNHC subgroup informs that, following 68th meeting resolutions, Solid Modeling framework remains in ISO/IEC 14496-16 and Light-Field Mapping and Particle Systems are removed by corrigendum. The SNHC subgroup informs that XMT and MPEG-J representations for AFX tools are available in ISO/IEC 14496-11/AMD4. Establishment of SNHC Ad-Hoc groups No. Title Meeting Chair N6662 AhG on AFX documents, CEs, and software Marius Preda N6663 AhG on MPEG-J extensions for rendering Mikaël Bourges-Sévenier N6662 Mandates: Chairman: Co-chairs: Duration: Meetings Reflector: Subscribe: N6663 Mandate: Chairman: Co-chairs: Duration Meetings: Reflector: Subscribe: Ad Hoc Group on AFX documents, CEs, and software 1. Maintain and edit SNHC VM document. 2. Coordinate SNHC CE activities. 3. Coordinate AFX/AMD1 software implementation Marius Preda (INT) Mahnjin Han (Samsung AIT) Patrick Gioia (France Telecom R&D) Until 70th meeting Sunday before 70th meeting mpeg-snhc AT gti. ssr. upm. es Send an email to mpeg-snhc-request AT gti. ssr. upm. es with the message “subscribe” as the first line in the body. Ad Hoc Group on MPEG-J extensions for rendering 1. Maintain and edit 14496-21 WD document 2. Harmonize MPEG-J systems interfaces for rendering needs Mikaël Bourges-Sévenier (Mindego Inc.) Vishy Swaminathan (Sun Microsystems) Itaru Kaneko (Waseda University) Until 70th meeting Sunday before 70th meeting mpgj-sys AT advent. ee. columbia. edu Send an email to mpegj-sys-request AT advent. ee. columbia. edu with the message “subscribe” as the first line in the body. Closing of the Meeting See you in Palma de Mallorca in October (and bring your swim suits ). 161 Annex 11 Report of Integration meeting Source: Jean-Claude Dufourd, ENST Opening of the Meeting Allocation of contributions Monday Plenary 10755 T. Chiang et al AHG on Maintenance of MPEG-4 Visual related Documents, Reference Software and Conformance 10756 L. Cieplinski et al AHG on Maintenance of MPEG-7 Visual related Documents and Reference Software Joint with MDS on MPEG-21 Conformance, Wed 15:00 to 16:00 10874 Spencer Cheng et al Improving MPEG-21 IPMP Conformance - Experience from MPEG2/4 IPMPX 10891 Eva Rodriguez et al Revised REL Interpretation Conformance after verification of Test Cases Joint with MDS on MPEG-21 Reference Software, Thu 11:00 to 12:00 10847 SC29 Secretariat Summary of Voting on CD of 21000-8 10864 Xin Wang et al Simple Integration Reference Software for MPEG-21 REL, DID and DIA 10942 Shane Lauf et al Mobile MPEG-21 browser implementation Integration plenary, Thursday 14:00-16:00, Systems room 11117 Chun-Jen Tsai et al Scalable Multimedia Streaming Test Bed for Media Coding and Testing in Streaming Environments 10792 SC 29 Secretariat Summary of Voting on ISO/IEC PDTR 21000-12 11029 Juergen Schmidt et Simple Integration Reference Software for MPEG-4 AudioBIFS, al version 3 10882 Gyeong Ja Jang et al Updates on the reference software of AFX Encoder 10918 SC 29 Secretariat 11038 Stephan Würmlin et Results on Ref. Soft. Impl. on Point based Rendering for MPEG-4 al AFX 11134 Jeremie Farret et al 11103 Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 6 Alexandre Cotarmanac'h Solid implementation into IM1 Updated software for SL extension 10983 ITTF via SC 29 Sec. Table of Replies on ISO/IEC 14496-5:2001/FDAM 4 [SC 29 N 6078] 10984 ITTF via SC 29 Sec. Table of Replies on ISO/IEC 14496-5:2001/FDAM 5 [SC 29 N 6079] Conformance 10922 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 2 162 10923 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 8 10958 Yoshihiro Miyamoto Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition 11072 Ralph Sperschneider Status on MPEG-4 Audio Conformance List of standards under development Std Pt Edit. Project Description 2 2 2 4 4 4 4 4 4 4 4 7 7 21 21 4 4 5 4 4 4 4 4 5 5 5 6 7 8 12 2004 2004 2004 2004 2004 2004 2004 2004 2004 2003 2004 2001 2004 200x 200x Amd.1 Amd.2 Dam1 Cor.1 Amd.6 Amd.8 Amd.9 Amd.10 Amd.6 Amd.7 Amd8 Amd.1 Amd.1 1st Ed. 1st Ed. 21 14 200x 1st Ed. IPMP Conformance Ext. Audio Conformance Ext. IPMP Ref.Soft. Ext. Visual Bitstreams AVC HE-AAC, ABIFS and SA AVC FRExt Conformance New Levels of SP Conf AVC and HE-AAC AFX Reference SW AVC FRExt Ref Soft Reference software extensions Conformance extensions Reference software Test Bed for MPEG-21 Resource Delivery Conformance CfP WD CD FCD FDIS 03/03 03/10 03/12 04/03 01/12 03/03 03/03 02/12 03/07 03/12 03/07 04/10 03/07 03/12 04/07 04/07 03/07 02/12 04/07 03/03 03/07 04/03 03/12 03/10 04/10 05/04 04/03 03/10 04/03 03/03 02/10 03/12 04/03 05/01 05/01 03/12 03/12 04/10 03/12 03/12 04/07 04/07 04/07 04/07 05/01 04/07 04/07 05/07 05/07 04/07 04/07 05/04 04/07 04/07 05/01 04/07 05/07 Latest references Project P. Standard MPEG-4 4 ISO/IEC 14496-4:2003 (MPEG-4 Conformance 2nd Ed.) MPEG-4 4 ISO/IEC 14496-4:2001/Amd.1 (FlexTime, Studio and Streaming Video Profile) MPEG-4 5 ISO/IEC 14496-5:2001 (Ref. Soft 2nd Ed.) MPEG-4 5 ISO/IEC 14496-5:2001/Amd.1 (FlexTime) MPEG-4 5 ISO/IEC 14496-5:2001/Amd.2 (XMT) MPEG-7 6 ISO/IEC 15938-6:2002 (Reference Software) MPEG-7 7 ISO/IEC 15938-7:2002 (Conformance) Issue 02/12 Awaji No. N5457 02/07 Klagenfurt 01/07 Sydney 02/03 Jeju 02/05 Fairfax 01/12 Pattaya 02/07 Klagenfurt N5083 Request documents MPEG-2 Conformance 10922 SC 29 Secretariat Summary of Voting on ISO/IEC 13818-4:200X/FPDAM 2 Usual « please fix all bugs » comment MPEG-2 Reference Software 163 N4368 N4711 N4865 N4475 N4937 MPEG-4 Conformance (14496-4) 10923 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-4:200X/FPDAM 8 Usual « please fix all bugs » comment, and the rest was dealt with in Audio 10958 Yoshihiro Miyamoto Proposed Corrigendum to ISO/IEC 14496-4:200X 2nd Edition No one presented the contribution 11072 Ralph Sperschneider Status on MPEG-4 Audio Conformance This document was presented in Audio, and only one issue was brought to Integration: all mp4 test sequences in Audio need to be made compliant with the filetype requirement of the latest MP4 file format amendment. After some verification, it is optional to bring all sequences to mp4 v2, not mandatory. MPEG-4 Reference Software (14496-5) 10882 Gyeong Ja Jang et al Updates on the reference software of AFX Encoder No one presented the contribution 10918 SC 29 Secretariat Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 6 Usual « please fix bugs » comments 10983 ITTF via SC 29 Sec. Table of Replies on ISO/IEC 14496-5:2001/FDAM 4 [SC 29 N 6078] Only YES votes 10984 ITTF via SC 29 Sec. Table of Replies on ISO/IEC 14496-5:2001/FDAM 5 [SC 29 N 6079] Only YES votes Simple Integration Reference Software for MPEG-4 AudioBIFS, version 3 This document reports on the implementation of the version 3 of AudioBifs in IM1. This implementation uses manually generated files, it needs to be brought in sync with the automatically generated templates. This does composition. Rendering is under discussion with Systems: is it required and how? 11029 Juergen Schmidt et al Stephan Würmlin et Results on Ref. Soft. Impl. on Point based Rendering for MPEG-4 al AFX No one presented the contribution 11038 Alexandre Updated software for SL extension Cotarmanac'h No one presented the contribution 11103 164 11134 Jeremie Farret et al Solid implementation into IM1 No one presented the contribution Issue: no reference software for part 15: “AVC file format”. This is on Dave Singer’s todo list. Issue: do we need reference software for part 17: “Streaming Text”. Jan Van der Meer acknowledged that presence of reference software is a prerequisite to promotion to FDIS of the specification. MPEG-21 Conformance Improving MPEG-21 IPMP Conformance - Experience from MPEG-2/4 IPMPX No one presented the contribution 10874 Spencer Cheng et al Revised REL Interpretation Conformance after verification of Test Cases This document was presented: it presents work on the conformance “streams”. Discussion of the state of the M21 Conformance: the WD is pretty skimpy, and we do not think it should be progressed. In general, REL is the “good student” for conformance, but this does not say much… 10891 Eva Rodriguez et al MPEG-21 Reference Software Simple Integration Reference Software for MPEG-21 REL, DID and DIA The document was presented : it describes a software, extended from previous version with a DIA functionality. The DIA functionality is provided by a piece of DIA reference software. This falls into the category of integrated utility software. 10864 Xin Wang et al 10847 SC29 Secretariat Summary of Voting on CD of 21000-8 AU nb comment : « update to FDIS status » is accepted US nb comments: - clarify introduction: accepted - clarify content of each section: accepted - use consistent presentation: accepted - use consistent organisation of the software: accepted KR nb comment: - test bed: acknowledged, another solution is proposed (normative reference to the TR) - integrated software plan for new parts: acknowledged, these parts are out of scope of the current document (because no FDIS yet) - comment on FF software: not relevant for this document - list of DIA utility module: accepted 10942 Shane Lauf et al Mobile MPEG-21 browser implementation 165 The document presents a J2ME implementation of a M21 browser, with an impressive demo on a phone. Multimedia Test Bed 10792 SC 29 Secretariat Summary of Voting on ISO/IEC PDTR 21000-12 Discussion of the responses to the various votes. The US comments are accepted. The AU and UK comments are not really technical and do not address shortcomings of the document, but evoke higher level issues. Scalable Multimedia Streaming Test Bed for Media Coding and Testing in Streaming Environments Presentation of small changes to the test bed software. 11117 Chun-Jen Tsai et al MPEG Reference Software Guide 166 Resolutions of Integration Resolutions Documents MPEG-2 No. 6624 6616 6617 6618 6619 6620 6621 Title 13818-4 MPEG-2 Conformance DoC on ISO/IEC13818-4/FPDAM1 IPMP Conformance Ext. ISO/IEC13818-4/FDAM1 IPMP Conformance Ext. DoC on ISO/IEC13818-4:200X/FPDAM2 Audio Conformance Ext. ISO/IEC13818-4:2004/FDAM2 Audio Conformance Ext. 13818-5 MPEG-2 Reference Software DoC on ISO/IEC 13818-5/Dam2 IPMP Reference Software Ext. ISO/IEC 13818-5/AMD2 IPMP Reference Software Ext ISO/IEC 13818-5:1997/Amd1:1999/COR2 TBP Available N N N N 04/07/23 04/07/23 04/07/23 04/09/23 N N N 04/07/23 04/07/23 04/07/23 MPEG-4 No. 6532 6533 6622 6623 6534 6498 6535 6536 6625 6626 6537 Title TBP Available 14496-4 MPEG-4 Conformance DoC on ISO/IEC 14496-4/FPDAM6 AVC Conformance Y 04/09/15 ISO/IEC 14496-4/FDAM6 AVC Conformance Y 04/09/15 DoC on ISO/IEC 14496-4/FPDAM8 HE-AAC, ABIFS and SA N 04/07/23 Conformance ISO/IEC 14496-4/FDAM8 HE-AAC, ABIFS and SA Conformance N 04/09/23 ISO/IEC 14496-4/PDAM9 AVC FRExt Conformance Y 04/09/15 ISO/IEC 14496-4/PDAM10 New levels of Simple Profile Conformance N 04/07/19 14496-5 MPEG-4 Reference Software DoC on ISO/IEC 14496-5/FPDAM6 AVC and HE-AAC reference N 04/09/15 software ISO/IEC 14496-5/FDAM6 AVC and HE-AAC reference software N 04/09/23 DoC on ISO/IEC 14496-5/FPDAM7 AFX reference software N 04/07/23 ISO/IEC 14496-5/FDAM7 AFX reference software N 04/07/23 ISO/IEC 14496-5/PDAM8 AVC FRExt reference software Y 04/09/15 MPEG-21 No. Title 21000-8 MPEG-21 Reference Software 6627 DoC on ISO/IEC 21000-8/CD MPEG-21 reference software 6628 ISO/IEC 21000-8/FCD MPEG-21 reference software 167 TBP Available N N 04/07/23 04/09/10 No. Title TBP Available 21000-12 MPEG-21 Test Bed for MPEG-21 Resource Delivery DoC on ISO/IEC 21000-12/PDTR Test Bed for MPEG-21 Resource N 04/07/23 6629 Delivery N 04/07/23 6630 ISO/IEC 21000-12/DTR Test Bed for MPEG-21 Resource Delivery AHG 168 Annex 12 Report of Test meeting Source: Tobias Oelbaum Opening of the Meeting Goals for the week The goals of this week are: Conduct “Expert testing” for SVC CE Processing the results of the SVC CE tests and presentation of the results Discussion about testing for the 3DAV CfE, review of selected bitrates for 3DAV CfE Joint Meetings The following joint meetings were scheduled with Video - SVC CE testing with Video – 3DAV CfE preparation Contributions 10935 A Multimedia material Visual quality ranking procedure based on Single or Multiple Viewing (Baroncini / Tan / Oelbaum) Test Activities SVC CE testing Results of the CEs were evaluated at the meeting using the new “Expert viewing” method described in 10935. Five different test sessions with spatial resolutions ranging from QCIF to 4CIF were conducted with five experts participating at each test session. Results were presented at a joint meeting with Video and are documented in Nxxxx 3DAV, preperation of the CfE First discussions about possibilities to test 3DAV proposals. It was proposed to use the same “Expert viewing” method for 3DAV that was used for the SVC CE tests. Bitrates selected for the CfE were reviewed and modified to allow meaningful tests at the next meeting. It was agreed that for MVC (Multible Viewpoint Videocoding) two different views that will be tested will be selected randomly by the test subgroup. Test Resolutions Output Documents W6513 Results of the visual assesment of the results of the CEs on Scalable Video Coding Technology 169 AdHoc Groups No AdHoc Groups have been set up at this meeting. The video group has setup the AhG for the “SVC call for proposal”. Resolutions The test subgroup would like to thank Charles Fenimore for his valuable help preparing the SVC CE tests. The test subgroup would like to thank videatis for making available the HD sequence “Soccer” for the SVC CE testing and further testing within MPEG. 170 Annex 13 Report of ISG meeting Source: Editor: ISG Chair Marco Mattavelli (EPFL) Overview The main work items of the Implementation Studies Subgroup in Redmond are: 1. The advances in the development of the MPEG-4 “Part 9 Reference Hardware Description” Phase 2 concerning the integration of the MPEG-4 Optimized Reference software Part 7 and the Reference Hardware Part 9 so as to constitute a “mixed” software hardware description of MPEG-4 video using the concept of the virtual socket. 2. The planning and extensions of the integrated framework for the support to the development of MPEG-4 Part 9 with MPEG-7 Part 7 and AVC (MPEG-4 Part-9) software. 3. The contribution to the definition of the Video Coding Tools repository 4. The approval of the FDAM of MPEG-7 reference software. Input contributions w.r.t. the above items are summarized according to the following table: Contributions M10751 “Report of the AHG on MPEG-4 Part 9 "Reference Hardware Description" M10808 2-D IDCT Hardware Accelerator Implementation for Virtex-II Devices M10821 Motion Estimation Hardware Accelerator Implementation for Virtex-II Devices M10823 An Integrated Hardware-Accelerated Software Framework for MPEG-4 Hardware Reference Model M10824 An IP Block For MPEG-4 Part 10 Context-Based Adptive Variable Length Coding (CAVLC) M10825 A Hardware Block for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10 M10826 A SystemC model for 2x2 Hadamard Transform and Quantization with Application to MPEG–4 Part 10 M10827 A Hardware Block for 4x4 Hadamard Transform and Marco Mattavelli EPFL, Robert Turney Xilinx Research Lab. A. Navarro, A. Silva, O. Nunes, C. Aragao Telecommunications Institute-University of Aveiro-Portugal J.Dubois, L.Pierrefeu, M.Mattavelli Laboratoire Electronique Informatique et Image of Dijon University – France, LTS-3 EPFL Tamer S. Mohamed and Wael Badawy University of Calgary, Calgary, AB, Canada. Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada. Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada. Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada. Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing 171 Quantization in MPEG-4 Part 10 M10828 A SystemC model for 4x4 Hadamard Transform and Quantization with application to MPEG-4 Part 10 M10829 A Hardware Block For The MPEG-4 Part 10 4x4 DCT-Like Transformation And Quantization M10830 A SystemC Model For The MPEG-4 Part 10 4x4 DCT-Like Transformation And Quantization M10849 Low-power hardware acceleration for motion estimation M10863 MPEG-4 Inverse Quantizer Hardware Accelerator Implementation in Virtex II M10883 Hardware Acceleration Module for Shape Adaptive Discrete Cosine Transform Systems (ATIPS), Calgary, Alberta, Canada. Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada. Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada. Ihab Amer, Wael Badawy, and Graham Jullien Advanced Technology Information Processing Systems (ATIPS), Calgary, Alberta, Canada. Valentin Muresan, Noel O’Connor, Noel Murphy, Sean Marlow, Alan Smeaton Centre for Digital Video Processing, Dublin City University, Dublin 9, Ireland. A. Navarro, A. Silva, O. Nunes, C. Aragao Telecommunications Institute-University of Aveiro-Portugal Andrew Kinane, Valentin Muresan, Noel O’Connor, Noel Murphy, Seán Marlow, Alan Smeaton Centre for Digital Video Processing, Dublin City University, Dublin 9, Ireland Tamer S. Mohamed and Wael Badawy University of Calgary, Calgary, AB, Canada. M10954 Multiple IP-Core HardwareAccelerated Software System Framework for MPEG4-Part9 M11092 Hardware Acceleration Module for Daniel Larkin, Valentin Muresan, Noel MPEG-4 Binary Shape Coding O’Connor, Noel Murphy, Seán Marlow, Alan Motion Estimation Tool Smeaton Centre for Digital Video Processing, Dublin City University, Dublin 9, Ireland M11104 Status of CDVP's contribution to Valentin Muresan, Daniel Larkin, Andrew MPEG-4 Part 9 - Implementation Kinane, Noel O’Connor Study Group Centre for Digital Video Processing, Dublin City University, Dublin 9, Ireland. Detailed Report Reference hardware description for MPEG-4 The ISG activity at the Redmond meeting has mainly been devoted to the review of the contribution and to the preparation of guideline documents: the review of the contributions presenting new HDL module submissions the review of contributions on the proposed improvements to the API specification and implementation improvements of the “Virtual Socket”, 172 the planning of the releases of the integrated framework based on the Wildcard II supporting the virtual socket, on the drafting of new guidelines for module and documentation submissions, on the specification of the advanced version of the demonstration, on the update of MPEG-4 Part 2 and Part 10 module submission status. The high number of HDL number received and the several new commitments made necessary several action points to coordinate the work and to uniform the documentation that will be included in the technical report. The first was to update the call for submissions so as to include and make available for current and new submitters all the information and developments made so far (output document N6506). The new call updates the status of the submissions the goals of each phase and provides references to documents providing detailed information on the integrated framework that support the virtual socket API, on the format for the documentation to be submitted together with the module HDL code and to the instruction on how to access the CVS server for HDL code submission and maintenance. With this purpose two output documents have been prepared, one provides the CVS access conditions and instructions (output document N6508), the other is a template for the preparation of the documentation of each HDL module (output document N6507). The table of module submission commitment has been updated and reported in an specific output document (question marks indicate that the commitment is uncertain concerning the delivery date or that the module has not been selected for a submission commitment) (output document N6509) . The ad-hoc group on the development of MPEG-4 Part 9 has been re-established with updated mandates, including a specific mandate for the specification and development of the demonstration platform. The ad-hoc schedule includes 4 telephone conferences before next meeting. Phone conferences are planned on the 19th August, 9th September, 30th September, 14th October at 3 p.m. GMT. Tel: (from US 1-877-582-3182, from outside US 1-706-679-1128, participant code 9202060193). Contribution to the definition of a video tools repository. Two joint meeting with the video group have been held to discuss the issue related to the development of a video tool repository. The implementation study group has contributed to put in evidence all formalism aspects that are essential for an efficient usage of the library so as to be able to define new module interconnections, new control signals and new modules. Such formalism definition should be further developed so as to be able to define new ways of using the standard blocks and define “new standards”. The promotion to FDAM of the MPEG-7 reference software extensions. The MPEG-7 reference software extension has been approved to FDAM answering to the US national body comments requiring for a correct abstract summaries for the audio descriptors. The document will be ready for ballot one week after the end of the meeting. 173 Resolutions The above activities have led to the following resolutions and output document approval. MPEG-4 part 9 related resolutions: 14.1.2 The Implementation Studies subgroup recommends to approve the following documents: MPEG-4 No. 6506 6507 6508 6509 Title 14496-9 MPEG-4 Reference Hardware Description Updated Call for the Submission of Hardware Reference Code for MPEG-4 Part 9: Reference Hardware Description Template for MPEG-4 Part 9 HDL module documentation CVS server user manual and code format specification for MPEG-4 Part9 submissions and maintenance Rev. 0 Status of HDL submissions and commitments for MPEG-4 Part-9 TBP Available Y Y N N 7/27/04 7/30/04 N Y MPEG-7 No. Title TBP Available 15938-6 MPEG-7 Reference Software ISO/IEC FDAM 15938-6 Information Technology -Multimedia Content N 7/30/04 6511 Description Interface- part 6: Reference Software Extensions DoC of ISO/IEC PDAM 15938-6 Information Technology -Multimedia N Y 6512 Content Description Interface- part 6: Reference Software Extensions 14.1.3 The Implementation Studies subgroup would like to thank all submitters of HDL code and contributors to the implementation of the virtual socket and encourages them to continue this fruitful effort and collaboration. 174 Annex 14 Report of Liaisons meeting Source: Jan Bormans The Liaison Group received three requests to establish a class C relationship, all of which were granted after consideration at the Redmond meeting: The Digital Media Project (DMP) is a non-for-profit organisation registered in Geneva in December 2003 with the mission to “promote continuing successful development, deployment and use of Digital Media that respect the rights of creators and rights holders to exploit their works, the wish of end users to fully enjoy the benefits of Digital Media and the interests of various value-chain players to provide products and services, according to the principles laid down in the Digital Media Manifesto”. DMP has assessed the urgent need for Technical Specifications of devices that possess a subset of features of fully-fledged Interoperable End-user Devices, the ability to deal with governed content in an interoperable way being the most important. DMP has called such devices “Portable Audio and Video Devices” (PAV) and decided that it will develop the relevant Technical Specifications on a fast track, namely by April 2005. These DMP activities are complementary to WG 11’s work, especially within the field of MPEG-21. The Digital Cinema Specification Development Committee (DCSDC) as Broadband Networks are now widely spreading throughout the world and high quality video distribution is getting easier and easier, new content business concepts based on the mental sense or culture base are considered becoming key to industry. Considering these trends - and in order to raise-up Japanese cinema industry to the international level on its quality and quantity - the Japanese National Project named Digital Cinema Common Specification Development Project (DCCSDP) has been started on July 1st 2004. To conduct DCCSDP, Digital Cinema Common Specification Development Committee (DCCSDC) was established. Object of this DCCSDP is to create the cinema technology up to and above the film based cinema industry which is mainly conducted by Hollywood, and furthermore, create value chain based on current digital technology and keep technology level consistency from scenario creation to cinema presentation and then, to standardize these established concepts and technologies. This new liaison relationship will enable efficient information exchange and collaboration in the field of normative technology for Digital Cinema Contents. DCCSP will consequently have access to MPEG technology and will provide feedback on its usability for DCCSP’s application domain. Immediate topics of interaction are foreseen to include MPEG-4 AVC, MPEG-7 and MPEG-21 REL and RDD. The Open Mobile Alliance (OMA) was formed in June 2002 by nearly 200 companies representing the world's leading mobile operators, device & network suppliers, information technology companies and content providers. The Open Mobile Alliance is designed to be the centre of mobile service enabler specification work, helping the creation of interoperable services across countries, operators and mobile terminals that will meet the needs of the user (http://www.openmobilealliance.org). 175 The Open Mobile Alliance (OMA) expresses it desire to explore these activities jointly. OMA proposes the exchange of technical working documents and specifications via designated liaison representatives of each organization. The Liaisons Group considered the following input documents: Input Contrib No. M10843 M11105 M10877 M10985 M10775 M10778 M10779 M10781 M10782 M10783 M10784 M10785 M10793 M10794 M10795 M10798 M10799 M10803 M10840 M10893 M10897 M10992 M11116 M11147 Title Liaison Statement from the Digital Media Project Digital Cinema QOS and Conformance Liaison Statement from JTC 1/SC 37 on ISO/IEC FCD 197945 Liaison Statement from the Open Mobile Alliance (OMA) IEC CDV 60728-9/Amd.1: Cable networks for television signals, sound signals and interactive services -- Part 9: Interfaces for cabled distribution systems for digitally modulated signals, Amendment 1 ISO/IEC FCD 19794-6: Information technology -- Biometric data interchange formats -- Part 6: Iris image data SC 37 NP on Vascular Biometric Image Interchange Format IEC CDV 62328-1: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 1: General description and architecture IEC CDV 62328-2: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 2: General recording structure IEC CDV 62328-3: Multimedia home server systems -- Interchangeable volume/file structure adaptation for broadcasting receivers -- Part 3: Broadcasting system specific recording structure – ISDB Liaison Statement from ITU-T SG 17 Liaison Statement from ITU-T SG 12 Liaison Statement from the TV-Anytime Forum IEC CDV 62298-1: Teleweb Application -- Part 1: General Description IEC CDV 62298-2: Teleweb application -- Part 2: Delivery methods Liaison Statement from ITU-R SG 6/WP 6M Liaison Statement from ITU-T SG 9 W3C Comments on the MPEG Timed Text specification Liaison Statement from ITU-R SG 6/WP 6Q SMPTE Liaison to MPEG on OpenType® and ISO/IEC 14496-18 Liaison Statement from the TV-Anytime Forum Liaison Statement from SC 37 Biometrics Liaison Statement from Blu Ray Disk Founders Liaison Statement from IEEE LTSC In addition to replying, when appropriate, to the incoming Liaison Statements, it was agreed to take the initiative to send outgoing Liaison Statements to: W3C - on drawing the attention of W3C’s Device Independence Working Group to existing MPEG technology that addresses parts of the topics they intend to cover in their upcoming Workshop on Metadata for Content Adaptation; VCEG - informing ITU-T SG 16 Q.6 on our progress in the field of Scalable Video Coding (SVC) and links with AVC; 176 JSR-239 – regarding the usage by MPEG-4 part 21 of low-level graphic operations and the use of JSR-239 for its Java bindings to OpenGL ES. The JVT has sent out Liaison Statements to various organizations describing the general status and content of the ISO/IEC 14496-10 FRExt amendment work, expect for BDF and SMPTE, which were sent out by WG 11 as they answer a request by these bodies addressed to WG 11. The responses for the non-technical National Body comments as well as an updated list of organisations with which MPEG entertains liaisons were completed. The following recommendations were issued: The approval of the following documents (Liaison Statements): No. N6551 N6552 N6553 N6554 N6555 N6556 N6557 N6558 N6559 N6560 N6561 N6562 N6563 N6564 N6565 N6566 Title General Liaison Statement to the Digital Media Project Liaison Statement to the DCSDC Liaison Statement to the OMA Liaison Statement to JTC 1/SC 37 Liaison Statement to ITU-T SG 17 Liaison Statement to ITU-R SG 6/WP 6M Liaison Statement to W3C on MPEG Timed Text specification Liaison Statement to Blu Ray Disk Founders Liaison Statement to IEEE LTSC Liaison Statement to SMPTE on OpenType® and ISO/IEC 14496-18 Liaison Statement to W3C on Public Workshop on Metadata for Content Adaptation Liaison Statement to VCEG Liaison Statement to TVAF Liaison Statement to JSR-239 Liaison Statement to IEC TC 100 Liaison Statement to SMPTE on Alpha Channel and AVC/H.264 Frext TBP Available No No No No No No No No No No 2004/07/23 2004/07/23 2004/07/23 2004/07/23 2004/07/23 2004/07/23 2004/07/23 2004/07/23 2004/07/23 2004/07/23 No 2004/07/23 No No No No No 2004/07/23 2004/07/23 2004/07/23 2004/07/23 2004/07/23 The approval of the following documents (statement of benefits): No. Title TBP General Statement of benefits from establishing a class C liaison with the No N6567 DMP Statement of benefits from establishing a class C liaison with the No N6568 DCSDC Statement of benefits from establishing a class C liaison with the No N6569 OMA The approval of the following documents (other Liaison documents): 177 Available 2004/07/23 2004/07/23 2004/07/23 No. Title TBP Available General N6570 Responses to NB Comments No 2004/07/23 N6571 List of WG11 Liaisons No 2004/07/23 The Liaison group recommends the approval of the new Class C Liaisons with the OMA, the DMP and the DCSDC. Nomination of liaison representatives: o Pete Schirling to the OMA o Marc Gauvin to the DMP o Miroslaw Bober to JTC1/SC37 o Jean-Claude Dufourd to W3C 178