INTERNATIONAL ORGANISATION FOR STANDARDISATION ORGANISATION INTERNATIONALE DE NORMALISATION ISO/IEC JTC 1/SC 29/WG 11 CODING OF MOVING PICTURES AND AUDIO ISO/IEC JTC 1/SC 29/WG 11 N4565 March 2002 Source: Title: Status: 1 Leonardo Chiariglione – Convenor Report of 59th WG 11 meeting Opening The 59th WG11 meeting was held in Jeju, Korea Hosted by KATS (Korean Agency for Technology and Standards) and organised by KSA (Korean Standards Association), on 2002/03/11T09:00 – 2002/03/15T21:50. 2 Roll call of participants The attendance list is given in Annex 1. 3 Approval of agenda The approved agenda is given in Annex 2. 4 Allocation of contributions The list of submissions is given in Annex 3. 5 Communications from Convenor The Convenor announced that Rob Koenen had resigned as Requirements Chair and that Fernando Pereira had accepted to continue in the same capacity. 6 Report of previous meeting The Sydney meeting report was approved. 7 Processing of NB Position Papers The comments from the following NBs were received, discussed and responses provided, where appropriate. 7954 UK National Body, Dr K Grant 7965 National Body of Singapore 7966 National Body of Singapore 8022 Japan National Body UK National Body Position Paper on Document Distribution Comment on JVT work Comment on MPEG-4 audio extension 1 JNB Comment on JVT activity 1 8051 Jean H.A. Gelissen (editor for the Dutch NB) 8101 Jean H.A. Gelissen (editor for the Dutch NB) 8157 Japan national Body 8 Concerns about the IPR situation within the JVT group Concerns about the IPR situation within the JVT group JNB Comment on JVT activity MPEG Phase 2 Requirements 8.1 8.2 Standards 8.3 Amendments The following amendment was approved ISO/IEC 13818-1:2000/PDAM2 N4695 8.4 Corrigenda The following progression of corrigenda was approved ISO/IEC 13818-4:1998/DCor 3 4603 ISO/IEC TR 13818-5:1997/DCor 1 4605 8.5 Workplan This was approved. 9 MPEG Phase 4 9.1 Requirements 9.2 9.2.1 Systems Standard The following WD was approved WD 1.0 of ISO/IEC 14496-1 3rd Edition 9.2.2 Extension 1 9.2.3 Extension 2 N4699 The following amendment was approved ISO/IEC 14496-1:2001/FDAM2 9.2.4 N4698 Extension 3 The following amendment was approved ISO/IEC 14496-1:2001/FPDAM3 9.2.5 N4701 Extension 4 2 9.2.6 Extension 5 The concerns of the UKNB that the text for ISO/IEC 14496-1 Amendment 5 and 15444-3 Amendment 1 may diverge as the different WGs handle NB comments were note. It was decided that the SC29 AGM chairman monitors the processes of generating DoCs to NB comments and amending the text to ensure the text continues to be unified. The changes proposed at the WG1 meeting in Genoa should be reviewed by MPEG in the Fairfax, VA meeting and then returned to WG1. 9.2.7 Extension 6 9.2.8 Corrigenda 9.3 9.3.1 Visual Standard A new version of MPEG-4 Visual Implementers Guide List of Problem Reports (N4583) was approved. A request was received to implement error resilience at the enhancement layer of existing scalability coding tools. Because such a work would require definition of a new tool, object type and profile, it was decided that such major effort could only be carried out if sufficient continuous support was evident by contributing parties. 9.3.2 Extension 1 9.3.3 Extension 2 The FGS Verification Test results were presented and discussed. A revision of one test was decided. 9.3.4 9.4 Corrigenda Audio 9.4.1 Standard 9.4.2 Extension 1 The following WD was approved WD on Backward Compatible Bandwidth Extension for General Audio Coding (ISO/IEC 14496-3:2001 Amendment 1) 9.4.3 Extension 2 9.4.4 Corrigenda 9.5 Conformance Testing 9.5.1 Standard 9.5.2 Amendment 1 9.5.3 Amendment 2 9.5.4 Amendment 3 The following amendment was approved 3 4611 ISO/IEC 14496-4:2001/PDAM3 9.5.5 N4708 Corrigenda The following corrigendum was approved ISO/IEC 14496-4:2001/COR1 9.6 N4706 Reference software 9.6.1 Standard 9.6.2 Extension 1 The following amendment was approved ISO/IEC 14496-5:2001/FDAM1 9.6.3 Extension 2 9.6.4 Extension 3 9.6.5 Extension 4 9.6.6 Corrigenda 9.7 DMIF 9.7.1 Standard 9.7.2 Corrigenda 9.8 9.8.1 9.9 9.9.1 N4711 Optimised software Technical Report 4 on IP Framework Standard The following standard was approved ISO/IEC 14496-8/FDIS N4712 9.10 Hardware Reference Description 9.10.1 Technical Report The ISG reported that they had received the first submitted module. 9.11 Advanced Video Coding The JVT did not meet at the same place as MPEG. However, some documents were produced and communicated to the JVT: Requirements for AVC Codec 4672 4 Communication to JVT Initial Memory Complexity Analysis of the AVC Codec Guidelines and work-plan for the complexity analysis of the AVC reference software 4673 N4570 N4571 A Liaison to VCEG (N4658) was also produced to highlight areas of common interest that are not directly dealt with by the JVT. Not having received comments fron NBs, the reference software copyright license of resolution 8 of the Pattaya meeting was adopted. Noting the concerns of several NBs with respect to the royalty-free baseline profile, whose use could be jeopardised by the later appearance of one or more IPR elements with possible negative effects not only the royalty-free baseline, but also other higher-level non-royalty-free profiles, MPEG members – including JVT members – and NBs were requested to take into consideration the consequences of this possible outcome and advise at the next meeting. 9.12 Explorations 9.12.1 Fine Granularity Scalability It was agreed that work on extensions on top of the Fine Granularity Scalable (FGS) Profile could be started if the advantage of FGS is evident from the finalized test report. Some proposals were received and reviewed. The main goals are 1. higher coding efficiency of FGS coding (prospectively approaching the compression performance of single-layer coders) 2. extenion of the ranges of scalability. 9.12.2 MP4 9.12.3 Advanced Text and 2D Graphics A Preliminary Call for Proposal on Advanced Text and 2D Graphics (N4705) was approved. 9.13 Workplan This was approved. 10 MPEG Phase 7 10.1 Requirements 10.2 Systems 10.2.1 Standard 10.2.2 Version 2 10.3 Description Definition Language 10.3.1 Standard 10.4 Visual 10.4.1 Standard 10.4.2 Version 2 10.5 Audio 10.5.1 Standard 5 10.5.2 Version 2 The following WD was approved WD of MPEG-7 Audio Extension 1 4615 10.6 Description Schemes 10.6.1 Standard 10.6.2 Version 2 The following WD was approved MPEG-7 Multimedia Description Schemes Extensions WD (v2.0) 4631 10.7 Reference software 10.7.1 Standard 10.7.2 Version 2 10.8 Conformance Testing 10.8.1 Standard The following progression of standard was approved ISO/IEC 15938-7 FCD — Information Technology — Multimedia Content Description Interface — Part 7: Conformance 4633 10.9 Extraction and use of visual descriptors 10.9.1 Technical Report The following Technical Report was approved ISO/IEC DTR 15938-8 Multimedia Content Description Interface – Part 8 Extraction and Use of MPEG-7 N4579 10.10 Workplan This was approved. 11 MPEG phase 21 11.1 Requirements Version 1.0 of the MPEG-21 Requirements (N4681) was approved. The first Draft of MPEG-21 Requirements for Digital Item Processing for Applications (N4686) was approved. 11.2 Vision, Technologies and Strategy 11.3 Digital Item Declaration 11.4 Digital Item Identification 6 The words “and Description” were removed from the title of this part of 21000. The following progression of standard was approved MPEG-21 Digital Item Identification FCD 4636 A Request for Candidates for the Registration Authority for ISO/IEC 21000-3was also approved (N4638). 11.5 Intellectual Property Management and Protection 11.6 Rights Expression Language The following WD was approved MPEG-21 Rights Expression Language WD (v2.0) 4639 11.7 Rights Data Dictionary 11.8 Digital ItemAdaptation The Final Call for Proposals for Digital Item Adaptation (N4683) with associated Requirements for Digital Item Adaptation (N4684) was approved. Subdivision of the 21000 project to accommodate part 7 with this name was requested. 11.9 Reference software 11.10 Other MPEG-21 parts 11.11 Workplan This was approved 12 Overall WG11 workplan This was approved 13 Explorations 13.1 Lossless audio coding After a thorough study that considered technical feasibility, market relevance and supporting companies it was decided that consideration be given for a work item on lossless audio coding. The next steps will be the development of a set of requirements and the drafting of a Call for Proposals. 13.2 3D Video coding 13.3 Digital Cinema Work in this area started again from Digital Cinema requirements (N4680). 13.4 Interframe Wavelet in Video Coding Experimental Conditions for Wavelet Coding Exploration (N4584) were approved. 14 Liaison matters The list of organisations with which MPEG entertains liaisons (N4667) was approved. 15 Administrative matters 15.1 Schedule of future MPEG meetings This was approved as follows 7 No. 58 59 60 61 62 63 64 65 66 yy 01 02 02 02 02 02 03 03 03 mm 12 03 05 07 10 12 03 07 11 dd 03-07 11-15 06-10 22-26 21-25 09-13 10-14 21-25 03-10 City Pattaya Jeju Fairfax, VA Klagenfurt Shanghai Turin? ? Trondheim ?, HI Country TH KR US AT CN IT ? NO US 15.2 Promotional activities New versions of the MPEG-4 and MPEG-7 overviews were approved. MPEG-4 Overview MPEG-7 Overview 4668 4674 As usual there were an MPEG101 session on the Sunday before the meeting and a sessions related to the establishment of the MPEG-7 Alliance. In addition the SNHC group reported the emerging discussion to initiate an industry forum regarding MPEG-4 AFX standardization. This activity, designed to accelerate the AFX commercialization, will hold a meeting on May 4 before the MPEG (Fairfax) meeting. 16 Organisation of this meeting 16.1 Tasks for subgroups These were assigned. In particular the Convenor asked to collect available information on those assets – conformance bitstreams and reference software – that the group had produced over the years. Jean-Claude Dufourd was kind enough to search for the information and produced N4690 listing the material related to MPEG conformance test bitstreams and N4691 listing MPEG reference software. Similarly it was possible to produce the list of MPEG standards finally released by WG11 for which publication stage had apparently not been reached (N4595). 16.2 Joint meetings The following joint meetings were held Group 1 Group 2 Requirements Video, SNHC What 3DVideo Requirements Systems, Video JVT 1 Requirements Video Various Requirements MDS RDD/REL Requirem MP21 Architetcture Requirements Systems, MDS 8 Where Day Time Requirements Mon 17:0018:00 Requirements Tue 09:0011:00 Requirements Tue 14:0016:00 MDS Tue 15:0016:00 Requirements Tue 16:0018:00 ISG Video Video Sys XM integration BiM Requirements Audio, Video, MDS MDS Sys, Aud, Vid MP7 Profiles SNHC Systems AFX MDS ISG MP7 XM MP7 Conformance Requirements Audio MP4, Lossless Video AVC complexity ISG Requirements Systems MP4 profiles, ATG Audio MDS Systems Requirements multichannel signaling MP21 IPMP Requirements MDS DIA Video AVC, 3DV, DCinema Requirements VIP BOR4 Wed 14:0014:30 Requirements Wed 14:0015:30 Video Wed 15:3016 :30 Systems Wed 15:3017:30 MDS Thu 09:0009:30 Audio Thu 09:0010:00 Video Thu 09:3010:30 Systems Thu 10:3011:30 MDS Thu 11:0011:30 Requirements Thu 11:0012:00 MDS Thu 14:0015:00 Requirements Thu 14:0015:30 17 Planning of future activities The following ad hoc groups were established 4716 4722 4720 4721 4629 4630 4619 4622 4590 4592 4648 4649 4650 4646 4591 4588 4587 4725 4724 4617 “How to” integrate specific decoders in BiM Ad Hoc Group on IM1 Ad Hoc Group on MPEG-4 Conformance Ad Hoc Group on MPEG-4 Scene Representation AHG on AFX PDAM/VM editing and Core Experiments AHG on AFX SW implementation AHG on Audio part of MPEG-4 Conformance AHG on Audio part of MPEG-7 Conformance AHG on Digital Cinema AHG on Editing MPEG-7 Visual XM AHG on Editing the MPEG-21 DID and DII FCDs AHG on Editing the MPEG-21 RDD WD AHG on Editing the MPEG-21 REL WD AHG on Editing the MPEG-7 MDS Extensions WD and XM AHG on Editorial Convergence and Maintenance of MPEG-4 Reference Software AHG on Exploration of Interframe Wavelet Technology in Video Coding AHG on Fine Granularity Scalability AHG on MP4 Extensions AHG on MPEG IPMP Extension AHG on MPEG-2 AAC 9 4616 4688 4598 4599 4618 4620 4575 4596 4621 4647 4597 4719 4593 4689 4589 4651 4623 4723 4576 4574 AHG on MPEG-2 Audio Reference Software AHG on MPEG-21 Digital Item Adaptation AHG on MPEG-21 Digital Item Processing for Applications AHG on MPEG-21 Requirements AHG on MPEG-4 Audio DCorr Text and Reference Software AHG on MPEG-4 Audio Extension 1 Core Experiments AHG on MPEG-4 Part 9: Reference Hardware Description AHG on MPEG-7 Applications & Promotion to Industry AHG on MPEG-7 Audio AHG on MPEG-7 Extension Mechanisms AHG on MPEG-7 Interoperability & Profiling AHG on MPEG-7 Systems and DDL AHG on MPEG-7 Visual Core Experiments AHG on MPEG-OeBF IPMP Issues AHG on of 3-D Video Coding in MPEG AHG on REL Core Experiments AHG on Requirements and methods for MPEG-4 Lossless Audio Coding AHG on the Carriage of MPEG-4 Content AHG on the complexity analysis of AVC reference software AHG on XM Development 18 Resolutions of this meeting These were approved 19 A.O.B There were no other businesses 20 Closing The meeting closed on 2002/03/15T21:50 with thanks to the hosting organisation. 10 Annex 1 Attendance list No. First Name Family Name Company Coun try 1. Ian Burnett University of Wollongong AU 2. Ernest Wan CISRA AU 3. Hermann Hellwagner University Klagenfurt AT 4. Ioan Alexandru Salomie Vrije Universiteit Brussel BE 5. Yiannis Andreopoulos Vrije Universiteit Brussel BE 6. Eric Delfosse IMEC BE 7. Jan Bormans IMEC BE 8. Alain Mignot SGDL Systems Inc CA 9. Peter Haighton VideoSpheres Inc. CA 10. Feng Wu Microsoft Research Asia CN 11. Yuwen He 12. Wen Gao(Prof.) 13. Jiri Matas CTV Cz 14. Mauri Vaananen Nokia FI 15. Jean-Claude Dufourd ENST FR 16. Marc Vlicher Gues SCPD FR 17. Yuval Fisher Envivio FR 18. Alexandre Cotarmanac'h France Telecom R&D FR 19. David Virette France Telecom FR 20. Dominique Curet France Telecom FR 21. Eric Barrau Philips Research France FR 22. Marius Preda INT FR 23. Olivier Avaro France Telecom R&D FR Computer Science Technology Department, Tsinghua University Graduate school of Chinese Academy of Sciences 11 CN CN 24. Patrice Collen France Telecom R&D FR 25. Patrick Gioia France Telecom R&D FR 26. Pierrick Philippe France Telecom FR 27. Sebastien Brangoulo France Telecom FR 28. Claude Seyrat EXPWAY FR 29. Sylvain Devillers Philips Research France FR 30. Andreas Hutter Siemens AG DE Ohm RWTH Aachen DE 31. Prof Jens-Rainer 32. Ralph Sperschneider Fraunhofer IIS-A, Dipl.-Ing. DE 33. Aljoscha Smolic Heinrich-Hertz-Institute DE 34. Carsten Herpel Thonsom Multimedia DE 35. Ingo Wolf T-Systems Nova GmbH Berkom DE 36. Joerg Bitzer Houpert Digital Audio DE 37. Juergen Herre Fraunhofer IIS-A, Dipl.-Ing. DE 38. Karlheinz Brandenburg Fraunhofer AEMT DE 39. Stefan Meltzer Coding Technoligies GmbH DE 40. Bernd Edler University of Hannover DE 41. Stephan Herrmann Munich University of Technology DE 42. Christian Neubauer Franhofer Institute IIS-A DE 43. Joerg Heuer Siemens AG DE 44. Itsik Mantin EMBLAZE Systems IL 45. Shlomo Birman Vimarix IL 46. Zvi Lifshitz Opitbase Ltd. IL 47. Massimo Balestri TILAB IT 48. Leonardo Chiariglione Telecom Italia Lab IT 49. Nicola Adami University of Brescia IT 50. Vittorio Baroncini FUB IT 12 51. Hideki Sakamoto NTT JP 52. Itaru Kaneko Waseda University JP 53. Nicholas Givotovsky MMG, Ltd. JP 54. Seiichi Goshi NHK JP 55. Takafumi Ueno Matsushita Electric JP 56. Takahito Iida Dentsu Inc. JP 57. Takanori Senoh Matsushita Electric Industrial Co., Ltd. JP 58. Toru Kambayashi Toshiba Corp. JP 59. Craig A. Schultz Access Ticket Systems INC. JP 60. Hideaki Kimata NTT JP 61. Ken Yamada Melodies & Memories Global Ltd. JP 62. Kimihiko Kazui Fujitsu Laboratories Ltd. JP 63. Masahiro Iwadare NEC Corporation JP 64. Masayuki Tanimoto Nagoya University JP 65. Naoya Tanaka Matsushita Electric Industrial Co., Ltd. JP 66. Ryozo Yamashita ASCII Corporation JP 67. Shinichi Takagi Waseda University JP 68. Takashi Matsuyama Kyoto University JP 69. Takayuki Nakachi NTT JP 70. Takehiro Moriya NTT JP 71. Takeshi Norimatsu Matsushita Electric Industrial Co., Ltd. JP 72. Takuyo Kogure Matsushita Electric Industrial Co., Ltd. JP 73. Toshio Kamei NEC Corporation JP 74. Toshiyuki Nishimura ASCII Corporation JP 75. Yoshinori Suzuki Hitachi, Ltd. JP 13 76. Youichi Takashima NTT Cyber Soulutions Labs JP 77. Akio Tanaka Toshiba Corp. JP 78. Akio YAMADA NEC Corp. JP 79. Day Neil Bluemetrix JP 80. Hirofumi Nishikawa Mitsubishi Electric Corp JP 81. Hiroshi Ito Mitsubishi Electric Corp JP 82. Hiroyuki Yamaguchi NTT DoCoMo, Inc JP 83. Kohtaro Asai Mitsubishi Electronic Corp JP 84. Koji Taniguchi Matsushita Electric Industrial Co., Ltd. JP 85. Masanori Sano NHK Science & Technical Research Lab JP 86. s Mayumi Koike The University of Tokyo JP 87. Shuichi Watanabe SHARP Corp. JP 88. Terumasa Aoki The University of Tokyo JP 89. Tokumichi Murakami Mitsubishi Electric Corp JP 90. Toru Yokoyama Hitachi, Ltd. JP 91. Toshiya Takahashi Matsushita Electric Industrial Co., Ltd. JP 92. Toshiyuki Nomura NEC Corp JP 93. Yoshinori Sugihara JEITIA JP 94. Koiti Hasida AIST JP 95. Kiyoshi Suzuki RICOH COMPANY, LTD JP 96. Takayuki Kunieda RICOH Company, Ltd. JP 97. Toshiaki Fujii Nagoya University JP 98. Mikio Sasaki Denso Corporation JP 99. Noboru Sonehara NTT JP LG Electronics LG Electronics ETRI KR KR KR 100. 101. 102. Doim Chang Do-nyun Kim Hyun-Cheol Kim 14 103. Jongjin Chae MarkTek Inc., KR 104. Kyuheon Kim ETRI KR 105. 106. 107. Won-Sik Yong-Chul Yong-Hyun Cheoneg Park Park ETRI LG Electronics LG Electronics KR KR KR 108. Young Kwon Lim net&tv Co., Ltd., Team Manager KR 109. Young-Won Song LG Electronics KR 110. Byeungwoo Jeon Sung Kyun Kwan University KR 111. 112. 113. Dae-Sung Do-Kyoon Dongkwon Cho Kim Park Samsung AIT Samsung AIT Dongguk Univ. KR KR KR 114. Du-Sik Park Samsung AIT KR 115. Euee-Seon Jang Samsung AIT KR 116. Gyeong-Ja Jang Samsung AIT KR 117. 118. 119. Hae-Kwang Han-Kyu Hee Beom Kim Lee Kang Sejong University ETRI Dongguk Univ. KR KR KR 120. Hyunwoo Kim Samsung AIT KR 121. 122. 123. Iyang-Seok Jae-Ho Jaehyuck Jo Lee Lim Dongguk Univ. Yura Vision Dongguk Univ. KR KR KR 124. Jaejoon Kim ETRI KR 125. Jae-Seob Shin Samsung KR 126. Jeong-il Seo ETRI KR 127. JinGuk Jeong Sogang University KR 128. 129. 130. Jin-Kyoung Jinwoong Jooyoung Kim Kim Kim OpenWeb ETRI Sogang University KR KR KR 131. Jung Ho Choi KT KR 132. Kisong Yoon ETRI KR 133. Kwang-deok Seo KAIST KR 134. Mahnjin Han Samsung AIT KR 135. Min-Seok Choi Yura Vision KR 15 136. Munchurl Kim Information and Communications University KR 137. 138. Nam-Yeoul Sang-Beom Lee Chong Sejong University Sejong University KR KR 139. Sang-Kyun Kim Samsung AIT KR 140. Sang-Oak Woo Samsung AIT KR 141. Sangyoun Lee KT KR 142. Seokcheol Kee Samsung AIT KR 143. 144. 145. 146. Shinjun Soo-Jun Sukhee Tae-Kyun Lee Park Cho Kim Samsung AIT ETRI ETRI Samsung AIT KR KR KR KR 147. Woong Il Choi Sungkyunkwan Univ KR 148. Woo-Shik Kim Samsung AIT KR 149. Yeonjeong Jeong ETRI KR 150. Yong Han Kim University of Seoul KR 151. 152. Yong-Ju Youngho Cho Suh ETRI ETRI KR KR 153. Young-Seung Chun Sejong University KR 154. Youngsik Huh Samsung AIT KR 155. 156. 157. 158. Bongsue Byungsik Daijin Dong Gu Suh Yoon Kim Kang ETRI ETRI POSTECH/Dept.of Computer Eng KBS KR KR KR KR 159. Hak Chun Lee Mediachorus KR 160. HeeGoo Kang Varo Vision Co., Ltd. KR 161. Heon Jun Kim LG Electronics KR 162. Ho Wook Jang ETRI KR 163. Ho-Keun Lee Y.P.LEE & Associates KR 164. Jae-Yong Lee Serome Technology KR 165. Jeen Soo Myung KwangWoon University KR 166. 167. 168. Jeho Nam Jieun Lee Jong Kweon Lee ETRI LG Electronics KRn Broadcasting System KR KR KR 16 169. 170. 171. JongNam Joon-Ho Joon-Ho Kim Chang Song KBS Serome Technology Varo Vision Co., Ltd. KR KR KR 172. JungGeun Lee MOVAIN-Inter Information co.,Ltd KR 173. Kiseok Oh 174. 175. 176. 177. Kyeongsoo Kyoungro Kyuseo Manho Kim Yoon Han Park Copyright Deliberation&Concilation Committee KRn Broadcasting System LG Electronics ETRI ETRI 178. Minsoo Hahn Information and Communications University KR 179. 180. 181. 182. Moon Jae Myung-Don Myung-hwan Okgee Cho Kim Ha Min KRn Broadcasting System ETRI KRn Broadcasting System ETRI KR KR KR KR 183. Sang Hoon Sull KR Univ. KR 184. Sang Taek Kim KT KR 185. Sang-Wook Kim Samsung KR 186. 187. Seong-Chan Byun Seoung-Jun Oh LG-Elite / IT Lab. MI Gr. KwangWoon University KR KR 188. Seunghyub Jeong ETRI KR 189. Seyoon Jeong ETRI Visual Information Research Team KR 190. 191. Soo-Young Sunghee Chi Park ETRI ETRI KR KR 192. Sungjoo Suh KR Univ. KR 193. Sunjung Kim KT KR 194. Suyoung Bae ETRI KR 195. Syu Jung Mun ETRI KR 196. Whoi-Yul Kim Hanyang University KR 197. Yanglim Choi Samsung Electronics KR 198. Yong Man Ro ICU KR 199. 200. Young-Woo Jung Yunju Lee ETRI KETI KR KR 17 KR KR KR KR KR 201. Yunjung Choi ETRI KR 202. CheonSeog Kim IV System KR 203. 204. 205. Ji Yeon KeeHwan Rin Chul Park Kim Kim Enpia Systems Enpia Systems University of Seoul, Dept. of ECE KR KR KR 206. SeungJi Yang IV System KR 207. So-youn Cho KR Content Forum KR 208. Youngmin Huh REAKoSYS KR 209. So Young Bae LG Electronics KR 210. Hyoung Joong Kim Kangwon National University KR 211. Junhwan Cho Reakosys KR 212. Kwangmin Hyun Reakosys KR 213. Andrew Tokmakoff Telematica Instituut NL 214. Jean H.A Gelissen Philips Research Laboratories NL 215. Marc Klein Middelink Philips (PDSL) NL 216. Peter Mulder NOB NL 217. Stanislau Pokracu Telematica Instituut NL 218. Werner Oomen Philips (PDSL) NL 219. Jan Van Der Meer Philips NL 220. Andrew Perkis NTNU NO 221. Arne Lie NTNU NO 222. Iver Grini Octaga AS NO 223. Wladyslaw Skarbek Warsaw University of Technology and Altkon PL Akademia 224. Ernesto Santos INESC Porto PT 225. Fernando Pereira Instituto Superior Tecnico PT 226. Ming Ji Panasonic Singapore Laboratories Pte Ltd SG 227. Zhongyang Huang Panasonic Singapore Laboratories Ltd. SG 18 228. Jing Liu Panasonic Singapore Laboratories Pte Ltd SG 229. Kok Seng Chong Panasonic Singapore Laboratories SG 230. Shengmei Shen Panasonic Singapore Laboratories Pte Ltd SG 231. Sua-Hong Neo Panasonic Singapore Laboratories Pte Ltd SG 232. Francisco Moran Burgos Univ Politecnica Madrid ES 233. Paulo Villegas ES 234. Charilaos Christopoulos Ericsson Research, Manager, MediaLab SE 235. Kristofer Kjoerling Coding Technologies Sweden AB SE 236. Per Frojdh Ericsson Research SE 237. Guy Moreillon NagraVision CH 238. Touradj Ebrahimi EPFL CH 239. Barney Wragg eLabs Universal Music UK 240. Panos Kudumakis CRL UK 241. Uwe Jost CRE UK 242. Chris Barlas Rightscom Ltd UK 243. Jean Stride British Standards Institution UK 244. Kate Grant NINE TILES UK 245. Keith Hill Rightscom Ltd UK 246. Michael Steliaros Superscape (UK) Ltd. UK 247. Mirowlaw Bober Mitsubishi Electronic Corp UK 248. Niels Rump Rightscom Ltd UK 249. David Parrott Reuters UK 250. Godfrey Rust Indecs2 UK 251. Leszek Cieplinski Mitsubishi Electric ITE-VIL UK 252. Tamer Shanableh Motorola UK Research UK Telefonica I+D 19 253. Timothy Wright Vodafone UK 254. Andrew Tescher Microsoft US 255. Ashish Banerji Hughes Network Systems US 256. Bradford Gandee ContentGuard, Inc. US 257. Bruce Block Recording Industry Association of America US 258. Eric Edwards Sony US 259. John R. Smith IBM T.J. Watson Research Center US 260. M Paramasivam Microsoft Corporation US 261. Martha Nalebuff Microsoft Corp. US 262. Thomas DeMartini ContentGuard, Inc. US 263. Xin Wang ContentGuard, Inc. US 264. Allan Peach DemoGraFX US 265. Anthony Vetro Mitsubishi Electronic Corp US 266. Eric Rehm Singingfish / Thomson Multimedia US 267. Frank Bossen DoCoMo Communications Laboratories USA, Inc US 268. Huifang Sun Mitsubishi Electronic Corp US 269. Jason Faks Dolby Laboratories US 270. Jay Yun Qualcomm Incorporated US 271. John Woods Center for Next Generation Video US 272. Jordan Isailovic Jri Technology US 273. Matthew Fellers Dolby Laboratories US 274. Michelle Kim IBM US 275. Myron Rubinfeld NIST US 276. Toby Walker Sony Corp. US 277. Vladimir Levantovsky Afga Monotype Coporation US 20 278. Weiping Li WebCast Technologies, Inc US 279. Ali Tabatabai Sony US 280. Bhauan Gandi Gaetana US 281. Ged Powell MoCoCo Communications Laboratories USA, US Inc. 282. Jiangtao Wen PacketVideo Corp. US 283. Jose' Roberto Alvarez Broadcom Corp. US 284. Michel Rynderman Avid Technology, Inc. US 285. Peter Marx Vivendi Universal Net US 286. Peter Schirling IBM Research Division, Digital Media Standards US 287. Peter van Beek SHARP US 288. Robert Turney Xilinx Labs US 289. Sam Narasimhan Motolola US 290. Sherman Chen Broadcom US 291. Tihao Chiang National Chiao Tung University US 292. Viswanathan Swaminathan Sun Microsystems Inc. US 293. Wolf Husak Dolby Labs US 294. Majid Rabbani Eastman Kodak Company US 295. Mihaela van der Schaar Philips Research US 296. Omid Moghadam Intel Corp. US 297. Wo Chang NIST US 21 Annex 2 Document list No. 7871 7872 7873 Author(s) Title Mike Rubinfeld Document Register for SC29/WG11 Meeting #59 in Jeju Island, Korea Levels for MPEG-4 Audio Profiles Technical Description of Interpolator Compression Tools 7874 Fernando Pereira (editor) Do Kyoon Kim, Sang Oak Woo, Seok Yoon Jung, Gyeong Ja Jang, ShinJun Lee, Mahnjin Han, Euee S. Jang ITTF via SC 29 Secretariat 7875 ITTF via SC 29 Secretariat 7876 SC 29 Secretariat 7877 SC 29 Secretariat 7878 SC 29 Secretariat 7879 Massimo Balestri (TILAB), Filippo Chiariglione (TILAB) Massimo Balestri (TILAB), Filippo Chiariglione (TILAB) MPEG-4 Industry Forum via SC 29 Secretariat 7880 7881 7882 7883 7884 7885 7886 Avay Divakaran, John Smith, Michel Rynderman Massimo Balestri (TILAB), Filippo Chiariglione (TILAB), Panos Kudumakis (CRL) SC 29 Secretariat 7889 7890 7891 Craig A. Schultz Ming Ji, SM Shen, ZY Huang (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure (Matsushita Electric Industrial Co., Ltd) Ming Ji, SM Shen, ZY Huang (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Jan van der Meer (Philips Digital Networks) Ming Ji, SM Shen, ZY Huang (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Jan van der Meer (Philips Digital Networks) David Kosiba David Kosiba, Bruce Chaplin David Kosiba, Bruce Chaplin 7892 David Kosiba 7893 7894 David Kosiba, Bruce Chaplin David Kosiba, Bruce Chaplin 7895 7896 7897 7898 David Kosiba David Kosiba, Bruce Chaplin IEC TC 100 via SC 29 Secretariat IEC TC 100 via SC 29 Secretariat 7887 7888 Table of Replies on ISO/IEC FDIS 14496-5:2001 (SC 29 N 4588) Table of Replies on ISO/IEC 14496-2/FDAM 2 (SC 29 N 4565) Table of Replies on ISO/IEC 14496-2/FDAM 1 (SC 29 N 4564) Summary of Voting on ISO/IEC 144965:2001/FPDAM 1 (SC 29 N 4589) Liaison Statement from CEN/ISSS to WG 11 (SC 29 N 4591) OMG IDL declaration of the IPMP messaging interface Proposed changes in the IPMP Messaging Infrastructure Liaison Statement from MPEG-4 Industry Forum to WG 11 on MPEG-4 Audio Profiles (SC 29 N 4595) Study on 15938-7 Conformance Proposal of audio watermarking messages for the IPMP Messaging Infrastructure Summary of Voting on ISO/IEC 138181:2000/FPDAM 1 (SC 29 N 4601) IPMP 101 IPMP Rights ES and Messages for Distributed IPMP Terminal for MPEG-4 IPMP Extension Incorporation of Some Suggestions into MPEG-2 IPMP Incorporation of Some Suggestions into MPEG-2 IPMP Distributed Terminal Walkthrough Data Buffer Reference URL Format Proposed Syntax for C++ CreateInstance and DeleteInstance New Message to Register for IPMP Tool Deletion Listener Correction to Asynchronous Messaging Diagram Changes to IPMP ProcessData and ProcessDataReturn messages IPMP Tool Descriptors in the IOD New Message to Terminate IPMP Tool IEC CD 60958-1 2nd Edition (SC 29 N 4612) IEC CDV 61937-1 2nd Edition (SC 29 N 4613) 22 No. 7899 7900 7901 Author(s) Title Hideki Sakamoto,Toru Hayashi, Yoichi Takashima, Hiroyuki Yamashita, Jay Kishigami, Hiroshi Yasuda SC 29 Secretariat Case Study of Persistent Association of Information with Digital Items: cIDf&s Trial on ID Resolution 7917 ZY Huang, SM Shen, Ming Ji (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure (Matsushita Electric Industrial Co., Ltd) Do Kyoon Kim, Sang Oak Woo, Seok Yoon Jung, Shinjun Lee, Gyeong Ja Jang, Mahnjin Han, Euee S. Jang Do Kyoon Kim, Sang Oak Woo, Seok Yoon Jung, Shinjun Lee, Gyeong Ja Jang, Mahnjin Han, Euee S. Jang Do Kyoon Kim, Sang Oak Woo, Seok Yoon Jung, Shinjun Lee, Gyeong Ja Jang, Mahnjin Han, Euee S. Jang Do Kyoon Kim, Sang Oak Woo, Seok Yoon Jung, Shinjun Lee, Gyeong Ja Jang, Mahnjin Han, Euee S. Jang Yiannis Andreopoulos, Adrian Munteanu, Geert Van der Auwera, Joeri Barbarien, Peter Schelkens, Jan Cornelis IEC TC 100 via SC 29 Secretariat IEC TC 100 via SC 29 Secretariat IEC TC 100 via SC 29 Secretariat Niels Rump (ed.) Paul Jessop, Niels Rump (for the AhG Empty Olivier Avaro (France Telecom R&D), JeanClaude Dufourd (ENST), Jan Van der Meer (Philips), Craig A. Schultz AccessTickect), Michelle Kim (IBM), Young-Kwon Lim (MP4Cast), Zvi Lifshitz (Optibase), Claude Seyrat Expway), David Singer (Apple) Hyunwoo Kim, Tae-Kyun Kim, Jong Ha Lee, Won Jun Hwang, Seok Cheol Kee Wo Chang 7918 7919 Wo Chang, Yoshiaki SHIBATA Tamer Shanableh, Paola Hobson 7920 Craig A. Schultz 7921 7922 7923 7927 7928 Craig A. Schultz Niels Rump Niels Rump Koiti Hasida Koiti Hasida 7930 7931 Sukhee Cho, Yunjong Choi, Kugjin Yun, Youngkwon Hahm, Chieteuk Ahn and Yonghan Kim* ITTF via SC 29 Secretariat 7933 Jose M. Martinez 7902 7903 7904 7905 7906 7907 7908 7909 7910 7911 7912 7913 7914 Summary of Voting on ISO/IEC 144961:2001/FPDAM 2 (SC 29 N 4610) IPMP_Scheme descriptor for Digital Item in MPEG21 architecture Result of Core Experiment on Interpolator Compression Result of Core Experiment on Interpolator Compression Result of Core Experiment on Interpolator Compression Result of Core Experiment on Interpolator Compression Wavelet-based fine granularity scalable video coding with in-band prediction IEC CDV 61937-2 2nd Edition (SC 29 N 4615) IEC CDV 61937-3 2nd Edition (SC 29 N 4616) IEC CDV 61937-4 2nd Edition (SC 29 N 4617) MPEG-21 Technical Architecture Working Draft MPEG-21 Technical Architecture AhG Report Empty Systems Meeting Report Component-based 2nd-order ICA face descriptor MPEG-7 Interoperability Test Bed (M7ITB) Status Report MPEG-7 Profiles and Levels Architecture A proposal for syntax amendment to use the error resilience tools in the MPEG-4 Simple Scalable Profile Study of Text of PDAM ISO/IEC 14496-1:2001 / AMD3 Tokyo IPMP Adhoc meeting report. Study on ISO/IEC CD 21000-3 (MPEG-21 DII&D) Requirements on DII&D (resubmission from m7177 Some Amendments to the Linguistic DS Generalized Uses of Some Linguistic-Description Tools Requirement for multi-viewpoint stereoscopic video Table of Replies on ISO/IEC FDIS 15938-2 (SC 29 N 4625) Proposal for MPEG-7 Overview update 23 Author(s) Title 7938 Anthony Vetro, Sylvain Devillers, Andrew Perkis Anthony Vetro, Sylvain Devillers, Andrew Perkis A. G. Tescher for USNB 7939 ITU-T SG 16 via SC 29 Secretariat 7940 ITU-T SG 16 via SC 29 Secretariat 7941 ITU-T SG 16 via SC 29 Secretariat 7942 SC 29 Secretariat 7943 7944 7945 Kristofer Kjorling, Andreas Ehret, Per Ekstrand, Jonas Engdegard, Fredrik Henn, Lars Liljeryd, onas Roen, Michael Schug, Lars Villemoes Chris Barlas Chris Barlas Report of the AHG on MPEG-21 Digital Item Adaptation Draft Evaluation Criteria for MPEG-21 Digital Item Adaptation USNB Contribution: Recommendation to Digital Cinema Liaison Statement from ITU-T SG 16 to SC 29/WG 11 on MPEG-4 on IP (SC 29 N 4634) Liaison Statement from ITU-T SG 16 to SC 29/WG 11 on JVT (SC 29 N 4635) Liaison Statement from ITU-T SG 16 to SC 29/WG 11 on Mediacom 2004 (SC 29 N 4636) Summary of Voting on PDTR 15938-8 (SC 29 N 4637) Technical Description of Coding Technologies&; Proposal for MPEG-4 v3 General Audio Bandwidth Extension: Spectral Band Replication (SBR) 7946 John Utz III 7947 Soo-Jun Park 7948 7949 7950 7951 7952 Akio Yamada Akio Yamada Akio Yamada Akio Yamada Toshio Kamei, Akio Yamada 7953 Toshio Kamei, Akio Yamada 7954 UK National Body, Dr K Grant 7955 7956 Takehiro Moriya Takehiro Moriya, Akio Jin 7957 Ingo Wolf, Bernhard Feiten, Jason Flaks 7958 7960 Spencer Cheng, Peter Haighton on behalf of the CDN NB Herve Murret-Labarthe, on behalf of the French National Body Nicolaas Tack, Gauthier Lafruit 7961 Mauri Vaananen, Heiko Purnhagen 7962 ZY Huang, SM Shen, Ming Ji (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure, Takafumi Ueno (Matsushita Electric Industrial Co., Ltd) Ming Ji, SM Shen, ZY Huang(Pana sonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure, Takafumi Ueno (Matsushita Electric Industrial Co., Ltd) No. 7936 7937 7959 7963 RDD AhG Report MPEG-21 Rights Data Dictionary (RDD) Working Draft 1.1 MDS Video Editing Segment Description Tools: Addressing XML Schema Compliance The test result of the BiM S/W Verification of MPEG7 Visual Descriptors Report of AHG on editing ISO/IEC PDTR 15938-8 Report of AHG on editing MPEG-7 Visual XM Editor's note on Study text of ISO/IEC PDTR 15938-8 MPEG-7 Visual XM 12.1 Results of the Face Recognition Descriptor Using a Confidence Factor Proposal of the Face Recognition Descriptor based on Fourier spectral Principal Component Analysis UK National Body Position Paper on Document Distribution Report of AHG on issues in lossless audio coding Lossless scalable audio coding based on MPEG-4 standard Verification of CE AudioQualityDS for MPEG-7 Version 2 CDN NB comment on 14496-1:2001/AMD 3 (IPMP) Study of ISO/IEC 13818-1/2000/FPDAM 1 (carriage of metadata over MPEG-2) Complexity assessment of MPEG-4 mesh subdivision tools Report of the AhG on MPEG-4 Audio Corrigendum and Reference Software Updating MPEG-21 IPMP based on MPEG-21 System Architecture Rights Holder in MPEG-21 IPMP and its Mapping to MPEG-2/4 IPMP 24 Author(s) Title Uniform XML Schema Namespace and Semantics of Schema Elements for MPEG-4 IPMP Extension 7968 7969 ZY Huang, Ming Ji, SM Shen, (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure, Takafumi Ueno (Matsushita Electric Industrial Co., Ltd) National Body of Singapore National Body of Singapore Takeshi Norimatsu, Naoya Tanaka, Mineo Tsushima (Matsushita), Masahiro Iwadare, Masahiro Serizawa, Toshiyuki Nomura, Yuichiro Takamizawa (NEC), Sua Hong Neo, Kok Seng Chong (Panasonic Singapore Lab.) NATO SC 29 Secretariat 7970 7971 7972 SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat 7973 SC 29 Secretariat 7974 SC 29 Secretariat 7975 Toshiyuki Nomura, Yuichiro Takamizawa 7976 7977 JNB Eric Barrau, Arnaud Bourge, Vincent Bottreau 7978 7979 7980 7981 Jens Spille Chris Barlas Chris Barlas Chris Barlas 7982 SC 29 Secretariat 7983 SC 29 Secretariat 7984 7985 7986 Patrick Gioia Patrick Gioia Bernd Edler, Heiko Purnhagen, Nikolaus Meine Steve Wood, Michelle Kim, et al No. 7964 7965 7966 7967 7987 7988 7989 J. R. Smith, K. Hasida, M. Rynderman, T.Walker Wenjun Zeng, Gene Wen, Mike Severa 7990 7991 David Singer Yuwen He, Shiqiang Yang, Yuzhuo Zhong 7992 Young-Kwon Lim 7993 Sang-Kyun Kim, Yanglim Choi, Dusik Park, Kiwon Yoo, Youngsik Huh Sang-Kyun Kim, Yang Lim Choi, Du Sik Park, Chang Yeong Kim Iver Grini (Octaga) for the SoNG project Zvi Lifshitz 7994 7995 7996 Comment on JVT work Comment on MPEG-4 audio extension 1 Proposal of an additional low-complexity and lowdelay technology for BWE tool Liaison Statement from NATO to WG 11 Summary of Voting on ISO/IEC 14496-2:2001/PDAM 3 Summary of Voting on ISO/IEC CD 15938-7 Summary of Voting on ISO/IEC CD 21000-3 Summary of Voting on 14496-1:2001/PDAM 5 [common text with ISO/IEC 15444-3/PDAM 1] Summary of Voting on ISO/IEC 14496-1:2001/PDAM 6 Summary of Voting on ISO/IEC 144964:200X/DCOR 1 Evaluation results of scalable lossless coding based on AAC Comments on MPEG-4/Audio Bandwidth Extension Architecture and features of a fully scalable motioncompensated 3D subband codec AHG Report on MPEG-2 Audio Reference Software AHG on REL/RDD Requirements Report AHG on REL/RDD Requirements Report OeBF Liaison Statement on Rights Grammar Requirements Late Comments on ISO/IEC 14496-1:2001/PDAM 3 (SC 29 N 4640) Late Comments on ISO/IEC CD 21000-4 (SC 29 N 4641) Wavelet Surfaces bitstream proposal Wavelet Surfaces bitstream proposal Comments on MPEG-4 HILN Text, Reference Software, and Conformance XMT: Study of text of ISO/IEC 144961:2001/FPDAM2 MPEG-7 Multimedia Description Schemes Extensions Working Draft Ver. 1.5 Editorial Changes and Extension of Annex C on Selective Decryption Configuration Message Towards an MPEG-21 File Format Block-based FGS Coding with Optimized Truncation for MPEG-4 Streaming Video Report of AHG on MPEG-4 content on MPEG-2 System and IP Network Report of VCE-6 on MPEG-7 Color Temperature Descriptor for Display Preference Consideration of illuminant independence in MPEG-7 Color Descriptor Implementation plan for MU reference software ILNB Position on ISO/IEC 14496-1:2001/PDAM3 and ISO/IEC CD 21000-4 25 Author(s) Title 7999 8000 8001 Daijin Kim, Min-Sub Kim, Sung Yang Bang, Sang Youn Lee, Young Sik Choi Sang-Kyun Kim, Yanglim Choi, Dusik Park, Chang Yeong Kim Zvi Lifshitz Zvi Lifshitz Zvi Lifshitz 8002 Test 8003 8004 Weiping Li Andrew Perkis 8005 8006 Itaru Kaneko Neil Day on behalf of the AHG Joint-Chairs 8007 Yuval Fisher (Envivio), Alexandre Cotarmanac’h (France Telecom R&D), Cyril Concolato (ENST) Dominique Curet Stephanie Relier, Catherine Roux, Michel Veillard, Dominique Curet Stephanie Relier, Catherine Roux, Michel Veillard, Dominique Curet AFNOR Sangyoun Lee, Sun Jeong Kim, Jeong-Ho Choi, Wooyoung Lim, Sang-Taek Kim (Korea Telecom), Hae-Kwang Kim(Sejong University, Korea) Xiao Lin, Takehiro Moriya Face Recognition Descriptor Using the Embedded HMM with the 2nd-order Block-specific Eigenvectors Consideration of illuminant independence in MPEG-7 Color Descriptor IM1 AHG Report IM1 Core code + authoring tools version 5.7 Proposed Corrigendum to ISO/IEC 14496-4:2001 (SFTime Semantics) Report on MPEG-4 Visual Fine Granularity Scalability Tools Verification Test Fine Granularity Scalability for MPEG-4 Part 10 Refinement of DIA requirements by considering incorporation of UAProf as one of the Terminal Capabilities Descriptions sets Proposed new text of IPMP FAQ Report of the MPEG-7 Applications and Promotions to Industry AHG Report of AHG on Advanced Text and 2D Graphics No. 7997 7998 8008 8009 8010 8011 8012 8013 8014 8015 8016 8017 8018 8019 8020 8021 8022 8023 8024 8025 8026 8027 8028 8029 Kyuheon Kim / kkim@etri.re.kr, Won-Sik Cheong / wscheong@etri.re.kr ITTF via SC 29 Secretariat ITTF via SC 29 Secretariat Eric Petajan Jens-Rainer Ohm, Touradj Ebrahimi Whoi-Yul Kim, Min-Seok Choi, Young-Min Kong SC 29 Secretariat Lifang Wu, Lansun Shen, Xianglin Huang Japan National Body Gwang Hoon Park / ghpark@khu.ac.kr, WonSik Cheong / wscheong@etri.re.kr, Kyuheon Kim, Yoon Jin Lee,Young Kwon Lim, Jinwoong Kim Doh-Hyung Kim, Jung-Hoe Kim, Sang-Wook Kim Lifang Wu, Lansun Shen, Xianglin Huang laurent Herrmann (Philips) Jean-Claude Dufourd for the AHG Kristof Denolf, Carolina Blanch Cyril Concolato (ENST), Jean-Claude Dufourd (ENST) FNB comments SL extension Discontinuity handling Study of 14496-1:2001/PDAM4 Comments on VCE-1 Core Experiment for shapesequence descriptor Report on the audio lossless compression markrt investigation Study on Advanced FGS in MPEG-4 Video Table of Replies on ISO/IEC FDIS 15938-3 Table of Replies on ISO/IEC 14496-4:2000/FDAM 1 Corrections to FBA section of XMT Report of Ad hoc Group on Exploration of Interframe Wavelet Technology in Video Report of Core Experiment result on Shape Sequence Descriptor (VCE-1) Late Comments on ISO/IEC 14496-1:2001/PDAM 3 (SC 29 N 4644) comments on face description JNB Comment on JVT activity Water Ring Scan Method for MPEG-4 and H.26L based FGS Methodologies Evaluation Results of Scalable Lossless Audio Coding Based on MPEG-4 BSAC comments on face description Profiles & Levels indication values in IOD BIFS AHG report Initial Memory Complexity Analysis of the JVT Codec Comparison of the graphics tools of BIFS and SVG 26 Author(s) Title No. 8030 Marco Mattavelli, Robert Turney 8031 8032 Joerg Bitzer, Stefan Kudras Ian Burnett 8033 8034 8035 Joerg Bitzer, Stefan Kudras Joerg Bitzer, Stefan Kudras Jens-Rainer Ohm, Weiping Li, K. Kim 8036 8037 Joerg Bitzer Mahnjin Han, In Kyu Park, Leonid LevkovichMaslyuk, Alexander Zhirkov Eric Rehm Eric Rehm Christoph Fehn, Marc Op de Beeck, Etienne Fert, Peter Kauff Shihao Wang, Chung-Neng Wang, Tihao Chiang and Huifang Sun John R. Smith (on behalf of MPEG-7 MDS Editors) RWTH Aachen, EPFL Report of the AHG on MPEG-4 Part 9 "Reference Hardware Description" Editing Notes for Audio Quality Descriptors Report on AHG on developing MPEG-21 Software and Systems Model (YM) Proposal for a HistoryType Proposal for a Multichannel Attribute Group Report of Ad hoc Group on Fine Granularity Scalability in MPEG-4 Video Report of the ad-hoc group on MPEG-7 Audio Result of Core Experiment on Depth Image-based Rendering (AFX A8.3) MPEG-7 Profiles and Levels using XML Namespaces Supporting Summarization in the Variation Set DS Broadcast Requirements on 3D Video Coding 8038 8039 8040 8041 8042 8043 8044 8045 8046 8047 8048 8049 Vittorio Baroncini Riitta Vaananen (IRCAM), Giorgio Zoia (EPFL) Jan van der Meer, Philippe Gentric UK National Body, Dr K Grant Jan van der Meer Jens-Rainer Ohm, Konstantin Hanke 8050 Eric Delfosse 8051 Jean H.A. Gelissen (editor for the Dutch NB) 8052 8059 8060 8101 Xin Wang, Thomas DeMartini, Mai Nguyen, Edgar Valenzuela Toby Walker, Ali Tabatabai, Mohammed Zubair Visharam Frank Klefenz Toby Walker, Ali Tabatabai, Mohammed Zubair Visharam (Sony),David Singer (Apple Computer) Toby Walker, Ali Tabatabai, Mohammed Zubair Visharam (Sony),David Singer (Apple Computer) Toby Walker, Ali Tabatabai, Mohammed Zubair Visharam (Sony),David Singer (Apple Computer) Toby Walker, Ali Tabatabai, Mohammed Zubair Visharam (Sony),David Singer (Apple Computer) Husak and Edwards Michele Kim Jean H.A. Gelissen (editor for the Dutch NB) 8102 8103 Rui J. Lopes 8053 8054 8055 8056 8057 8058 AHG report on editorial convergence of MPEG-4 reference software Editor's input on MPEG-7 Part 5: MDS (editing notes for ISO) Report of Ad hoc Group on Exploration of Interframe Wavelet Technology in Video EDCF requirements Corrections to 3D Audio profile in MPEG-4 Systems MPEG and IETF Additional comments on ISO/IEC 13818-1/FPDAM 1 Proposal for a Timed Text Approach in MPEG Principles for evaluation of scalable wavelet coding technology Comments on the Digital Item Adaptation Requirements Document Concerns about the IPR situation within the JVT group MPEG-21 REL Core Experiments in XrML Support for MPEG-4 Part 10 in MP4: Some Initial Considerations MPEG-7 AHG Report on Audio Conformance Support for MPEG-4 Part 10 in MP4: Some General Considerations Support for MPEG-4 Part 10 Slice-Level Information in MP4: SomeInitial Considerations Support for MPEG-4 Part 10 Picture Information in MP4: SomeInitial Considerations Support for MPEG-4 Part 10 Stream Switching in MP4: Some InitialConsiderations Digital Cinima AHD Report AHG Report on XMT Concerns about the IPR situation within the JVT group MPEG-7 TeM decoder developed at Lancaster University (version LUv2-0) 27 No. 8104 8105 8106 8107 8108 8109 8110 Author(s) Title Wladyslaw Skarbek, Krystian Ignasiak Michelle Kim, Ching-yung Lin, Peter Schirling, John Smith, Edward So, Belle Tseng Gauthier Lafruit, Alexandru Salomie, Eric Delfosse, Rudi Deklerck, Peter Schelkens, Jan Bormans, Jan Cornelis Takashi Matsuyama, Ryozo Yamashita Stephan Herrmann P. van Beek, M. I. Sezan Face recognition descriptor with new properties Rights Use Cases 8129 Chun-Jen Tsai, Yuval Fisher (Envivio), Philippe Gentric (Philips) Joerg Heuer, Andreas Hutter Jean-Claude Dufourd for the AHG Ralph Sperschneider, on behalf of the AhG on MPEG AAC Ralph Sperschneider, on behalf of the AhG on MPEG AAC Ralph Sperschneider, on behalf of the AhG on MPEG AAC Ralph Sperschneider, on behalf of the AhG on MPEG AAC Ralph Sperschneider, on behalf of the AhG on MPEG AAC Ralph Sperschneider, on behalf of the AhG on MPEG-4 Audio Conformance Ralph Sperschneider, on behalf of the AhG on MPEG-4 Audio Conformance Ralph Sperschneider, on behalf of the AhG on MPEG-4 Audio Conformance Ralph Sperschneider, on behalf of the AhG on MPEG-4 Audio DCor Text and Reference Software Michelle Kim (IBM), William Luken (IBM), Steve Wood (IBM) Alexander (Sandy) MacInnis, Sherman (Xuemin) Chen, José Roberto Alvarez Ioan Alexandru Salomie, Rudi Deklerck, Gauthier Lafruit, Adrian Munteanu, Peter Schelkens, Jan Cornelis Sherman (Xuemin) Chen, José Roberto Alvarez, Alexander (Sandy) MacInnis Mihaela van der Schaar, Philips Research, Raj Kumar Rajendran, Shih-Fu Chang, Columbia University Rama Kalluri, Mihaela van der Schaar 8130 Peisong Chen and John W. Woods 8131 8132 Robert A. Cohen, Peisong Chen, John W. Woods S. R. Quackenbush 8140 Mihaela van der Schaar 8141 Itaru Kaneko 8111 8112 8115 8116 8117 8118 8119 8120 8121 8122 8123 8124 8125 8126 8127 8128 Proposal of Unified Backchannel Syntax for viewdependent 3D transmission Requirements for Standardisation of 3D Video AHG Report XM Development A User Description Profile for MPEG-7 and TVAnytime Editorial update of ISO/IEC 144962:2001/AMD3:PDAM Report on Core Experiment VCE-5 BIFS-ISG AHG report AHG Report on MPEG AAC Study on Text of ISO/IEC 13818-4:1998/Amd 1:1998/Dcor 1 Study on Text of ISO/IEC 13818-4:1998/Amd 3:2000/Dcor 1 Status and Workplan for AAC Conformance AHG Report on MPEG-4 Audio Conformance Study on Text of ISO/IEC 14496-4:2000/Dcor 1 Study on Text of ISO/IEC 14496-4:2000/Amd 1:2001/Dcor 1 Status and Workplan for MPEG-4 Audio Conformance Comments on Text of ISO/IEC 14496-3:2001/DCor 1:2002 Profile complexity analysis NAL for AVC Video with MPEG-2 Systems MeshGrid stream description TV Profile for AVC Video FGS+: A framework for improved Joint SpatioTemporal Video Quality of Fine Grained Scalable Coding Proposal for FGS coding in H.26L using Arithmetic Coding Comparison of MC-EZBC and H.26L TML 8 on Digital Cinema Test Sequences Interframe Subband/wavelet Coding Results for Digital Cinema using MCTF and JPEG 2000 Report of the AHG on AHG on MPEG-4 Audio Extension 1 Core Experiments Using S-Frames for fast switching between FGS streams and switching between MC-FGS structures to limit prediction-drift Proposed new text of IPMP FAQ 28 Author(s) Title No. 8142 Yuval Fisher 8143 Yuval Fisher 8144 8145 8146 Yuval Fisher Yuval Fisher Yuval Fisher 8147 8159 8160 8161 Yuval Fisher (Envivio), Laurent Herrmann (Philips), Michelle Kim (IBM), Jean-Claude Dufourd (ENST), Guido Franceschini (CSELT) Yuval Fisher (Envivio), Alexandre Cotarmanac’h (France Telecom R&D), Cyril Concolato (ENST Gary Sullivan/garysull@microsoft.com, Ajay Luthra/aluthra@gi.com, Thomas Wiegand/wiegand@hhi.d Gary Sullivan/garysull@microsoft.com, Ajay Luthra/aluthra@gi.com, Thomas Wiegand/wiegand@hhi.d Marius Preda, Francoise Preteu Mikael Bourges-Sevenier (Mindego), Michael, Steliaros (Superscape) Yoichi Yagasaki Oliver Morgan, Tom McMahon, all memebers of SMPTE ST13-03 MPEG Liaison committee Ryozo YAMASHITA Japan national Body Whoi-Yul Kim, Min-Seok Choi, Young-Min Kong Kyuheon Kim Eric Rehm UKNB (c/o Adam Lindsay) Informative Annex Describing MPEG-4 Script and ECMA Script Differences Informative Annex Describing MPEG-4 Script and ECMA Script Differences Events Executiont Media Node URLs Set TRUE DrawOrderQuant Field to FALSE in QuantizationParameter Report of AHG on Systems Conformance 8162 UKNB (c/o Adam Lindsay) 8163 8164 David Parrott Xiaoyan Sun, Feng Wu, Shipeng Li 8165 8166 Adam Lindsay, UKNB Greg Collyer, Adam Lindsay, UKNB 8167 John R. Smith (on behalf of MPEG-7 MDS Editors) Andrew Perkis 8148 8149 8150 8151 8152 8153 8154 8156 8157 8158 8168 8169 8170 8171 8172 8173 8174 8201 8204 Eric Rehm Claude Seyrat Cedric Thienot Claude Seyrat Gregoire Pau Alexandre Cotarmanac'h Thomas DeMartini, thomas.demartini@contentguard.com Thomas DeMartini, thomas.demartini@contentguard.com Gary Sullivan xiaoyan sun feng wu shipeng li Report of AHG on Advanced Text and 2D Graphics Report of 1st meeting of the Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG Report of 2nd meeting of the Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG BBA within an AFX profile AFX AHG report on PDAM/VM/CE and reference software Ad hoc Group Report on the Studio Profile Liaison Input from SMPTE Report of AHG on 3D-Video JNB Comment on JVT activity Report of Core Experiment result on Shape Sequence Descriptor (VCE-1) KNB comment on JVT work MPEG-7 Profiles and Levels using XML Namespaces Provisional UKNB comments on PDAM 14496-1 Amd5 (ISOFIle) Provisional UKNB comments on PDAM 14496-1 Amd6 (MP4v2) Reuters Use Cases for RDD/REL The description and proposed syntax of JVT-based FGS UKNB Comments on PDAM 6 for ISO/IEC 14496-1 UKNB Comments on PDAM 5 for 14496-1, PDAM 1 for 15444-3 Editor's input on MPEG-7 Part 5: MDS (editing notes for ISO) Refinement of DIA requirements by considering incorporation of UAProf as one of the Terminal Capabilities Descriptions sets MPEG-7 Profiles and Levels using XML Namespaces Proposal of requirements for MPEG-7 V2 Plugging a new codec in the BiM encoding framework An SL extension Proposal for Modification of MPEG-21 REL WD Anonymous Fee Payments and Architectural Recursion New Problem Reports Relating to MPEG-4 Visual The description and proposed syntax of JVT-based FGS 29 Author(s) Title No. 8205 Jens-Rainer Ohm, Touradj Ebrahimi 8206 Jens-Rainer Ohm, Weiping Li, K. Kim 8207 Jens-Rainer Ohm, Konstantin Hanke 8208 8209 8210 Eric Rehm Eric Rehm Vladimir Levantovsky 8211 8212 8213 8214 Itsik Mantin Miroslaw Bober Ji Ming, Jan van der Meer, SM Shen Xiaoyan Sun, Feng Wu, Shipeng Li, Wen Gao 8215 8216 8217 8218 8219 8221 Shih-Hao Wang, Chung-Neng Wang, Tihao Chiang, and Huifang Sun Leszek Cieplinski The National Body of Switzerland Jan Bormans The National Body of Switzerland John Magill, Jan Bormans 8222 The National Body of Switzerland Report of Ad hoc Group on Exploration of Interframe Wavelet Technology in Video Report of Ad hoc Group on Fine Granularity Scalability in MPEG-4 Video Principles for evaluation of scalable wavelet coding technology MPEG-7 Profiles and Levels using XML Namespaces Supporting Summarization in the Variation Set DS Application Analysis and Requirements for Advanced Text Support Proposal of Media Rating Encoding Report of the AHG on Visual Core Experiments Working Draft 1.1 of ISO/IEC 13818-1:xxxx / AMDx The framework for seamless switching of scalable video bitstreams AHG report on editorial convergence of MPEG-4 reference software shwang.ee90g@nctu.edu.tw Comment on 14496-1:2001.1 Report on the AHG on MPEG-21 Requirements Swiss NB Comment on 14496-1:2001.1 Updated description of the relationship between the MPEG-21 and Mediacom 2004 Projects Comment on 14496-1:2001.1 30 Annex 3 Agenda 1. Opening 2. Roll call of participants 3. Approval of agenda 4. Allocation of contributions 5. Communications from Convenor 6. Report of previous meeting 7. Processing of NB Position Papers 8. MPEG Phase 2 8.1 Requirements 8.2 Standard 8.3 Amendments 8.4 Corrigenda 8.5 Workplan 9. MPEG Phase 4 9.1 Requirements 9.2 Systems 9.2.1 Standard 9.2.2 Extension 1 9.2.3 Extension 2 9.2.4 Extension 3 9.2.5 Extension 4 9.2.6 Extension 5 9.2.7 Extension 6 9.2.8 Corrigenda 9.3 Visual 9.3.1 Standard 31 9.3.2 Extension 1 9.3.3 Extension 2 9.3.4 Corrigenda 9.4 Audio 9.4.1 Standard 9.4.2 Extension 1 9.4.3 Extension 2 9.4.4 Corrigenda 9.5 Conformance Testing 9.5.1 Standard 9.5.2 Amendment 1 9.5.3 Corrigenda 9.6 Reference software 9.6.1 Standard 9.6.2 Extension 1 9.6.3 Extension 2 9.6.4 Extension 3 9.6.5 Extension 4 9.6.6 Corrigenda 9.7 DMIF 9.7.1 Standard 9.7.2 Corrigenda 9.8 Optimised software 9.8.1 Technical Report 9.9 4 on IP Framework 9.9.1 Standard 9.10 Hardware Reference Description 9.10.1 Technical Report 9.11 Advanced Video Coding 10.12 Explorations 32 10.12.1 Fine Granularity Scalability 10.12.2 MP4 10.12.3 Advanced Text and 2D Graphics 9.13 Workplan 10. MPEG Phase 7 10.1 Requirements 10.2 Systems 10.2.1 Standard 10.2.2 Version 2 10.3 Description Definition Language 10.3.1 Standard 10.4 Visual 10.4.1 Standard 10.4.2 Version 2 10.5 Audio 10.5.1 Standard 10.5.2 Version 2 10.6 Description Schemes 10.6.1 Standard 10.6.2 Version 2 10.7 Reference software 10.7.1 Standard 10.7.2 Version 2 10.8 Conformance Testing 10.8.1 Standard 10.9 Extraction and use of visual descriptors 10.9.1 Technical Report 10.10 Workplan 33 11. MPEG phase 21 11.1 Requirements 11.2 Vision, Technologies and Strategy 11.3 Digital Item Declaration 11.4 Digital Item Identification and Description 11.5 Intellectual Property Management and Protection 11.6 Rights Expression Language 11.7 Rights Data Dictionary 11.8 Digital ItemAdaptation 11.9 Reference software 11.10 Other MPEG-21 parts 11.11 Workplan 12. Overall WG11 workplan 13. Explorations 13.1 Lossless audio coding 13.2 3D Video coding 13.3 Digital Cinema 13.4 Interframe Wavelet in Video Coding 14. Liaison matters 15. Administrative matters 15.1 Schedule of future MPEG meetings 15.2 Promotional activities 16. Organisation of this meeting 16.1 Tasks for subgroups 16.2 Joint meetings 34 17. Planning of future activities 18. Resolutions of this meeting 19. A.O.B 20. Closing 35 Annex 4 Requirements report Source: Fernando Pereira (Instituto Superior Técnico) and Keith Hill (Rightscom) for MPEG-21 For the Requirements group, this meeting was marked by the absence of Rob Koenen, following his resignation after about six years as Requirements chairman. Fernando Pereira was appointed as Requirements chairman at the end of this meeting. The activities under the Requirements group’s responsibility were divided between Fernando Pereira (MPEG-4, MPEG-7 and Exploration issues) and Keith Hill (MPEG-21). The Requirements group was in charge of compiling the document including all communications from MPEG to JVT (N4673). This document included communications from the Requirements, Video, Systems and ISG MPEG groups. MPEG-4 MPEG-4 Systems Profiling M8045 Riitta Vaananen, Giorgio Zoia, Corrections to 3D Audio profile in MPEG-4 Systems N4669, MPEG-4 Profiles under Consideration The contribution above was addressed but not discussed in detail since the authors were not present at the meeting. At was highlighted that profiles cannot be ‘corrected’; only technical errors in tools may be corrected. New needs in terms of profiles have to be solved by defining new profiles. Regarding the long standing issues on Scene Graph profiles it was decided: Add some Flextime nodes to Advanced2D profile AdvancedMain2D profile removed from the MPEG-4 Profiles under Consideration document since its application domain may be addressed with the Main 2D profile Quantization node added to Main2D profile and differently constrained in terms of Levels Advanced Text and 2D Graphics M8007 Yuval Fisher, Alexandre Cotarmanac’h, Cyril Concolato, Report of AHG on Advanced Text and 2D Graphics M8210 Vladimir Levantovsky, Application Analysis and Requirements for Advanced Text Support N4705, Preliminary Call for Proposal on Advanced Text and 2D Graphics Acknowledging the limitations of MPEG-4 technology in terms of text representation, and following the work of the AHG on Advanced Text and 2D Graphics, the requirements on Advanced Text & 2D Graphics (ATG) were reviewed in a joint meeting with the Systems group. It was decided to issue a Preliminary Call for Proposals at this meeting and a Final Call for Proposals at the next meeting, targeting the evaluation of the answers in Klagenfurt, in July 2002. JVT N4714, Proposed guidelines for the carriage of AVC content within MPEG Framework Following the recognition, that the definition of requirements for the Carriage of AVC Content has become important, the following requirements were defined in a joint meeting with the Systems and Video groups: MPEG-4 Systems MP4 File Format Additional on File Format Carriage over MPEG-2 Systems 36 Interchange Carriage over IP Payload Format Additional on Payload Format These requirements were included in the document with the Requirements for the AVC Codec (N4672). Moreover some guidelines for the development of solutions for the carriage of AVC content were discussed which were included in a document to be issued by the Systems group. MPEG-4 Visual Advanced FGS M8003 Weiping Li, Fine Granularity Scalability for MPEG-4 Part 10 As for last meetings, the possibility to initiate an activity targeting the improvement of the FGS tool was discussed. Following a proposal to initiate this activity in the JVT, the group decided that FGS on top of AVC may be considered for JVT phase 2 (since scalability is a functionality to be addressed in JVT phase 2) but it still too early to start technical work for phase 2. Moreover the group decided that if the conditions set to start technical work on advanced FGS were fulfilled, this work should start targeting the possible standardization of an ‘advanced FGS' tool on top of MPEG-4 Part 2 video. The conditions were: Meaningful verification test results for the FGS profile Technical evidence of significant possible coding efficiency improvements Availability of reference software for the FGS tool Conformance testing for the FGS tool defined Since the first condition was not fulfilled by the end of the meeting, the Requirements group did not issue any recommendation regarding the start of advanced FGS technical work. Finally, the close relation with the activities regarding inter wavelet coding in terms of scalability was noted; as a consequence, the definition of similar testing and development conditions was recommended in order to allow more meaningful comparisons to be made. JVT M8150 Gary Sullivan, Ajay Luthra, and Thomas Wiegand, Report of the Second Meeting of the Joint Video Team (JVT) of ISO/IEC MPEG and ITU-T VCEG M8159 Korean NB position, JVT 2nd phase functionalities and schedule M8127 Sherman (Xuemin) Chen, José Roberto Alvarez, Alexander (Sandy) MacInnis, TV Profile for AVC Video Ñ4671, Procedure to Develop Profiles and Levels N4672, Requirements for AVC Codec N4673, Communication to JVT In a joint meeting with the Video group, the JVT report from its Geneva meeting in February was reviewed. Moreover the JVT document on Profiles and Levels was reviewed. Regarding the development of profiles and levels, the Requirements group decided to recommend JVT to use the following approach: 1. Profile proposals are collected, through the following list of items for each profile: Applications areas (notably new ones, that are enabled by the proposed profile); List of functionalities, compared to the closest existing profile(s); List of tools in the profile; Supporting companies; notice that these companies are also committing to doing the conformance testing. 2. When a proposal is mature, a decision will be made about its inclusion in the standard. Such a choice will be made on the basis of the following criteria: Identified functionality is not supported by already existing profiles with an acceptable level of complexity; 37 Avoid to name the profiles using names of applications The added functionality provided by a new profile (e.g. increased efficiency) may involve the performance of verification tests, notably subjective testing. Declared interest exists in the actual deployment of the profile (or level) in services and products by several companies; Level definitions available, if levels will have to defined; Streams available to exercise all tools in the profile and the full complexity of the levels (if relevant); These streams have been checked by multiple, independent parties. Some additional recommendations regarding the JVT Profiles and Levels are included in the document Communication to JVT (N4673). Among them it is important to highlight the one recommending JVT that complexity analysis be used in order to define the minimum possible number of profiles. The fact that JVT is already mentioning 12 levels for each profile was considered negative. The proposal for a AVC TV profile was reviewed and discussed. The group agreed that profiles should not be named with names of applications to avoid creating the idea that a certain profile is only for a certain application or that other profiles cannot be used for that same application. Moreover it was clear that the exclusion of certain tools from a certain profile had to be motivated using a solid complexity analysis which was requested to the proponents of this profile. MPEG-4 Audio Profiles & Levels M7872 Fernando Pereira (editor), Levels for MPEG-4 Audio Profiles M7881 Liaison Statement from MPEG-4 Industry Forum to WG 11 on MPEG-4 Audio Profiles (SC 29 N 4595) N4670, Levels for MPEG-4 Audio Profiles Regarding the liaison statement from M4IF, MPEG reinforced that always welcomes proposals that address industry needs. However regarding the definition of conformance at the object type level to allow the use of a single object, the Requirements and Audio groups jointly meeting stressed that the same effect may be reached by defining a profile including a single object type and a level with a single object. The document ‘Levels for MPEG-4 Audio Profiles’ was reviewed and approved as public output document to provide a well structured and easy to find collection of audio levels for people outside MPEG. Lossless Audio Coding M7955 Takehiro Moriya, Report of AHG on issues in lossless audio coding M7956 Takehiro Moriya, Akio Jin, Lossless scalable audio coding based on MPEG-4 standard M7975 Toshiyuki Nomura, Yuichiro Takamizawa, Evaluation results of scalable lossless coding based on AAC Following the discussion at previous meetings, the Requirements and Audio groups jointly meeting, reviewed the contributions above and concluded that the conditions set for the starting of a technical activity on audio lossless coding, notably Relevant applications identified Industry need shown Commitment by MPEG members made Technical evidence provided were adequately fulfilled. In this context, an AhG was created with the task to elaborate the requirements for this technical activity and prepare a Call for Proposals to be issued maybe already at next meeting. 38 MPEG-7 MPEG-7 Profiling M7917 Wo Chang, MPEG-7 Interoperability Test Bed (M7ITB) M7918 Wo Chang, Yoshiaki Shibata, MPEG-7 Profiles and Levels Architecture M8038 (also 8160, 8208) Eric Rehm, MPEG-7 Profiles and Levels using XML Namespaces M8109 Peter van Beek, M. Ibrahim Sezan, A User Description Profile for MPEG-7 and TVAnytime N4678, MPEG-7 Profiles under Consideration The contributions above were presented in a very lively joint session with the MDS, Audio and Video groups. It was stressed that the discussion on MPEG-7 profiling has been around for a long time now and the appearance of the more applications and prototypes should allow a better understand of the need and meaning of profiling in MPEG-7. Major questions discussed were: Why do we need profiles ? What type of interoperability do we want ? Do the answers to these questions depend on the application domain ? MPEG experts will applications in mind were requested to answer to the following questions: Why do you need profiles ? What you happen if you could not have profiles ? What type of interoperability do you want to reach with similar MPEG-7 enabled applications? One outcome of this discussion is the fact that the meaning of interoperability and profiling seems to be different for different application domains, database retrieval and video surveillance. The presentation regarding the possible TV-Anytime profile was very relevant since it represents a real case which study may be very useful. Following the discussions, it was decided that a preliminary approach for MPEG-7 profiling should be adopted, notably: MPEG-7 profiles will be defined across MPEG-7 parts, at least for MDS, Audio and Visual. The keyword to define profiles is 'functionality' - profiles are a set of tools providing a set of functionalities for a certain class of applications. A new profile should be defined if it provides a significantly different set of functionalities. The keyword to define levels is 'complexity' - levels limit the complexity associated to a certain profile@level. A new level should be defined if it is associated to a significantly different implementation complexity. Profiles should be named independently of applications to avoid sending wrong messages. Levels should be labelled using numbers This approach is preliminary and will be further addressed in an AHG created to address interoperability and profiling issues. As a result of this session, the MPEG-7 Profiles under Consideration document (N4678) was updated, including now 4 profiles under study. MPEG-7 Systems Extensions M8170 Claude Seyrat & Cedric Thienot, Proposal of requirements for MPEG-7 V2 N4715, Call for Proposal on MPEG-7 Systems Extensions At a joint session with the Systems group, MPEG-7 Systems extensions requirements were reviewed targeting the release of a Call for Proposals. The major requirements regard improved coding efficiency for MPEG-7 descriptions and coding efficiency for MPEG-21 DI Declarations. This means that additional binary coding tools will be standardized in addition to the currently available BIM tool. The answers to the Call for Proposals are requested for July 2002. MPEG-7 Applications and Promotion M8006 Neil Day, Report of the MPEG-7 Applications and Promotions to Industry AHG M7933 Jose Martinez, Proposal for MPEG-7 Overview update N4674, MPEG-7 Overview (2 weeks editing) 39 N4675, Introduction to MPEG-7 N4676, MPEG-7 Applications N4677, Announcement of MPEG-7 Awareness Event The session on MPEG-7 Applications and Promotion addressed the following issues: Promotion o MPEG-7 in expositions, journals and conferences Preparation of the 3rd Awareness Event to be held in Fairfax the Friday and Saturday before the MPEG meeting. Liaison with the MPEG-7 Alliance Preparation of MPEG PR documents, notably the MPEG-7 Overview, MPEG-7 Applications, and Introduction to MPEG-7 documents. MPEG-21 MPEG-21 Requirements (General) M8218 Jan Bormans (editor), Report of the Ad-hoc Group on MPEG-21 Requirements N4681 Jan Bormans (editor), MPEG-21 Requirements v 1.0 Version 1 of the MPEG-21 Requirements was formally published at the Jeju meeting. Until this point the MPEG-21 Technical Report, which provides a high level overview of the multimedia framework, has been the place where MPEG-21 requirements have been defined. The MPEG-21 Requirements document will be the place where all of MPEG-21’s requirements are documented and will be regularly maintained from this point forward. The document contains requirements of varying depth that reflect the contrasting intensity of activity in the different parts of MPEG-21. For example, the requirements gathered for the Rights Data Dictionary, Rights Expression Language and Digital Item Adaptation are very well defined and they have been used as the basis for issuing Calls for Proposals and evaluating the subsequent submissions. The requirements of other parts of MPEG-21 remain less developed, such as MPEG21 IPMP, persistent association of identification and description with content, event reporting and content representation. It is expected that these will be further developed over the course of future MPEG meetings. M7941 Liaison Statement from ITU-T SG 16 to SC 29/WG 11 on Mediacom 2004 (SC 29 N 4636) M8221 John Magill, Jan Bormans, Updated Description of the Relationship between the MPEG-21 and Mediacom 2004 Projects ITU-T SG16 Mediacom 2004 is dealing with content security issues and they submitted a liaison statement expressing their interest in the development of the MPEG-21 standard. They have a specific interest in the RDD-REL work and would like to become more involved. The Requirements group therefore recommended that WG11 invite ITU-T SG16 experts to the next MPEG meeting to become involved in RDD-REL specification and to send them copies of the latest WD’s from the Jeju meeting. SG16 has also expressed an interest in IPMP but at this stage do not plan to develop any encryption architecture within the context of their work. Finally, SG16 reported its progress in the analysis of its multimedia framework. They have also identified 7 key elements in their analysis of a multimedia framework and have constructed a comparative table with the elements in the MPEG-21 TR to identify where they intersect, overlap or are separate. MPEG-21 IPMP Requirements The lack of a comprehensive set of MPEG-21 IPMP requirements remain a concern as, despite their limited definition, there is an MPEG-21 IPMP specification at a Committee Draft status. However, the specification was not further developed during the Jeju meeting as IPMP experts devoted their attention to the MPEG-4 IPMP PDAM. MPEG-21 IPMP requirements appear in the context of other specifications such as the Rights Data Dictionary, Rights Expression Language and Digital Item Adaptation. In common with MPEG-7 IPMP requirements (for which a specification does not exist) there is a need to be able to manage 40 and protect descriptions and apply rights expressions to descriptions. For example, in the context of Digital Item Adaptation, an MPEG-21 IPMP system would ‘protect’ the association of permissions governing the context in which content may be adapted. An additional need is to define the requirements for Digital Items as opposed to the management and protection of Resources (‘content’) represented by existing MPEG coding standards. A resolution was approved by the WG11 Plenary to request that an activity to define the requirements for the management and protection of MPEG-21 Digital Items be initiated. MPEG-21 RDD-REL Requirements M7980 Chris Barlas, Ad-hoc Group on REL-RDD Requirements Report M7981 Chris Barlas, OeBF Liaison Statement on Rights Grammar Requirements Based upon the recommendations submitted by the AHG on REL-RDD requirements, these requirements were modified to reflect the developing understanding of MDS experts who are currently developing the RDD & REL specifications. These were approved by the Requirements group and documented in the MPEG-21 Requirements v1.0 (N4681). The Open eBook Forum (OeBF) have also reviewed the MPEG-21 RDD-REL requirements and submitted some comments, recommendations and proposed a new requirement. These were taken into account and the new requirement was accepted. A liaison statement to OeBF was prepared and a resolution was agreed, thanking the OeBF for their contribution. MPEG-21 Identification and Description Requirements M7923 Niels Rump, Requirements on DII&D (resubmission from M7177) The scope of Part 3 of the MPEG-21 standard was further refined to address Digital Item Identification rather than its previously wider scope of Identification and Description. Consequently there are now a number of requirements within the scope of MPEG-21 that fall outside of Part 3 and may themselves be candidates for specification. One such example is the requirement to identify MPEG-21 ‘Users’, including value chain participants. In order to effectively control how Rights Expressions can be associated with Digital Items and Resources as they pass down the value chain it will be necessary to identify value chain participants. While there have been a number of initiatives to develop proprietary identification systems for Users within specific communities, no international effort has as yet been initiated to address the requirement for the identification of value chain participants. It is appropriate to consider whether, within the scope of its specifications to support an integrated multimedia framework, this is an activity in which MPEG should take a lead. MPEG-21 Use Case Scenarios M8163 David Parrott, Reuters Use Cases for RDD/REL It was agreed during the Jeju meeting to revise the MPEG-21 use case scenario document that was last reviewed at the Sydney meeting in July 2001. New use cases were contributed that illustrate the application of rights data dictionary and rights expression language tools and these need to be integrated. In addition, it is likely that further use cases will be submitted in response to the Call for Proposals for Digital Item Adaptation at the next meeting. The use cases are important as they form the basis for defining ‘Core Experiments’ to validate specifications. MPEG-21 Architecture M7911 Niels Rump, MPEG-21 Technical Architecture AhG Report M7910 Niels Rump, MPEG-21 Technical Architecture Working Draft M7962 SM Shen et al, Updating MPEG-21 IPMP based on MPEG-21 System Architecture M7963 SM Shen et al, Rights Holder in MPEG-21 IPMP and its Mapping to MPEG-2/4 IPMP M8032 Ian Burnett, Report on AHG on developing MPEG-21 Software and Systems Model (YM) M7990 David Singer, Towards an MPEG-21 File Format N4686 Ian Burnett et al, Draft Requirements for Digital Item Processing for Applications The start point for the discussion about MPEG-21 Technical Architecture began with the analysis produced at the Tokyo AHG meeting in February which contained a diagrammatic representation of 41 the architecture. The diagram (see figure 1 below) was discussed and further modified by the Requirements group during the Jeju meeting and discussed at a joint meeting between Systems, MDS and Requirements. Considerable difference of opinion between MPEG experts emerged about the nature of the MPEG-21 architecture. It was also not clear between experts what are the differences between the architecture of MPEG-21 and the architecture for other MPEG standards and how they relate to each other. There was also considerable difference of opinion about the usefulness of the diagram. Generally it was felt that it only represented the high-level architecture described in the Technical Report (i.e. the architectural elements) rather than the integration of the specifications under development (e.g. RDD, REL, IPMP, DIA, etc). It was decided that the diagram (see below) was probably not the most helpful start point for this analysis and would not result in a satisfactory set of requirements for the development of MPEG-21 Future Tools (TBD) DIA Parser & Tool(s) IPMP Parser RDD Parser REL Parser DII&D Parser DID Parser & Tool(s) I/O Interface Media Resource Tool(s) MPEG-21 Prosessing Engine Message Bus Other Tools (TBD) non-normative DIA Tool(s) IPMP Tool(s) RDD Tool(s) REL Tool(s) DII&D Tool(s) Plug-in Interface systems. A different start point for the analysis was therefore adopted. It was decided instead to examine the processes that result when a Digital Item Declaration is received by an MPEG-21 “processing engine” (this could be a terminal, software client, etc). A working document was produced (N4686 – Draft Requirements for Digital Item Processing for Applications) which provides a record of the discussions held in Jeju including a list of the processes that a systems application needs to perform upon receiving a Digital Item Declaration. The intention is to develop the discussion over the coming meeting(s) by considering several DID application scenarios. The working document will continue to be developed at the Fairfax meeting to express a full set of requirements for DI processing in a variety of application scenarios. It is expected that the resulting requirements will form the basis for developing the MPEG-21 sYstems Model (YM) and possibly an MPEG-21 File Format, and some interesting contributions were discussed that were helpful in developing the thinking of the Requirements group for the development of these tools. 42 Digital Item Adaptation M7936 Anthony Vetro, Report of the AHG on MPEG-21 Digital Item Adaptation M7937 Anthony Vetro, Draft Evaluation Criteria for MPEG-21 Digital Item Adaptation M8004 Andrew Perkis, Refinement of DIA requirements by considering incorporation of UAProf as one of the Terminal Capabilities Descriptions sets M8050 Eric Delfosse, Comments on the Digital Item Adaptation Requirements Document N4683 Anthony Vetro, Keith Hill, Final Call for Proposals for Digital Item Adaptation N4684 Requirements Group, MPEG-21 Requirements on Digital Item Adaptation N4685 Requirements Group, Evaluation Criteria and Procedures for Digital Item Adaptation N4687 - Request for addition of a Part 7 to ISO/IEC 21000 (Digital Item Adaptation) A final Call for Requirements for Digital Item Adaptation (N4683) was approved at the Jeju meeting, succeeding the preliminary Call which had been issued at the Pattaya meeting in December 2001. The Final Call included some minor changes to the logistical arrangements for evaluating the responses, and also included two accompanying documents: N4684 contains a set of requirements against which the responses will be evaluated; and N4685 defines the evaluation criteria that will be used. An AHG group has been formed that will meet on the 4th and 5th May prior to the next MPEG meeting in Fairfax to conduct the evaluation. The Resolutions from the Jeju meeting noted that the Requirements group recommend Anthony Vetro to lead the evaluation of the DIA Call for Proposals. SC29 was also formally requested to approve the creation of ISO/IEC 21000 Part 7, Digital Item Adaptation. Persistent Association of Identification and Description with Digital Items M7899 Hideki Sakamoto, Case Study of Persistent Association of Information with Digital Items: cIDf & #8217’s Trial on ID Resolution N4682 Keith Hill, Call for Requirements for the Persistent Association of Identification and Description with Digital Items A Call for Requirements was published (N4682), inviting the submission of requirements for the persistent association of identification and description with Digital Items – the fundamental unit of trade within the MPEG-21 Multimedia Framework. While MPEG has identified the need for such persistent association of identification and description, this Call will enable the requirements to become better understood in order to decide what MPEG might consider necessary to standardize. The timetable for the Call for Requirements requests that responses be received by 14th July 23:59 GMT so that they can be discussed and evaluated during an ‘ad-hoc’ group meeting prior to the MPEG meeting to be held in Klagenfurt. Exploration 3D Video Coding M8155 Ryozo Yamashita, Report of AHG on 3D-Video M8107 Takashi Matsuyama, Ryozo Yamashita, Requirements for Standardisation of 3D Video M7930 Sukhee Cho, Yunjong Choi, Kugjin Yun, Youngkwon Hahm, Chieteuk Ahn and Yonghan Kim, Requirement for multi-viewpoint stereoscopic video M8040 Christoph Fehn, Marc Op de Beeck, Etienne Fert, Peter Kauff, Broadcast Requirements on 3D Video Coding N4679, Preliminary Requirements for 3D Video support in MPEG The 3D Video Coding break out group met with the Requirements and Video groups twice during the week. In the first session, the contributions above listed were presented and discussed. From this discussion, it resulted that the objectives of 3D Video coding seem to be different for different experts and thus an effort to more precisely define the problem under study was needed. To reach this objective, the break out group was asked to draft a document including the following sections: Problem definition using a model or architecture Objectives highlighting what needs standardization 43 Relation with available standards (and on going activities), notably with MPEG standards (what is available and what is missing ? what are the limitations of the current standards ?) Applications and products available List of requirements (drafted using MPEG template) clustered in a meaningful way In the second session, the document resulted from the work of the break out group was presented. This document allowed to conclude that: There are different approaches to the 3D Video problem. This approaches seem to fit together but this conclusion has still to be checked notably at the light of requirements such as backward compatibility with MPEG-2 Video. There are many relevant tools already available in the MPEG-2, MPEG-4 and MPEG-7 standards. Further study is needed to identify which tools are missing in terms of available standards. There are many applications which require 3D Video technology and also many products already available in the market. The requirements must be clustered in terms of Audio, Visual and Systems since 3D Video applications require not only specific video coding technology but also audio and systems tools, e.g. for powerful interactivity. A joint AHG with the Video group was created to improve the draft document created during the meeting (N4679), notably in terms of the definition of the problem, relation with available standards and listing of requirements independently of any application domains. Digital Cinema N4680, Digital Cinema Requirements The Digital Cinema break out group met with the Requirements group three times during the week. These meetings addressed the following topics: Discussion on the way to proceed with the digital cinema activities within MPEG Update of the MPEG digital cinema requirements to incorporate the answers provided by various bodies as feedback to the letters sent at last MPEG meeting asking for requirements Preparation of a new Call for Proposals and the logistics for the corresponding tests. The conclusions regarding these topics were: Due to several factors, it was decided that MPEG will issue a new Call for Proposals addressing the Video Distribution requirements in the Digital Cinema Requirements document New tests have to be prepared adopting new testing methodologies, and better material. Moreover the logistics has to be carefully prepared to avoid the problems happened in the first round of tests. The group discussed all the logistics factors that have to be considered in order to guarantee successful tests. An updated version of the Digital cinema requirements document was produced (N4680) already incorporating the feedback from three bodies. This revised document was presented to the Video group. A joint AHG with the Test group was created to address all the issues related to digital cinema within MPEG, notably improvement and update of the requirements and preparation of the new tests. 44 Annex 5 Systems report Source: Title: Status: Editor: Systems Chair and Break-out group Chairs Systems Meeting Report Approved Olivier Avaro (France Telecom R&D) Contributors: Olivier Avaro (France Telecom R&D), Jean-Claude Dufourd (ENST), Jan Van der Meer (Philips), Craig A. Schultz (AccessTickect), Michelle Kim (IBM), Young-Kwon Lim (MP4Cast), Zvi Lifshitz (Optibase), Claude Seyrat (Expway) Overview The main outputs of the meeting from the Systems Sub-group perspective are: Title MPEG-2 Systems 13818-1 DoC on Proposal of Minor Enhancement to 13818-1 :2000/AMD1 Study DoC of ISO/IEC 138181:2000/FPDAM1 Study Text of ISO/IEC 138181:2000/FPDAM1 Request for Amendment 2 of ISO/IEC 138181:2000 Text of ISO/IEC 13818-1:2000/PDAM2 MPEG-4 Systems 14496-1:2001 Cor 2 Study Text of ISO/IEC 14496-1:2001/DCOR2 MPEG-4 Systems 14496-1:2001 Amd. 2 (XMT) DoC of ISO/IEC 14496-1:2001/FPDAM2 Text of ISO/IEC 14496-1:2001/FDAM2 MPEG-4 Systems 14496-1:2002 WD 1.0 of ISO/IEC 14496-1 3rd Edition MPEG-4 Systems 14496-1:2001 Amd. 3 (IPMP) DoC of ISO/IEC 14496-1:2001/PDAM3 Text of ISO/IEC 14496-1:2001/FPDAM3 IPMP Reference Software Architecture and Workplan MPEG-4 Systems 14496-1:2001 Amd. 4 (AFX and MuW) Study Text of ISO/IEC 14496-1:2001/PDAM4 45 No. TBP Available Editor N469 2 N469 3 N469 4 N470 3 N469 5 No 15/03/200 2 15/03/200 2 23/03/200 2 15/03/200 2 15/03/200 2 Olivier N469 6 Yes 29/03/200 2 Yuval N469 7 N469 8 No 15/03/200 2 15/04/200 2 Michelle N469 9 Yes 29/03/200 2 Yuval N470 0 N470 1 N470 2 No 15/03/200 2 29/03/200 2 15/03/200 2 Craig N462 7 Yes 22/03/200 2 Mikael No No No Yes No Yes No Jan Jan Jiming Jiming Michelle Craig Craig WD 1.0 of SL Extensions N470 4 N470 5 Yes N470 6 Request for Amendment 3 for ISO/IEC 14496- N470 4 7 Text of ISO/IEC 14496-4:2001/PDAM3 N470 8 MPEG-4 Systems 14496-5 (Reference Software) MPEG-4 Systems Software Status and N470 Workplan 9 DoC on ISO/IEC 14496-5:2001/FPDAM1 N471 0 Text of ISO/IEC 14496-5:2001/FDAM1 N471 1 MPEG-4 Systems 14496-8 (4/IP Framework) Text of ISO/IEC 14496-8/FDIS N471 2 RTP payload formats for carriage of MPEG-4 N471 content over IP Networks 3 Proposed guidelines for the carriage of AVC N471 content within MPEG Framework 4 MPEG-7 Systems 15938-1 (Systems) Call for Proposal on MPEG-7 Systems N471 Extensions 5 “How to” integrate specific decod ers in BiM N471 6 MPEG-21 IPMP 21000-4 Study Text of ISO/IEC 21000-4/CD N471 7 General FAQ Revision 19.0 N471 8 Yes Preliminary Call for Proposal on Advanced Text and 2D Graphics MPEG-4 Systems 14496-4 (Conformance) Text of ISO/IEC 14496-4:2001/COR1 15/03/200 2 15/03/200 2 Alexandre 15/03/200 2 15/03/200 2 15/03/200 2 Jean-Claude 15/03/200 2 15/03/200 2 29/03/200 2 Zvi 29/03/200 2 29/03/200 2 15/03/200 2 Young 15/03/200 2 15/03/200 2 Olivier No 15/03/200 2 Craig Yes 15/03/200 2 Olivier No No Yes No No No No Yes Yes No No Olivier Jean-Claude Jean-Claude Jean-Claude Jean-Claude Young Young Claude General issues General M7913 : The Systems meeting report has been approved. M7885 : Tutorial on IPMP. Overall view of the spec. M8211 : Proposal of Media Rating Encoding. This was already discussed when the OCI related to rate control were specified. It was decided that the specification of rating should be application dependent and that MPEG should just provide a place holder for that. No new reasons were brought to change this previous understanding. In addition, new “OCI” should be standardized in MPEG-7 rather than OCI. M8016 : Document not available. 46 List of standards under development Project Part Ed. MPEG-2 Systems MPEG-2 Systems MPEG-4 Systems MPEG-4 Systems MPEG-4 Systems MPEG-4 Systems MPEG-4 Systems MPEG-4 Systems MPEG-4 Systems MPEG-4 Conformance MPEG-4 Conformance MPEG-4 Conformance MPEG-4 Conformance MPEG-4 Software MPEG-4 Software MPEG-4 MPEG-4 over IP Systems 200 0 200 0 200 1 200 1 200 2 200 1 200 1 200 1 200 1 200 1 200 x 200 2 200 1 200 1 200 1 200 1 200 2 200 2 MPEG-7 MPEG21 IPMP Proje ct Amd. 1 Amd. 2 Cor.2 Description CfP WD CD FC D IPMP on MPEG-2 Systems 0203 Amd. 2 3rd Ed. Amd. 3 Amd. 4 Amd. 5 Amd. 6 Cor.1 XMT 0010 0207 0112 0107 MP4 MPEG specific text 0107 0112 0112 0112 Amd. 1 2nd Ed. Amd. 2 Amd. 1 Amd. 2 1st Ed. Flextime, Studio& SV Prof. 0103 0203 0205 0205 0205 0112 0112 XMT 0203 0103 0107 0103 0212 0107 0207 0107 0112 0107 0203 0205 Transport of Metadata 0203 IPMP MuW and AFX MP4 base text Flextime XMT Transport of MPEG4/IP Systems extensions Amd. 1 1st Ed. IPMP Framework 0203 0207 FDI S 0205 0212 0205 0203 0207 0207 0210 0210 0210 0203 0205 0207 0212 0203 0205 0203 0307 0210 Demonstrations The following demonstrations have been made : Envivio and IBM : Demonstration related to Amendment 2 (Media Control, XMT, …). Web site Volunteers needed to develop and maintain Systems Web site. FAQ The FAQ were updated and output at this meeting. 47 AOB None. MPEG-2 Systems (13818-1) 13818-1:2000/Amd. 1 Topics Elementary Stream Management 1. Transport of metadata over MPEG-2. Contributions Elementary Stream Management M7884, M7959, M8047 : See disposition of comment document. 13818-1:2000/Amd. 2 Topics IPMP 2. IPMP Tool Representation and Communication Systems mapping on MPEG-2 Systems Contributions IPMP M7887, M8213, M7963: All contribution processed. Completed editing of document sufficient for promotion from the WD level to CD level. MPEG-4 Systems (14496-1) 14496-1:2001/Cor2 Topics Various corrigenda Constributions Various corrigenda M8026 : Update of the profile and level indication table. Fix of the profile and level indication for visual scene. Accepted for inclusion in Cor2. M8146 : Set TRUE DrawOrderQuant Field to FALSE in QuantizationParameter. Accepted for inclusion in Cor2. M8144 : Events execution model under specified. Clarification of the model. Includes comments from Web3D. Accepted for inclusion in Cor2. M8001 : Proposed Corrigendum to SFTime Semantics. Summary of discussions on reflector and proposals. The decision is to keep the original text although it requires further clarification as described in this contribution. Claifications will be included in Cor 2. 14496-1:2001/Amd. 2 48 Topics MPEG-4 Textual Format 3. XMT-A 4. XMT- Scene Description 5. 6. 7. 8. Media Sensor MediaControl MediaBuffer MatteTexture Elementary Stream Management 9. OD Framework additions (OD execute, Segment Descriptors) 10. MP4 additions Profiles and Levels 11. Basic2D, Core2D, Main2D, Advanced2D (Scene Graph and Graphics) profile. Contributions MPEG-4 Textual Format M7900, M7987, M8017 : NB comments have been disposed of (See disposition of comments) and inputs were used to construct the FDAM2. Scene description M8143 : Informative Annex Describing MPEG-4 Script and ECMA Script Differences. Accepted for inclusion in the amendment. Profile and Levels Joint meeting with requirements M8017, M8045 : List of various problems on the current 3D Audio profile. Proposed corrections of the profile. What is correction and extension is not clear. The proponents should come with a new profile definition. M8124 : This document provides analysis of the complexity of Flextime nodes, quantization and media control nodes. It serves as the basis for the discussion on the merge of Advanced 2D and Advanced Main 2D as well as on the inclusion of Quantization in Main 2D, as recorded below. Decision on the evolution of Amd.2 profiles 1. Advanced2D: Add the Flextime nodes (Temporal Group and Temporal Transform) to Advanced 2D; 2. Main2D Add the Quantization node and Inline to Main 2D; Remove WorldInfo and Group (WorldInfo and Group are not in Core2D). Decision on the evolution of Amd.2 levels Speed adjustments in MediaControl and Temporal Transform 1. Main2D 49 Level 1: no speed adjustments. (speed parameter in MediaControl and in TemporalTransform shall be 1; scalability field in TemporalTransform shall be [1,1]) Level 2: speed adjustments supported but audio resampling is not required (i.e no restrictions on the field values conveyed in BIFS stream, but rendering constraints for audio in place). Level 3: remove restrictions from MediaControl and TemporalTransform (neither bitstream nor rendering constraints). Also remove the restrictions from Sound2D (allow location and spatialize); and remove the restriction from AudioSource for rewind and fast forward [of course this does not apply to broadcast] 2. Advanced2D: Level 1 and Level 2: the same as Level 2 in Main2D Level 3: the same as Level 3 in Main2D Inline Support 1. Main2D Level 1 : Ignored. Level 2 : Restricted to supporting Simple2D+Text. No more than 4 Inline nodes in the scene at any one time. Restricted to supporting content to that created with Simple or Basic Profile Scene Graph, and Simple2D Graphics ( Simple2D+Text). Level 3 : No restriction (of course Inline content cannot exceed the profile of the main scene). 2. Advanced2D: no restriction. Quantization in Main2D Level 1: ignored. Level 2 and Level 3: isLocal, useEfficientCoding not supported (as in Core2D Level1 and Level2). 14496-1 3rd Edition Topics Integrated version 12. Integration of 14496-1:2001 14496-1:2001/Amd1, 14496-1:2001/Amd2, 14496-1:2001/Cor1, 144961:2001/Cor2 Contributions None. 14496-1:2001/Amd. 3 Topics IPMP Extensions Contributions IPMP Extensions M7889, M7958, M7982, M8020, M7879, M7880, M7883, M7886, M7890, M7891, M7892, M7893, M7894, M7895, M7896, M7920, M7921, M7989, M7996, M8005 : All considered for the 50 production of the FPDAM3. Completed processing and resolution of MPEG-4 IPMP PDAM NB comments. Completed technical editing of and preparation for promotion to FPDAM. M7963 : As with the previous submission, useful for gaining understand but not yet clear as to its providing the best solution as well as its applicability. M7964: Uniform XML Schema Namespace and Semantics of Schema. Accepted for inclusion in the MPEG-21 IPMP study. M8141-M8005 : Proposed new text of IPMP FAQ. Completed up to date FAQ combining questions and answers for MPEG-2,4,7 and 21 as well as general IPMP. To be integrated in the Systems FAQ. Reference Software Development of IM1 IPMP architecture diagram along with requirements for the current IM1 software to support the inclusion of IPMP reference software. The following work plan was agreed upon for the development of the IPMP reference software : What Software architecture Tool manager Message Router AU Interface (Encoder / Decoder) Bit stream Generation List of functionality needed on Im1 Integration in Im1 Sample Application Development Who IPMP break-out + AHG Panasonic Craig Zvi Shen IPMP break-out + AHG All IPMP + Zvi Panos and Zvi When 15/03/2002 Available Available May 2002 July 2002 15/03/2002 July 2002 July 2002 14496-1:2001/Amd. 4 Topics Scene Description 13. Multi-user applications 14. Animation Framework Extension Elementary Stream Management 15. FlexMux Extensions Contributions Scene Description M7873: Presented succinctly. Discussed as part of the next presentation M7905: Presented succinctly. The results clearly show the Samsung technology to be consistently better or far better than Predictive MFField. As a result, there was no opposition to the acceptance of the Samsung Interpolator Compression technology into the PDAM4. M8011: The proposed changes have been included in a rewrite of the PDAM4 M8106: This was discussed in SNHC (Cf. SNHC report). Joint meeting with SNHC 51 Coding of nodes : The SNHC specification uses specific coding for node for improved efficiency. Implication on the current Systems architecture and possibly better solutions need to be investigated (ref. AHG) Animation : The current BIFS Anim may be extended to solve the pb. This will be investigated in the BIFS AHG (ref. AHG). Elementary Stream Management M8145 : Media Node URLs. How to specify semantic of URLs in OD so that one can e.g. select in a media dependent node a specific stream from an MP4 file. The URL semantic has to be dependent from the media node context (e.g. same URL used for the audio node and video node, while the selected streams are respectively a audio and video streams). To be discussed further and completed for an amendment of the MPEG-4 Systems specification. 14496-1:2001/Amd. 5 and Amd. 6 Topics Elementary Stream Management 16. Amd. 5 : MP4 (Base text) 17. Amd. 6 : MP4 (MPEG-4 specific part) Contributions Elementary Stream Management M8166, M8161, M8162, M8165, M7972, M7973 and Swedish NB comments : It was not practical to process the NB comments without the editor being present. Progression of these amendment is postponed to Fairfax. 14496-1:2001 Future Amendments Topics Scene Description 18. Advanced Text and 2D Graphics Elementary Stream Management 19. SL Extensions Contributions Scene Description Joint meeting with Requirements M8210, M8048, M8029 : Contribution on requirements for advanced text and 2D graphics. Discussed and result documented in a preliminary Call for Proposal. The Call for Proposal will be issued in Fairfax. See CfP output document for further information on the timeline. Elementary Stream Management M8172. Answer to the Call for Contribution issued at the Pattaya meeting on incremental construction of the scene. In the case of big media access unit, the receiver may have problem to have long time to get the complete set of information which are carouselled. If the scence can be 52 separated into several parts and some parts can be shared by the different users the problem could be solved. To support this solution, following extension of SL are proposed Pointer to the first SLP in the SLConfigDescriptor; Pointer to the next SLP in the SLPH; The last SLPH shall point to the non-existing SLP. This contribution also claiming that there are some problems in scalable streaming and IPMP key synchronization and they can be solved by this contribution. But the BIFS carouselling problem could be more completely solved by the transport laye, such as MPEG-2 DSM-CC data carouselling or application standards such as DVB or ATSC, even though such scenario needs more careful analysis. Incremental contstruction of BIFS may not be the only existing problem of BIFS carouselling we have. And the solution seems not to be complete. But there are no other clear solutions to solve the problems stated in the Call for Contribution at the moment. Therefore, this will go to WD for the further consideration. M8009, M8010: Discontinuity handling in the case of bistream switching. This contains the requirements, analysis of the current OD framework, and the proposed solution for the case of switching the bitstreams during the presentation. The proposed solution is having a discontinuity descriptor with a flag to signal the existence of the discontinuity. This problem seems to be solved by applying appropriate constraints to bistream generation process to allow seamless bistream switching. In addition MPEG-4 SL has no requirements to support bitstream switching. This activity will be therefore discontinued. MPEG-4 Conformance (14496-4) 14496-4:2001/Cor1 Topics 20. Minor clarification on the textual dump format. Contributions M7974 : No comments. Promote to Cor1. 14496-4 2nd Edition Topics 21. Integration of 14496-4, 14496-4:2000 Amd.1, 14496-4:2001 Amd.1, 14496-4:2000 Cor.1, 14496-4:2000 Cor.2 14496-4:2001 Cor.1. Contributions None. 14496-4:2001/Amd2 Topics 22. Conformance for 14496-1:2001/Amd2 (XMT) Contributions None. MPEG-4 Reference Software (14496-5) 53 14496-5:2001/Amd1 Topics 23. Reference Software for 14496-1:2001/Amd1 (Flextime) Contribution M8000 : Current version of the MPEG-4 reference software and authoring tools. M7877, M7874 : See disposition of comments. 14496-5:2001/Amd2 Topics 24. Reference Software for 14496-1:2001/Amd2 (XMT and DMIF) Contribution None. 14496-5:2001 future amendments Topics 25. Reference Software for 14496-1:2001/Amd3 (IPMP) 26. Reference Software for 14496-1:2001/Amd4 (AFX and MuW) 27. Reference Software for 14496-1:2001/Amd5 (MP4 Base) 28. Reference Software for 14496-1:2001/Amd6 (MP4 MPEG Specific) Status WD. Contribution M7995 : Implementation plan for MU reference software. Integrated in the Im1 workplan. Transport of MPEG-4 over IP Network (14496-8) 14496-8 Topics 29. IETF RFC for transport of MPEG-4 over IP 30. Framework for the carriage of MPEG-4 content over IP network. Contributions M8046 : Introduction of changes requested by IETF. IETF feels generic payload format is quite complex and has doubt about the quality of the drafts. IETF feels it may have unidentified problems. * It is written in MPEG-4 system centric point of view. It could be possible to rewrite it in the elementary stream point of view without mentioning MPEG-4 SL. * One of the reasons IETF people doubts is they didn’t see much comments on their reflector. IETF needs implementation for the verification * FT has implemented the generic draft but not demonstrated it at the IETF meeting yet. 54 It could be better to finalize simple draft first independently on the generic draft. Its implementations are already demonstrated by ISMA. Simple draft can be de-correlated from the generic payload format without any technical changes. It may help to move forward quickly. * Simple draft can carry various MPEG-4 streams including OD stream and BIFS stream. * SL Packet Header can be carried by simple draft but they are invisible to RTP. Application understanding SL could get the reconstructed SL Packet Header. * The generic payload format could then be considered as an extension of simple draft. How to proceed Have a simple draft de-correlated from generic payload format. Send a liaison to IETF * To move forward with simple draft at the moment. * To hold the generic draft to be clean-up and accommodate the requirement from JVT. Work further on the generic draft including the requirements from JVT. Joint meeting with Visual and Requirements Requirements for JVT Carriage (Ref. Requirement document). Carriage of JVT Content M8125 : MPEG-2 NAL This contribution is proposing the complete NAL syntax for JVT over MPEG-2. This would be nice as a starting point. But there is a strong concern about having multiple NALs specific to each protocols. It is more desirable to design the general NAL rather than having protocol specific NALs. This concern shall be addressed as a part of resolution. M8053, M8055, M8056 : MP4 for JVT to address the entities smaller than AU. According to the definition of AU of MPEG-4 Visual, JVT needs AU fragment level addressing. This contribution proposes “sub-sample” to contain AU fragment, Data Partitions, or supplemental enhancement Information. But we are not very clear about the exact requirements of JVT. Therefore we can not make any decision before having a detailed discussion with JVT. M8057 This contribution proposes an extension of MP4 to support Picture level information. Dispositions on this contribution are same to M8056. M8058 This contribution proposes an extension of MP4 to support bitstream switching. Dispositions on this contribution are same to M8056. MPEG-7 Systems (15938-1) 15938-1/Amd 1 Topics MPEG-7 Systems extensions Contributions MPEG-7 Systems extensions Joint meeting with Requirements 55 M8170 : Additional requirements to the call. Integrated in the CfP. The Call will be issued in Jeju. MPEG-21 (21000) 21000-x Topics Architecture Status Contributions Architecture Joint meeting with Requirements and MDS M7910 : The working draft was revised. Difference between MPEG-21 architecture and YM (reference model) was discussed : sYstems Model : This is the MPEG-21 reference software (it comprises software modules implementing MPEG-21 tools and exercising MPEG-21 functionnality); MPEG-21 Architecture : This is a functional description of a generic MPEG-21 terminal (functional blocks with identified normative interface as well as information flow). A couple of issues were raised and discussed : Transport of the Digital Item (RTP, MPEG-2, …) : This is out of the scope of MPEG-21 but need to be done specified in appropriate place (e.g. in MPEG-4 for MP4, in MPEG-2 for MPEG-2 systems, …); Parsing only diagram : The current architecture only includes parsing. Likely more is done. The box will be identify as “tools” rather than “parser”. We don’t need a message bus : The architecture should only mentioned normative tools, the flow of information between them and the conformant interface. It should not contain implementation details (.g. like the message bus). It will be removed. Binarisation of the digital item MPEG will develop a binary version of the DID. We will allow both textual and binary format like in MPEG-7. We have the appropriate tools in-house for binarisation with MPEG-7 Systems. Textual/binary does no have any impact on the MPEG-21 processing engine architecture. MPEG-21 has specific requirements for its binarisation. The BiM shall compress the DID efficiently; The BiM shall support multiple XML namespace; The BiM shall allow to reconstruct an XML DID canonically equivalent to the original MPEG-21 DID. The BiM shall allow the compression of XML data for which the schema is not known at the MPEG-21 processing engine. They will be included in the current CfP for MPEG-7 extensions. File Format for the digital item M7990 : Proposal of an MPEG-21 file format. Since the proponent was not present, the contribution was little review. Still, it was decided that MPEG will develop a file format for the digital item. We have the appropriate tools in-house with the MP4 file format. The following MPEG-21 specific requirements for file format have been identified : The MP21 file format shall allow the bundling of the DID(s) descriptors and its resources in a single file. The MP21 file format shall allow random access to descriptors and resources. 56 The MP21 file format shall be backward compatible with the MP4 file format. The MP21 file format shall be able to refer to or/and include a broad set of resource formats (including HTML). The Systems group will make a call for contribution for the next meeting and the MP21 file format will be developed as an amendment to MP4. Persistent association See requirements report. Presentation of the digital item The current MPEG-7 Systems CfP calls for presentation tools for MPEG-7 data. Such tools should allow the visualization of MPEG-7 metadata (e.g. for an EPG) in a visualization format (e.g. HTML or XMT). Such tools would need to access both metadata and resources, possibly bundled in an MPEG-21 digital item. Similar concepts were discussed within MPEG-21. Therefore iIt was decided to remove this item from the MPEG-7 Call, to better understand the common technology that needs to be develop for MPEG-7 and MPEG-21. Contribution on the topic are welcomed by next meeting. 21000-4 Topics IPMP Status CD 2001-07. FCD 2002-05. FDIS 2002-10 Contributions IPMP M7962: Updating MPEG-21 IPMP based on MPEG-21 System Architecture. Accepted for inclusion in MPEG-21 IPMP Study document to satisfy NB comments. Unsure if proposal contains best solution possible but still very useful to help further the work as well as better understand the requirements for furthering the work. M7983, M7899, M7901 : Progressed the work of studying the MPEG-21 IPMP CD and NB comments. 57 Systems Standard Monitoring Standard Title Status Document with Purpose Topics MPEG-2 Systems 138181/Amd.7 13818-1:2000 Generic coding of moving pictures and associated audio information: Systems AMENDMENT 7: Transport of ISO/IEC 14496 data over ISO/IEC 13818-1 Generic coding of moving pictures and associated audio information: Systems 138181:2000/COR1 Generic coding of moving pictures and associated audio information: Systems TECHNICAL CORRIGENDUM 1 138181:2000/COR2 Generic coding of moving pictures and associated audio information: Systems TECHNICAL CORRIGENDUM 2 138186/COR1 Generic coding of moving pictures and associated audio information – Part 6: Extensions for DSM-CC Published 2000-12-01 Elementary Stream Management 31. MPEG-4 Over MPEG-2 Published 2000-12-01 MPEG-2 Systems Edition 2000 DCOR ballot : from ‘00-07-28 to ‘00-10-28 COR : ‘01-01-19 (Pisa meeting) SC 29 Sec. Submitted COR to ITTF on ‘01-02-05, ITTF forwarded it to ITU-T. ITU-T’s author review : by ‘01-10 - ITU forwarded the final text to ITTF DCOR ballot : from ‘01-07-23 to ‘01-10-22 SC 29 Sec. Submitted COR to ITTF in ‘01-11, ITTF forwarded it to ITUT. ITU-T AAP* last call period : by ‘02-03-28, to be approved by the beginning of ‘02-04 and then ITU will forward the final text to ITTF for publication. * AAP : ITU-T’s approval process MPEG-2 DSM-CC Published 1999-s12-01 58 ITTF ITU-T To Prepare the final text for publication ITU-T AAP last call Elementary Stream Management 32. FlexMux Descriptor Elementary Stream Management 33. Buffer model for PID2. Elementary Stream Management 34. Editorial correction Standard Title Status Document with Purpose Topics TECHNICAL CORRIGENDUM 1 138186/Amd.3 Generic coding of moving pictures and associated audio information -Part 6: Extensions for DSM-CC AMENDMENT 3: Transport buffer model in support of synchronized user-to-network download protocol 13818-6/ COR2 Generic coding of moving pictures and associated audio information – Part 6: Extensions for DSM-CC TECHNICAL CORRIGENDUM 2 Published 2001-12 DCOR ballot : from ‘01-02-09 to ‘01- 05-09 s Editor To be consolidated to 2nd Edition Editor no longer available Elementary Stream Management 35. Transport buffer model in support of synchronized user-to-network download protocol. Elementary Stream Management 36. Editorial correction MPEG-4 Systems 14496-1 Coding of audio-visual objects – Part 1: Systems Published 1999-12-15 144961:1999/Amd.1 Coding of audio-visual objects –Part 1: Systems AMENDMENT 1: Systems extensions Published 2001-11 59 Elementary Stream Management 37. Systems Decoder Model 38. Object Descriptor Framework 39. Synchronization of Elementary streams 40. Multiplexing of Elementary streams 41. Object Content Information 42. IPMP Scene Description 43. BIFS Syntactic Description Language Profiles and Levels Elementary Stream Management 44. MPEG-4 File Format (MP4) Scene Description 45. Application Window as a BIFS node 46. Advanced Audio BIFS 47. Material Keying Standard Title Status Document with Purpose Topics 48. Advanced coding (PROTO, Integration of Mesh, coding of Mfield). Application Engine (MPEG-J) Profiles and Levels 144961:1999/COR1 Coding of audio-visual objects – Part 1: Systems TECHNICAL CORRIGENDUM 1 14496-1:2001 Coding of audio-visual objects -Part 1: Systems 144961:2001/Amd.1 Coding of audio-visual objects -Part 1: Systems AMENDMENT 2: Extended BIFS 14496-1:2001/ COR1 Coding of audio-visual objects -Part 1: Systems TECHNICAL CORRIGENDUM1 144961:2001/Amd.2 Coding of audio-visual objects -Part 1: Systems AMENDMENT 2: Textual Format Miscellaneous 14496-1 Published 2001-11 MPEG-4 Systems Edition 2001 49. Integration of 14496-1, 14496-1/Amd.1, 14496-1 COR 1 Elementary Stream Management 50. Flextime 51. Rebufering Scene Description 52. Flextime nodes 53. ServerCommand 54. ExternProto 55. Advanced BIFS Coding Profiles and Levels Published 2001-11 Published 2001-10 DCOR ballot : from ‘01-02-09 to ‘01- 05-09 COR : ‘01-07-20 To be submitted to SC29 secretariat by editor 60 correction to Editor (Yuval Fisher) Editor (Michelle Kim) To be consolidated to 3rd Edition To be consolidated to 3rd Edition Miscellaneous 14496-1 correction to MPEG-4 Textual Format 56. XMT-A 57. XMT- Scene Description 58. Media Sensor 59. MediaControl 60. MediaBuffer 61. MatteTexture Elementary Stream Management 62. OD Framework additions Standard Title Status Document with Purpose Topics (OD execute, Segment Descriptors) 63. MP4 additions Profiles and Levels 64. Basic2D, Core2D, Main2D, Advanced2D (Scene Graph and Graphics) profile. MPEG-4 Conformance 14496-4:2000 14496-4:2000/ Amd1 14496-4:2002 2nd Edition 14496-1 Amd2 144964:2001/Cor1 Coding of audio-visual objects -Part 4: Conformance testing Coding of audio-visual objects -Part 4: Conformance testing AMENDMENT 1: Conformance testing extensions Coding of audio-visual objects -Part 4: Conformance testing Coding of audio-visual objects -Part 4: Conformance testing AMENDMENT 1: Conformance testing extensions Coding of audio-visual objects -Part 1: Systems TECHNICAL CORRIGENDUM1 Published 2000-12-15 Conformance for 14496-1 ITTF JC To be consolidated to 2nd Edition by JC after FDAM ballot approval Conformance 1/Amd1 - Wait for Approval of 144964/FDAM1 ITTF JC To be published after 144964:2000/FDAM 1 approval MPEG-4 Conformance Edition 2002 65. Integration of 14496-4, 14496-4/Amd.1, 144964/Cor1. FDAM 2001-12 ITTF To be consolidated in 2nd Edition Conformance for 144961:2001/Amd2 (Flextime) Submitted to ISO Secretariat on the 15/03/2002 ITTF To be consolidated in 2nd Edition Minor clarification on the textual dump format. Submission to ITTF: on ‘01-11-06 - FDAM ballot: by ‘02-03-10 for 14496- MPEG-4 Reference Software 14496-5 14496-5/Amd1 144965/COR1 Coding of audio-visual objects -Part 5: Reference software Coding of audio-visual objects -Part 5: Reference software AMENDMENT 1: Reference software extensions Coding of audio-visual objects -Part 5: Reference software TECHNICAL CORRIGGENDUM 1 Reference Software for 144961 Published 2000-04-01 FDAM 2000-07-xx ITTF Wait for consolidation to 2nd edition. Reference Software for 144961/Amd1 COR 2001-01-19 ITTF Wait for consolidation to 2nd edition. Miscellaneous 14496-5 61 correction to Standard Title 14496-5:2001 Coding of audio-visual objects -Part 5: Reference software 144965:2001/Amd.1 Coding of audio-visual objects -Part 5: Reference software AMENDMENT 1: Reference software extensions Status Document with Purpose Topics To be published April 2002 ITTF To be published MPEG-4 Reference Software Edition 2001 66. Integration of 14496-5, 14496-5/Amd.1, 144961/Cor1. FDIS on the 15/03/02. To be submitted to secretariat Editor (JCD) To be send to the secretariat. Reference Software for 144961:2001/Amd1 (Flextime) MPEG-4 Transport of MPEG-4 over IP Networks 14496-8 Coding of audio-visual objects -Part 8: Transport of MPEG-4 over IP Network (14496-8 15938-1 Multimedia content description interface Part 1: Systems 15938-2 Multimedia content description interface Part 1: DDL FDIS 2001-12-07 MPEG-7 Systems - FDIS: '01-12 (Claude Seyrat) - Submission to ITTF: on '01- 12-28 - FDIS ballot: by '02-04-28 - FDIS ballot: by '02-02-06 62 YoungKwon (Editor) Integrate IETF comments ITTF To prepare the final text after FDIS ballot approval ITTF To be published after FDIS approval proof check due by 2002-01-30 Elementary Stream Management 67. IETF RFC for transport of MPEG-4 over IP 68. Framework for the carriage of MPEG-4 content over IP network. MPEG-7 Architecture MPEG-7 dynamic descriptions MPEG-7 binary format MPEG-7 DDL Resolutions of Systems (Ref. WG11 Resolutionss) List of reviewed contribution N° Title 7873 Technical Description of Interpolator Compression Tools 7874 Table of Replies on ISO/IEC FDIS 14496-5:2001 (SC 29 N 4588) Summary of Voting on ISO/IEC 14496-5:2001/FPDAM 1 (SC 29 N 4589) OMG IDL declaration of the IPMP messaging interface Proposed changes in the IPMP Messaging Infrastructure Proposal of audio watermarking messages for the IPMP Messaging Infrastructure Summary of Voting on ISO/IEC 13818-1:2000/FPDAM 1 (SC 29 N 4601) IPMP 101 IPMP Rights ES and Messages for Distributed IPMP Terminal for MPEG-4 IPMP Extension Incorporation of Some Suggestions into MPEG-2 IPMP 7877 7879 7880 7883 7884 7885 7886 7887 7889 7890 7891 7892 7893 7894 7895 7896 Distributed Terminal Walkthrough Data Buffer Reference URL Format Proposed Syntax for C++ CreateInstance and DeleteInstance New Message to Register for IPMP Tool Deletion Listener Correction to Asynchronous Messaging Diagram Changes to IPMP ProcessData and ProcessDataReturn messages IPMP Tool Descriptors in the IOD New Message to Terminate IPMP Tool Authors Do Kyoon Kim, Sang Oak Woo, Seok Yoon Jung, Gyeong Ja Jang, ShinJun Lee, Mahnjin Han, Euee S. Jang ITTF via SC 29 Secretariat SC 29 Secretariat Massimo Balestri (TILAB), Filippo Chiariglione (TILAB) Massimo Balestri (TILAB), Filippo Chiariglione (TILAB) Massimo Balestri (TILAB), Filippo Chiariglione (TILAB), Panos Kudumakis (CRL) SC 29 Secretariat Craig A. Schultz Ming Ji, SM Shen, ZY Huang (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure (Matsushita Electric Industrial Co., Ltd) Ming Ji, SM Shen, ZY Huang (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Jan van der Meer (Philips Digital Networks) David Kosiba David Kosiba, Bruce Chaplin David Kosiba, Bruce Chaplin David Kosiba David Kosiba, Bruce Chaplin David Kosiba, Bruce Chaplin David Kosiba David Kosiba, Bruce Chaplin 63 N° Title 7899 Case Study of Persistent Association of Information with Digital Items: cIDf’s Trial on ID Resolution Summary of Voting on ISO/IEC 14496-1:2001/FPDAM 2 (SC 29 N 4610) IPMP_Scheme descriptor for Digital Item in MPEG-21 architecture Result of Core Experiment on Interpolator Compression 7900 7901 7905 7910 MPEG-21 Technical Architecture Working Draft 7911 MPEG-21 Technical Architecture AhG Report Systems Meeting Report 7913 7920 7921 7947 7958 7959 7962 Study of Text of PDAM ISO/IEC 14496-1:2001 / AMD3 Tokyo IPMP Adhoc meeting report. The test result of the BiM S/W Verification of MPEG-7 Visual Descriptors CDN NB comment on 144961:2001/AMD 3 (IPMP) Study of ISO/IEC 138181/2000/FPDAM 1 (carriage of metadata over MPEG-2) Updating MPEG-21 IPMP based on MPEG-21 System Architecture 7963 Rights Holder in MPEG-21 IPMP and its Mapping to MPEG-2/4 IPMP 7963 Rights Holder in MPEG-21 IPMP and its Mapping to MPEG-2/4 IPMP 7964 Uniform XML Schema Namespace and Semantics of Schema Elements for MPEG-4 Authors Hideki Sakamoto,Toru Hayashi, Yoichi Takashima, Hiroyuki Yamashita, Jay Kishigami, Hiroshi Yasuda SC 29 Secretariat ZY Huang, SM Shen, Ming Ji (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure (Matsushita Electric Industrial Co., Ltd) Do Kyoon Kim, Sang Oak Woo, Seok Yoon Jung, Shinjun Lee, Gyeong Ja Jang, Mahnjin Han, Euee S. Jang Niels Rump (ed.) Paul Jessop, Niels Rump (for the AhG Olivier Avaro (France Telecom R&D), Jean-Claude Dufourd (ENST), Jan Van der Meer (Philips), Craig A. Schultz AccessTickect), Michelle Kim (IBM), Young-Kwon Lim (MP4Cast), Zvi Lifshitz (Optibase), Claude Seyrat Expway), David Singer (Apple) Craig A. Schultz Craig A. Schultz Soo-Jun Park Spencer Cheng, Peter Haighton on behalf of the CDN NB Herve Murret-Labarthe, on behalf of the French National Body ZY Huang, SM Shen, Ming Ji (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure, Takafumi Ueno (Matsushita Electric Industrial Co., Ltd) Ming Ji, SM Shen, ZY Huang(Pana sonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure, Takafumi Ueno (Matsushita Electric Industrial Co., Ltd) Ming Ji, SM Shen, ZY Huang(Pana sonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure, Takafumi Ueno (Matsushita Electric Industrial Co., Ltd) ZY Huang, Ming Ji, SM Shen, (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure, Takafumi Ueno (Matsushita Electric Industrial Co., 64 N° Title Authors IPMP Extension Summary of Voting on 144961:2001/PDAM 5 [common text with ISO/IEC 15444-3/PDAM 1] Summary of Voting on ISO/IEC 14496-1:2001/PDAM 6 Summary of Voting on ISO/IEC 14496-4:200X/DCOR 1 Late Comments on ISO/IEC 14496-1:2001/PDAM 3 (SC 29 N 4640) Late Comments on ISO/IEC CD 21000-4 (SC 29 N 4641) XMT: Study of text of ISO/IEC 14496-1:2001/FPDAM2 Editorial Changes and Extension of Annex C on Selective Decryption Configuration Message Towards an MPEG-21 File Format Report of AHG on MPEG-4 content on MPEG-2 System and IP Network Ltd) SC 29 Secretariat 7995 Implementation plan for MU reference software Iver Grini (Octaga) for the SoNG project 7996 Zvi Lifshitz 8009 ILNB Position on ISO/IEC 14496-1:2001/PDAM3 and ISO/IEC CD 21000-4 IM1 AHG Report IM1 Core code + authoring tools version 5.7 Proposed Corrigendum to ISO/IEC 14496-4:2001 (SFTime Semantics) Proposed new text of IPMP FAQ Report of AHG on Advanced Text and 2D Graphics SL extension 8010 Discontinuity handling 8011 8016 Study of 14496-1:2001/PDAM4 Table of Replies on ISO/IEC 14496-4:2000/FDAM 1 Corrections to FBA section of XMT Comment on 14496-1:2001.1 Late Comments on ISO/IEC 14496-1:2001/PDAM 3 (SC 29 7972 7973 7974 7982 7983 7987 7989 7990 7992 7999 8000 8001 8005 8007 8017 8017 8020 SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat SC 29 Secretariat Steve Wood, Michelle Kim, et al Wenjun Zeng, Gene Wen, Mike Severa David Singer Young-Kwon Lim Zvi Lifshitz Zvi Lifshitz Zvi Lifshitz Itaru Kaneko Yuval Fisher (Envivio), Alexandre Cotarmanac’h (France Telecom R&D), Cyril Concolato (ENST) Stephanie Relier, Catherine Roux, Michel Veillard, Dominique Curet Stephanie Relier, Catherine Roux, Michel Veillard, Dominique Curet AFNOR ITTF via SC 29 Secretariat Eric Petajan The National Body of Switzerland SC 29 Secretariat 65 N° 8026 8027 8029 8032 8045 Title N 4644) Profiles & Levels indication values in IOD BIFS AHG report Comparison of the graphics tools of BIFS and SVG Report on AHG on developing MPEG-21 Software and Systems Model (YM) Corrections to 3D Audio profile in MPEG-4 Systems MPEG and IETF Additional comments on ISO/IEC 13818-1/FPDAM 1 8048 Proposal for a Timed Text Approach in MPEG 8053 Support for MPEG-4 Part 10 in MP4: Some Initial Considerations 8055 Supporting MPEG-4 Part 10 with the MP4 File Format: Some Initial Thoughts 8056 Support for MPEG-4 Part 10 Access Unit Fragment Acccess in MP4 File Format for JVT Video 8057 Support for MPEG-4 Part 10 Picture Level Information in MP4: Initial Considerations 8058 Support for MPEG-4 Part 10 Streaming Switching in MP4: 8046 8047 Some Initial Considerations 8103 8106 8112 8124 8125 8141 8143 8144 8145 8146 MPEG-7 TeM decoder developed at Lancaster University (version LUv2-0) Proposal of Unified Backchannel Syntax for view-dependent 3D transmission BIFS-ISG AHG report Profile complexity analysis NAL for AVC Video with MPEG-2 Systems Proposed new text of IPMP FAQ Informative Annex Describing MPEG-4 Script and ECMA Script Differences Events Execution Media Node URLs Set TRUE DrawOrderQuant Field to FALSE in QuantizationParameter Authors laurent Herrmann (Philips) Jean-Claude Dufourd for the AHG Cyril Concolato (ENST), Jean-Claude Dufourd (ENST) Ian Burnett Riitta Vaananen (IRCAM), Giorgio Zoia (EPFL) Jan van der Meer, Philippe Gentric UK National Body, Dr K Grant Jan van der Meer Toby Walker, Ali Tabatabai, Mohammed Zubair Visharam Toby Walker, Mohammed Zubair Visharam, Ali Tabatabai (Sony) David Singer (Apple Computer) Toby Walker, Mohammed Zubair Visharam, Ali Tabatabai (Sony) David Singer (Apple Computer) Toby Walker, Mohammed Zubair Visharam, Ali Tabatabai (Sony) David Singer (Apple Computer) Toby Walker, Mohammed Zubair Visharam, Ali Tabatabai (Sony) David Singer (Apple Computer) Rui J. Lopes Gauthier Lafruit, Alexandru Salomie, Eric Delfosse, Rudi Deklerck, Peter Schelkens, Jan Bormans, Jan Cornelis Jean-Claude Dufourd for the AHG Michelle Kim (IBM), William Luken (IBM), Steve Wood (IBM) Alexander (Sandy) MacInnis, Sherman (Xuemin) Chen, José Roberto Alvarez Itaru Kaneko Yuval Fisher Yuval Fisher Yuval Fisher Yuval Fisher 66 N° Title 8147 Report of AHG on Systems Conformance 8148 Report of AHG on Advanced Text and 2D Graphics Provisional UKNB comments on PDAM 14496-1 Amd5 (ISOFIle) Provisional UKNB comments on PDAM 14496-1 Amd6 (MP4v2) UKNB Comments on PDAM 6 for ISO/IEC 14496-1 UKNB Comments on PDAM 5 for 14496-1, PDAM 1 for 154443 Requirements for MPEG-7 Extensions Plugging a new codec in the BiM encoding framework An SL extension Application Analysis and Requirements for Advanced Text Support Proposal of Media Rating Encoding Working Draft 1.1 of ISO/IEC 13818-1:xxxx / AMDx 8161 8162 8165 8166 8170 8171 8172 8210 8211 8213 Authors Yuval Fisher (Envivio), Laurent Herrmann (Philips), Michelle Kim (IBM), Jean-Claude Dufourd (ENST), Guido Franceschini (CSELT) Yuval Fisher (Envivio), Alexandre Cotarmanac’h (France Telecom R&D), Cyril Concolato (ENST UKNB (c/o Adam Lindsay) UKNB (c/o Adam Lindsay) Adam Lindsay, UKNB Greg Collyer, Adam Lindsay, UKNB Claude Seyrat Claude Seyrat Gregoire Pau Alexandre Cotarmanac'h Vladimir Levantovsky Itsik Mantin Ji Ming, Jan van der Meer, SM Shen 67 Annex 6 MDS report Source: John R. Smith on behalf of Multimedia Description Schemes (MDS) Group The MPEG MDS sub-group activities included work items for MPEG-7 and MPEG-21 standards. The primary MPEG-7 work items included MPEG-7 Multimedia Description Schemes v.1 (FDIS) and MPEG-7 MDS Extensions (WD). MDS also worked with other groups on MPEG-7 Conformance (CD) and MPEG-7 Extraction & Use (PDTR). The MPEG-21 work items included MPEG-21 Digital Item Declaration (FCD), Digital Item Identification & Description (CD), Rights Expression Language (WD), and Rights Data Dictionary (RDD). MPEG-7 v.1 • MDS • Conformance • Extraction & Use MPEG-21 • Part 2 - DID • Part 3 - DII&D • Part 5 - REL • Part 6 - RDD MPEG-7 v.2 • MDS Extensions Overview: The main MDS activities related to MPEG-7 during the week were as follows: 1. Review final editing notes for ISO proof of MPEG-7 MDS (15938-5) 2. Review new contributions to MPEG-7 MDS v.2 3. Process NB comments on MDS part of MPEG-7 Extraction & Use (PDTR) 4. Process NB comments on MPEG-7 Conformance (CD) and review “Study of CD” (with other groups) 5. Produce revised version of MPEG-7 MDS Extensions Working Draft (WD) 6. Contribute MPEG-7 MDS conformance to MPEG-7 Conformance Committee Draft (CD) and lead activity on completing MPEG-7 Conformance FCD. 7. Edit and approve the documents (DoC, WD, CD, AHGs, new CEs, etc.) The main MDS activities related to MPEG-21 during the week were as follows: 1. Analyze recommendations of AHGs 2. Analyze results of CEs 3. Process NB comments on MPEG-21 DII&D (CD) 4. Further develop WD on MPEG-21 REL (WD) 5. Further develop WD on MPEG-21 RDD (WD) 6. Produce DII&D FCD 7. Edit and approve the documents (WD, CD, AHGs, new CEs, etc.) MPEG MDS Group activities 68 During the kick-off session, the workplan for the week for MPEG-7 and MPEG-21 development was discussed and approved. Furthermore, the following points were discussed: Organization of work into one track for MPEG-7 and MPEG-21 topics Scheduling of MDS group plenary meetings for Wednesday and Thursday Plan for generating revised MPEG-7 Extensions WD Plan for generating MPEG-21 DII FCD Plan for generating revised MPEG-21 RDD WD Plan for generating revised MPEG-21 REL WD Timeline for MPEG-21 REL and RDD Review of MDS MPEG-7 and MPEG-21 AHG reports Num. Contributions N/A AHG on Editing the MPEG-7 MDS Extensions WD and XM [w4538] N/A AHG on Editing the MPEG-21 DID FCD Study and DII&D CD Study [w4539] 7944 AHG on Editing the MPEG-21 RDD WD [w4540] 8063 AHG on Editing the MPEG-21 REL WD [w4541] 8061 AHG on MPEG-21 Core Experiments [w4542] 8032 AHG on developing MPEG-21 Software and SYstems Model (YM) [w4543] N/A Report of AHG on Editing the MPEG-7 MDS Extensions WD and XM, John R. Smith on behalf of MDS group. Results: Completed MPEG-7 MDS Extensions WD: o Incorporated Linguistic DS from XM o Incorporated SyntheticVideoEditing DS from XM o Uploaded on Dec. 21, 2001 Completed MPEG-7 MDS Extensions XM: o Incorporated ChangeMetadata Header (proposed in Pattaya) o Uploaded on Dec. 21, 2001 N/A AHG on Editing the MPEG-21 DID FCD Study and DII&D CD Study, Niels Rump Results: Both documents were under balloting following Pattaya meeting and were not revised. Furthermore, “study” documents were not produced given lack of new input. 7944 AHG on Editing the MPEG-21 RDD WD, Chris Barlas and Godfrey Rush for the AHG Results: Held AHG meeting to discuss OeBF and relationship to RDD/REL. Revised Model for Structure of Rights Data Dictionary and concept definitions Enhanced description of scope and terms & definitions. 8063 AHG on Editing the MPEG-21 REL WD, Barney Wragg for the AHG Results: Held joint AHG meeting with RDD AHG Sunday prior to Jeju Island meeting. Period after Pattaya meeting focused primarily on developing REL use cases, mapping to 69 requirements, and designing core experiments. Work of AHG did not produce directly any modifications to existing REL WD 1.0 prior to Jeju Island meeting. 8062 AHG on MPEG-21 Core Experiments, Barney Wragg for the AHG Results: Held AHG meeting with OeBF to discuss alignment of requirements. Held joint AHG meeting with REL AHG Sunday prior to Jeju Island meeting. Recommendations: Adopt example use cases into annex of WD Define extension to draft MPEG-21 core REL Align terms with RDD Define relationship with DID Recommend a joint meeting with MDS and Requirements to review N4336 Further core experiments Increase coverage of evaluation Evaluation of relationship with DID 8032 AHG on developing MPEG-21 Software and SYstems Model (YM) Ian Burnett for the AHG Results: As reported during MPEG plenary. Limited discussions on the reflector since Pattaya. The majority of postings were cross posts from the IPMP reflector and MPEG-21 Architecture reflector. The YM discussions were effectively placed on hold while the MPEG-21 Architecture reaches consensus. Review of MDS Core Experiments results Num. Contributions 8062 CE on the MPEG-21 REL 8062 CE on the MPEG-21 REL Barney Wragg on behalf on CE. Results: The REL Core Experiments resulted in document providing XrML examples. The core experiment was derived from a usage case provided by M. Paramasivam (Microsoft) at the 58th meeting in Pattaya. This case was originally developed to evaluate requirement 2.1.8, as defined in N4336. The case was expanded to cover several requirements. MPEG-21 RDD Working Draft Num. Contributions 7945 MPEG-21 Rights Data Dictionary (RDD) Working Draft v1.1 7945 MPEG-21 Rights Data Dictionary (RDD) Working Draft v1.1 Chris Barlas and Godfrey Rust Results: Chris and Godfrey reviewed the revised RDD WD v1.1 for the MDS group. They discussed the improvements such as revising structure of Rights Data Dictionary and 70 developing concept definitions, and enhancements to description of scope and terms & definitions. MPEG-7 MDS Proposals Num. Contributions 7946 MDS Video Editing Segment Description Tools: Addressing XML Schema Compliance 8209 Supporting Summarization in the Variation Set DS 7946 MDS Video Editing Segment Description Tools: Addressing XML Schema Compliance Eric Rehm (for J. Utz, III) Issues: Identifies esoteric XML Schema problem with current schema specification for MDS Consequences: MDS V1.0 is not a valid XML Schema because of alternating elements in analytic video editing content model (XSQ XML Schema parser fails on MDS schema) XSV shows other errors in audio and video which need to be flagged for attention of audio and video Possible solutions: Do nothing Yoshi #1: Change DDL (DDL revision requires amendment) Yoshi #2: Issue “call for solution” Yoshi #3: Wait for XML Schema update to solve problem Yoshi #4: Reconsider syntax definitions of relevant tools. Eric #1: Redefine syntax and put semantic constraint – requires extension for validating parsers. Modify version 1.0 and rely on inspection scripts for validation. Add normative annotation/appinfo elements that define required lookahead. Results: Adopt Yoshi #4. Contact and confirm with Video Editing proponents and Y. Shibata. Create new XML content model for MDS v1.0. Incorporate the revised syntax as provided by E. Rehm during ISO editing period. 8209 Supporting Summarization in the Variation Set DS E. Rehm Results: Identifies use for Variation DS to include links to summaries and views Proposes to add two elements to Variation DS To be revisited for MDS v.2 in discussion on Thursday. Group will decide on incorporating into XM or WD. The more general question of how to extend MPEG7 schema will be studied in MDS AHG. MPEG-7 MDS Version 1 Num. Contributions 8042 Editor's input on MPEG-7 Part 5: MDS (editing notes for ISO) 8042 Editor's input on MPEG-7 Part 5: MDS (editing notes for ISO) J. R. Smith 71 Proposal: John R. Smith reviewed detailed list of editing notes prepared by the co-project editors of ISO/IEC 15938-5 (MPEG-7 MDS). The editing notes reported on typos and mistakes in the FDIS draft and proposed correction. Results: The MDS group reviewed each of the editing notes and made decision to accept or reject each one. The final editor’s notes document was sent to ISO secretariat on March 15, 2002. MPEG-7 Extraction & Use Num. Contributions 7970 Summary of voting on PDTR 15938-8 (SC 29 N 4637) DoC on PDTR 15938-8 7970 Summary of voting on PDTR 15938-8 (SC 29 N 4637) J. R. Smith Proposal: John R. Smith reviewed the summary of voting on MDS aspects of PDTR ISO/IEC 15938-8 (MPEG-7 Extraction & Use). Results: The MDS group reviewed each of the ballot comments and made decision to accept or reject each one. The DoC document will be released by Video group. Peter van Beek prepared the final draft of MDS content for DoC. Peter van Beek will also collect the final input from MDS editors on MDS aspects of DTR 15938-8. MPEG-21 DII&D Num. Contributions 4532 MPEG-21 DII&D FCD 7971 Summary of Voting on ISO/IEC CD 21000-3 4532 7971 MPEG-21 DII&D FCD Summary of Voting on ISO/IEC CD 21000-3 Niels Rump Issues: Reviewed the NB comments on DII&D CD with MDS group. Niels applied the changes to the current CD document and prepared the draft of the FCD based on decisions of group. Niels also prepared the draft of the DII&D CD DoC document. Some discussion was had in regards to description aspects of DII&D. Group has supported the position to rename the DII&D to DII since the description aspects of the DII&D are covered completely by DID. Some discussion was had on the requirements for DII&D to identify other entities in the MPEG-21 framework. The group has discussed allowing the DII&D part of the standard to only address identification of digital items and not other entities, with the possibility that another part of the standard will address identification of other entities in MPEG-21. Other editorial comments are to be handled by Niels. 72 Reviewed a draft for RFC for registration authority for identification systems. Output: FCD DoC RFC for Registration Authority for Identification Systems Resolution from MDS for Registration Authority Resolution for change of name of Part 3. MPEG-21 RDD-REL Requirements Num. Contributions 7944 AHG on Editing the MPEG-21 RDD WD [w4540] C. Barlas 8163 Use cases for RDD-REL D. Parrot BoG on RDD/REL B. Wragg Report of AHG on RDD/RELC. Barlas Results: Chris Barlas gave a report of meeting with OeBF (Open e-Book Forum). M7981 – Liaison statement lists its requirements (about 15) and issues comments to MPEG. One OeBF requirement (3.6.5) does not seem to have mapping to particular MPEG-21 requirement. The requirement deals with the ability to differentially express rights expressions for different individual users and groups. It is not clear that this item needs MPEG to develop specific requirement, since it is fairly basic and already presumed to be accommodated by MPEG-21 requirements. One possibility is to develop use case that demonstrates this. What is the process for responding to OeBF? o Chris Barlas and Keith Hill will work Jans Borman to prepare a response to the OeBF liaison statement o Make resolution at plenary to thank OeBF for comments 8163 Report of AHG on RDD/RELD. Parrot Proposal gives new use cases for RDD-REL for different applications: o Web distribution o Video news distribution (media company to distributor) o E-commerce and channel partner distribution o Real-time financial data distribution o Picture archive access Discussion: where should the use cases be explored – MDS or Requirements? Action: o Work with RDD-REL BoG o Propose CE to develop rights expressions for use cases BoG on RDD/REL B. Wragg The RDD/REL BoG has identified a number of MPEG-21 requirements on RDD/REL which are possibly incorrectly stated or not appropriate for RDD/REL, including o Modification of Expressions 73 o Authentication of Expressions o DIA Requirements (2.1.7) recommend Requirement is clarified, expanded and brought into context of MPEG-21 framework o 2.1.16 Expression Language support of dictionary terms MDS group will supply updated requirements statements to Requirements. MPEG-21 Technical Architecture Num. Contributions Requirements for MPEG-21 Technical Architecture Binary DID requirements Discuss next steps 7990 Towards an MPEG-21 file format N. Rump D. Singer ZY Huang, SM Shen, Ming Ji (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure, Updating MPEG-21 IPMP based on Takafumi Ueno (Matsushita Electric Industrial Co., 7962 MPEG-21 System Architecture Ltd) Ming Ji, SM Shen, ZY Huang(Pana sonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure, Rights Holder in MPEG-21 IPMP Takafumi Ueno (Matsushita Electric Industrial Co., 7963 and its Mapping to MPEG-2/4 IPMP Ltd) Presentation/Browsing of Digital Items Introductory discussion on Technical Architecture and Software There needs to be clear distinction between technical/terminal architecture and reference software implementation Role of YM has been clarified to be software for reference implementation MPEG-21 Technical Architecture N. Rump Further develop & document the requirements for Technical Architecture Draft of MPEG-21 Technical Architecture diagram was developed in Tokyo ad-hoc meeting. The diagram has been further revised to allow plug-in of tools through plug-in interface. o Concerns were raised about the sequential processing nature of the architecture and whether the sync and messaging protocols were worked out o At some point need to define transport of digital items o Should revise the message bus to reflect flow of information rather than passing of messages o Renaming current technical architecture diagram to MPEG-21 “Processing Engine” to reflect the nature of the diagram o Activity on technical architecture to remain in Requirements for moment MPEG-21 YM (Reference Software) I. Burnett Need to work out architecture in order to allow implementation of reference S/W Need to specific reference S/W implementations, such as MPEG-21 DI parser 74 MPEG-21 Binarization of DID Do we need capabilities for binarizing MPEG-21 DID? Seems “yes”. Need to draft requirements. Requirements: o The MPEG-21 binarization shall compress the DID support multiple namespaces allow reconstruction of canonically equivalent XML to the original MPEG-21 File Format D. Singer (not present) Action: issue call at this meeting in the MPEG-7 Systems call MP21 file format shall allow: o Bundling of DID descriptors and its resources into a single file o Random access to descriptors and resources o Be backwards compatible with the MP4 file format Persistent Association Draft call for requirement in Jeju. Refresh in May. Final call in July. Presentation of the digital item Need contribution or proposal on issues of presentation of digital items. Otherwise, it is difficult to proceed in developing mandates for AHG. Need also to develop “Processing Engine” before understanding relevance of “presentation” Ian Burnett gave demo of browser for Digital Items that presents digital item by applying stylesheet to DID. Can produce HTML or SMIL. MPEG-7 Profiles Num. Contributions 7918 MPEG-7 Profiles and Levels Architecture N/A MPEG-7 Interoperability Test-bed 8038 MPEG-7 Profiles and Levels using XML Namespaces 8109 A User Description Profile for MPEG-7 and TV-Anytime 7918 W.Chang W.Chang Eric Rehm P. van Beek, M. I. Sezan MPEG-7 Profiles and Levels Architecture MPEG-7 Interoperability Test-bed Wo Chang Proposal: MPEG-7 N3751 identifies large number of application domains. Furthermore, MPEG-7 defines 409 global types (how many combinations) Proposed objective of profiles/levels is to allow interoperability of systems implementing same profile and to allow mix of multiple profiles. Introduced MDI, which is numbering scheme for MPEG-7 DSs and Ds. 75 How to allow profiling? (1) Replace MPEG-7 Root Element (2) Add attributes to MPEG-7 root element. (3) Use XML namespace and schemaLocation to locate subset of MPEG-7 schema Propose Profile and Level registration and management sa central repository. Discussion: Concern was raised that the proposal does not consider the complexity dimension and that something more is needed for defining profiles than creating a subset of the schema. For example, it is important to consider how the tools are used in making a description. Action: Known criteria for profiles/levels include interoperability and complexity. There is still lack of understanding how requirements for interoperability and complexity drive creation of profiles/levels in MPEG-7 (lack of proposals). 8038 MPEG-7 Profiles and Levels using XML Namespaces Eric Rehm Proposal: Motivation is that MPEG-7 could be costly to implement given the large number of tools and therefore it may be necessary to define profiles. This can be done using Namespaces – for example, by defining one namespace per profile (across parts – MDS, Visual, Audio). Recommendation: Create a single profile namespace and schema for all types in a profile Augment Package/Scheme element with new restriction attribute Comments: Questions were raised about whether namespace was necessary mechanism for defining profiles. For example, it may be easier to include attributes in MPEG-7 root element. 8109 A User Description Profile for MPEG-7 and TV-Anytime P. van Beek, M. I. Sezan Proposal: Propose an MPEG-7 profiles for user preferences, which allows the subset of MPEG-7 tools that are used by TVA to be selected from MPEG-7 schema. How to group and subset description tools: o By complexity – levels o By application – multiple applications o By functionality – key driver for profiles o No profiles Conclusions: We will not necessarily split MDS, Audio, and Visual to form the profiles, but will form clusters of tools from across the parts. The Requirements group will create resolutions from this meeting clarifying current understanding on profiles and levels for MPEG-7. MPEG-7 Conformance Num. Contributions 7882 Study on 15938-7 Conformance J. R. Smith 76 7882 Study on 16938-7 Conformance John R. Smith Proposal: John R. Smith reviewed the Study on 15938-7 Conformance in joint meeting with MDS, video, audio, and systems groups. The major revisions included the definition of conformance with respect to MPEG-7 systems decoding and DDL processing. The specification was also revised to harmonization the view on conformance across the different parts of schema: visual, audio, DDL, and MDS. John pointed out areas that needed further development. The revisions of the study were supported by NB comments. Results: Got commitment from Systems/DDL experts to work on content during a short editing period immediately following the meeting. The detailed review of the voting on ISO/IEC CD 15938-7 was completed following morning. MPEG-7 Conformance (cont.) Num. Contributions 7970 Summary of Voting on ISO/IEC CD 15938-7 J. R. Smith 7970 Summary of Voting on ISO/IEC CD 15938-7 John R. Smith Proposal: John R. Smith reviewed the NB ballot comments on ISO/IEC CD 15938-7 in joint meeting with MDS, audio, video, and systems groups. Results: The groups went through each comment one-by-one and determined disposition. John prepared the final DoC document for output from meeting. MPEG-7 XM Software Num. Contributions N/A MPEG-7 XM Software 7970 MPEG-7 XM Software Proposal: Joint meeting was held between MDS and ISG to review status for MPEG-7 XM software. Several items were reported as not compiling on certain platforms or were missing documentation. Results: During the meeting several items designated not compiling were investigated and were determined to be able to be compiled with slight effort. MDS will solicit from proponents to check that remaining items are taken care of. MPEG-7 MDS version 2 77 Num. Contributions 7927 Some Amendments to the Linguistic DS 7928 Generalized Uses of Some Linguistic-Description Tools 8209 Supporting Summarization in the Variation Set DS (return) 8033 Proposal for a HistoryType K. Hasida K. Hasida E. Rehm J. Bitzer, S. Kudras 7927 7928 Some Amendments to the Linguistic DS Generalized Uses of Some Linguistic-Description Tools K. Hasida Proposal: Several revisions to current WD specification of Linguistic DS were proposed: (1) Scope of definition (2) Syntax-semantics mapping (3) Media alignment Result: Revisions to RelationType would be considered for MPEG-7 MDS XM. Also, development of Linguistic Relations would be considered for MPEG-7 MDS XM. It was pointed out that additional tools for media alignment are not needed since MediaLocator is currently sufficient for supplying that functionality. 8033 Proposal for HistoryType J. Bitzer Proposal: A proposal was made in Pattaya meeting for describing change history, which was adopted into MPEG-7 MDS XM document. The proponent revised the content and proposed a HistoryType. Results: The group agreed to accept the new HistoryType into MPEG-7 MDS XM document to replace existing material. Proponent to provide final draft of material by end of meeting. MPEG-7 Multi-channel Audio Num. Contributions N/A Proposal for multi-channel audio J. Bitzer N/A Proposal for Multi-channel audio J. Bitzer Proposal: A proposal was made in joint MDS, audio groups meeting to modify MPEG-7 version 1 to allow audio descriptors to be extracted from multi-channel audio. The audio group verified that such description is warranted in MPEG-7. The proponent proposed modification to MDS part to support the audio extraction. Results: The MDS group agreed to adopt the change into the MDS XM document. 78 MDS Plenary and Reports of BoG Num. Contributions N/A REL BoG Report B. Wragg N/A RDD BoG Report C. Barlas, G. Rust REL BoG: Excellent progress this week Developing and evaluating relation with RDD, DID, and rest of framework WD 2.0 completed – still needs review expect 3.0 in Fairfax CE process is on-going: o Note using CE’s to evaluate and expand REL RDD BoG: First drafts of sections 5, 6, 7 WD 2.0 now complete AHG mandates – develop database demonstrator & carry out analysis/mapping of key schems: demonstrate all provisions of sections 4 & 5 to prove and develop standard; research governance requirements 79 New Core Experiments (CEs): The following MPEG-21 experiments were approved during the Jeju meeting: Topic Workplan for CE on REL/DID Experiments using Two-Ton Shoe Album Leader Relevant Requirements Thomas DeMartini 2.1.21 Inheritance Semantics 2.2.1 Digital Item Description 2.2.3 Composite Digital Items 2.1.1 Support of Multiple Usage/Business Models 2.1.2 Articulation of Roles 2.1.3 Definition of Terms 2.1.4 Standard Identification Systems 2.1.5 Interoperability 2.1.6 Extensibility 2.1.8 Expressiveness 2.1.9 Machine Readable Language 2.1.10 Adding New and Modifying Existing Expressions 2.1.11 Identification and Description of Rights Expressions 2.1.12 Authentication of Expressions 2.1.13 Verification of Expressions 2.1.16 Expression Language Support of Dictionary Terms 2.1.17 Open Standard MetaLanguage 2.1.18 Well Defined Semantics 2.1.19 A Core Set of Primitives 2.1.22 Minimizing Overheads 2.2.1 Digital Item Description 2.2.3 Composite Digital Items 2.2.10 Life Cycle of Digital Items 2.2.11 Format and Delivery Independence 2.3.1 Specification of Usage Permissions 2.3.4 Render Permissions 2.3.5 Derivative Digital Item Permissions 2.5.1 Specification of Obligations 2.5.3 Obligations on Agents Workplan for CE on Rights Expressions for Combination of Digital Items 80 Related documents 4642, 4639, 4640, 4641 4643, 4639, 4640, 4641 2.1.1 Support of Multiple Usage/Business Models 2.1.2 Articulation of Roles 2.1.3 Definition of Terms 2.1.4 Standard Identification Systems 2.1.5 Interoperability 2.1.6 Extensibility 2.1.8 Expressiveness 2.1.9 Machine Readable Language [Others to be determined during CE] Workplan for CE on Rights Expressions for Video News Syndication 81 4644, 4639, 4640, 4641 List of MDS Output documents: Title MPEG-7 Multimedia Description Schemes Extensions WD (v2.0) MPEG-7 Multimedia Description Schemes XM (v11.0) Text of ISO/IEC 15938-7 FCD — Information Technology — Multimedia Content Description Interface — Part 7: Conformance DoC on ISO/IEC 15938-7 CD Request for new amendment to ISO/IEC 15938-5 MPEG-21 Digital Item Identification FCD DoC on ISO/IEC 21000-3 CD Request for Candidates for the Registration Authority for ISO/IEC 21000-3 MPEG-21 Rights Expression Language WD (v2.0) REL Element Evaluation Process MPEG-21 REL Core Experiment Process Workplan for CE on REL/DID Experiments using Two-Ton Shoe Album Workplan for CE on Rights Expressions for Combination of Digital Items Workplan for CE on Rights Expressions for Video News Syndication MPEG-21 Rights Data Dictionary WD (v2.0) 82 No. TBP Date 4631 Y 22/03/02 4632 N 22/03/02 4633 Y 22/03/02 4634 4635 4636 4637 N N Y N 15/03/02 15/03/02 22/03/02 15/03/02 4638 Y 15/03/02 4639 4640 4641 Y N N 15/03/02 15/03/02 15/03/02 4642 N 15/03/02 4643 N 15/03/02 4644 N 15/03/02 4645 Y 22/03/02 Next targets for the Fairfax, VA meeting: MPEG-7 Produce the MPEG-7 MDS Extensions CD. Produce the MPEG-7 Conformance FDIS (with audio, video, and systems) MPEG-21 Perform the Core experiments approved during the Jeju meeting and review the results. Study and improve the FCD on Digital Item Declaration and address NB comments. Study and improve the FCD on Digital Item Identification and Description and address NB comments. Continue development of MPEG-21 RDD and REL MPEG-21 DIA WD 83 Final MDS Meeting Schedule (Jeju Island, KR): MDS MDS Group (MPEG-7 & -21 activities) Number TITLE (V. Final) ROOM SOURCE STD NOTES Monday Morning (9h00-13h00) MPEG Plenary Plenary room Monday Afternoon (14h30-20h00) Kick-off of MPEG MDS activities (14h30-15h00) Agenda, Goals and Issues for the Week for MDS Group Emerald Review of AHG resolutions and action points (15h00-16h00) Emerald J. R. Smith N/A AHG on Editing the MPEG-7 MDS Extensions WD and XM [w4538] K. Hasida, M. Rynderman, J. R. Smith, T. Walker N/A AHG on Editing the MPEG-21 DID FCD Study and DII&D CD Study [w4539] T. Schwartz, N. Rump, H. Sakamoto 7944 AHG on Editing the MPEG-21 RDD WD [w4540] C. Barlas 8063 AHG on Editing the MPEG-21 REL WD [w4541] B. Wragg, B. Gandee, R. Iannella 8061 AHG on MPEG-21 Core Experiments [w4542] I. Burnett, B. Wragg 8032 AHG on developing MPEG-21 Software and SYstems Model (YM) [w4543] P. Ruskin, I. Burnett MDS CE results (16h00-16h30) Emerald B. Wragg, B. Gandee, R. Iannella, H. Zhang, J. Shen, Y.-W. Song, M.Paramasivam, H. Z. Yang MPEG-21 MPEG-21 RDD WD (16h30 - 17h00) MPEG-21 Rights Data Dictionary (RDD) Working 7945 Draft 1.1 Emerald MPEG-21 MPEG-21 MDS BoG Mandates (17h30 - 18h00) Emerald MPEG-21 MPEG-21 RDD-REL BoG (09h00 - 15h00) Charlotte MPEG-21 MPEG-7 Proposals (09h00 - 10h00) Emerald MPEG-7 8062 CE on the MPEG-21 REL [w4537] C. Barlas Tuesday Morning (9h00-13h00) 7946 MDS Video Editing Segment Description Tools: Addressing XML Schema Compliance J. Utz, III 8209 Supporting Summarization in the Variation Set DS E. Rehm 8033 Proposal for a HistoryType J. Bitzer, S. Kudras MPEG-7 MDS Version 1 (10h00 - 11h30) Editor's input on MPEG-7 Part 5: MDS (editing 8042 notes for ISO) Emerald J. R. Smith on behalf of MPEG MDS Editors 84 MPEG-7 BoG MPEG-7 Extraction and Use (11h30 - 12h30) Summary of Voting on PDTR 15938-8 (SC 29 N 7970 4637) Emerald MPEG-7 J. R. Smith DoC on PDTR 15938-8 Tuesday Afternoon (14h00-20h00) MPEG-21 DII&D (17h00 - 17h30) Emerald 4532 MPEG-21 DII&D FCD N. Rump for editors 7971 Summary of Voting on ISO/IEC CD 21000-3 N. Rump for editors MPEG-21 RDD-REL Requirements (15h00 - 16h00) 7944 AHG on Editing the MPEG-21 RDD WD [w4540] 8163 Use cases for RDD-REL MPEG-21 Technical Architecture (with Rqmnts. & Systems) (16h00 - 18h00) Requirements for MPEG-21 Technical Architecture 7990 Towards an MPEG-21 file format 7962 Updating MPEG-21 IPMP based on MPEG-21 System Architecture 7963 Rights Holder in MPEG-21 IPMP and its Mapping to MPEG-2/4 IPMP MPEG-21 Emerald MPEG-21 Joint Requirements MPEG-21 Joint MPEG-21 BoG N. Rump D. Singer ZY Huang, SM Shen, Ming Ji (Panasonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure, Takafumi Ueno (Matsushita Electric Industrial Co., Ltd) Ming Ji, SM Shen, ZY Huang(Pana sonic Singapore Laboratories Pte Ltd), Taka Senoh, Takuyo Kogure, Takafumi Ueno (Matsushita Electric Industrial Co., Ltd) Wednesday Morning (08h00-13h00) MPEG-21 RDD BoG (08h00 - 09h00) Charlotte MPEG Plenary (9h00-12h30) Plenary room MPEG Plenary MPEG-21 RDD-REL BoG (11h00 - 12h30) Charlotte MPEG-21 BoG MPEG-21 RDD-REL BoG (02h00 - 17h00) Charlotte MPEG-21 BoG MPEG-7 Profiles (14h00 - 15h00) with Requirements Emerald MPEG-7 Joint MPEG-7 Joint Wednesday Afternoon (14h00-17h30) 7918 8038 8109 MPEG-7 Profiles and Levels Architecture MPEG-7 Profiles and Levels using XML Namespaces A User Description Profile for MPEG-7 and TVAnytime MPEG-7 Conformance (15h30 - 16h30) with All W.Chang Eric Rehm P. van Beek, M. I. Sezan Video 7882 Study on 15938-7 Conformance John R. Smith 7970 Summary of Voting on ISO/IEC CD 15938-7 All Plenary MDS and Report of BoG (17h00 - 18h00) Emerald MPEG-21 RDD-REL BoG 85 MDS Plenary MPEG Social Event (18h00 - midnight) Thursday Morning (9h00-12h30) MPEG-21 RDD-REL BoG (09h00 - 15h00) Charlotte MPEG-21 MPEG-7 Conformance (08h30 - 09h00) with Audio, Video, Systems Video MPEG-7 MPEG-7 XM Software (09h00 - 09h30) with ISG Charlotte MPEG-7 MPEG-7 MDS Version 2 (09h30 - 11h00) Emerald MPEG-7 7927 Some Amendments to the Linguistic DS Generalized Uses of Some Linguistic-Description Tools K. Hasida K. Hasida, M. Rynderman, J. R. Smith, T. Walker 8209 MPEG-7 Multimedia Description Schemes Extensions Working Draft Ver. 1.5 Supporting Summarization in the Variation Set DS (return) 8033 Proposal for a HistoryType J. Bitzer, S. Kudras 7928 7988 MPEG-21 Multi-channel Audio (11h00 - 11h30) with Audio BOG K. Hasida E. Rehm Emerald MPEG-21 Joint Emerald MPEG-21 Joint Emerald MPEG-21 Thursday Afternoon (14h00-19h00) MPEG-21 Digital Item Adaptation (14h00 - 15h00) with Requirements MPEG-21 DID (15h00 - 15h30) MPEG-21 DID FCD Plenary MDS and Reports of BoG (15h30 - 16h00) Y.-W. Song on behalf of DID editors Emerald MDS Plenary MPEG-21 RDD-REL Review of Output documents, AHGs, CEs, DoC, Std (16h00 17h00) Emerald Friday Morning (09h00-13h00) Wrapping up (09h00 - 13h00) Approval of resolutions, AHGs and Output documents Emerald MDS Plenary Plenary room MPEG Plenary Friday Afternoon (14h00-22h30) MPEG Plenary Joint meetings: MDS & Requirements on MPEG-21 RDD-REL requirements MDS & Requirements & Systems on MPEG-21 Technical Architecture Requirements + Audio, Visual, MDS on MPEG-7 profiles MDS & All on MPEG-7 conformance Tues 3:00PM - 4:00PM Emerald Tues 4:00PM - 6:00PM Requirements Wed 2:00PM - 3:30PM Emerald Wed 3:30PM - 4:30PM Video Breakout group meetings: MPEG-21 RDD-REL Tues 09h00 – 15h00 Charlotte Room 86 MPEG-21 RDD-REL Wed 13h00 - 17h00 Charlotte Room MPEG-21 RDD-REL Thurs 09h00 – 15h00 Charlotte Room 87 Annex 7 Video Group Report Source : Jens-Rainer Ohm, Miroslaw Bober Activities in Video Coding Review of JVT work The Video subgroup reviewed the results of the JVT January meeting (M8150). Particular questions of JVT to their parent bodies, as far as MPEG is concerned, were answered in document N4673. Joint sessions were held with the requirements group concerning the aspect of Profile and Level definitions. In particular, it is recommended to keep the number of different conformance points as low as possible, which can first be achieved by minimal definition of the number of levels. Both profiles and levels should more clearly be defined based on decoder complexity considerations, and taking into account envisaged application domains. A session on issues of AVC codec complexity was held jointly with the ISG. It was recommended to investigate complexity of encoder and decoder based on the JM software implementation, selecting specific tools in the range of low (all options off), medium and high (all options on) complexity. For tools to be selected in the medium complexity range, a selection similar to that in document M8127, which would map to a similar application domain as the ASP of MPEG-4 part 2. Fine Granularity Scalability Profile The verification test concerning FGS has been performed before the Jeju meeting, and a draft test report has been brought into the meeting. The verification test consisted of test A (the so-called dynamic test, captures taken by running over a true network) and test B (static test, comparison versus simulcast). Due to systems limitations, one part of test A had been performed differently from the other parts (FGST tool was not used in that particular one). During the review of the draft report, it was concluded that the result was rather ambiguous due to this fact. Hence, it was recommended to the test executors to repeat this particular test in time before the 60th meeting, and make available a refined version of the test report based on these results as input document before the meeting. All software related to FGS profile is finalized, such that the FDAM1 of software extensions was issued at the 59th meeting. Concerning conformance related to FGS, responsibilities have been identified for all streams. A Study of FPDAM1 of conformance extensions has been produced, and NBs were kindly asked to take this study into regard when voting on FPDAM1. Software and Conformance streams, maintenance of standards The Video subgroup has arranged in Jeju that all software related to MPEG-4 Video (14496-2) is made publicly available on web site http://megaera.ee.nctu.edu.tw/mpeg/. This also includes software related to encoder optimization (MPEG-4 part 7). Further support is planned, which will most hopefully lead to publicly available realtime software implementations of MPEG-4 Video Simple Profile. The Video subgroup also has arranged in Jeju that all conformance streams related to MPEG-4 Video (14496-2) will be publicly available on ftp site ftp://ftp.tnt.unihannover.de/pub/MPEG/video/conformance in a reasonable period after the meeting. 88 An output document N4583 "MPEG-4 Visual Implementers Guide List of Problem Reports" was issued as a revised version of the previous document from Pattaya meeting. Status of 14496-2:2001/PDAM3 It was decided not to progress to FPDAM3 in Jeju, as the situation of software and conformance work related to PDAM3 appeared rather unclear. Contributors were requested to clarify this situation until the next meeting. Request for error resilience supplement to MPEG-4 A request was made to the Video subgroup on implementing error resilience at the enhancement layer of existing scalability coding tools (M7919). However, it was identified that this would require definition of a new tool, object type and profile. It was concluded that such a major effort could only be justified if sufficient continuous support was evident by contributing parties. Explorations Advanced FGS On Advanced FGS, six input documents (M7991,M8023,M8128,M8140,M8204,M8214) were received and reviewed, but it was concluded not to take any action on these items before the verification test on FGS is finalized. Interframe Wavelet Coding In Pattaya, an AHG had been installed to explore Interframe Wavelet coding. From an applications point of view, it was identified that possible merits of such a technique would be flexible scalability of bitstreams and resolutions for seamless integration of servers, networks, terminals, acquisition and storage devices with different characteristics. An important argument is that scalable coding should not penalize coding efficiency if compared against single layer coders, which is a new paradigm having in mind the traditional way of comparing scalable coding versus simulcast. Several input contributions were reviewed (M7906,M7977,M8130,M8131,M8207). A preliminary conclusion is that fully scalable technology already exists which is competitive with conventional coders on the market today in terms of coding efficiency, but not yet competitive with coders under development. Possible directions of improvement of such coders would be higher accuracy of MC, inclusion of post processing and RD optimization in truncating scalable streams. It is still premature to draw a final conclusion, but worthwhile to continue this investigation. To achieve comparison on an equal basis, experimental conditions have been defined in an output document (N4584). Future contributors are asked to use these conditions to make different approaches comparable. 3D Video Coding On this activity, a meeting was held jointly with the Requirements group. 3 input documents were reviewed (M7930, M8040,M8107). It was identified that this work contains aspects which are prospectively related to the work area of the Video subgroup, especially in the areas of multiview 89 compression, image-based rendering and view interpolation. Before any further action is taken, it should be clarified what the architecture of a complete system should be, then to identify which tools are existing in MPEG standards, which tools would have to be enhanced or newly defined.defined Digital Cinema The Digital Cinema work in its present status is still (or better said again) concerned with investigation of higher-level requirements. Video expertise would surely be needed later in the process. Summary list of documents reviewed AHG Reports M8041 M8059 M8153 M8156 M8205 M8206 M8227 AHG on Editorial Convergence of MPEG-4 Reference Software (T. Chiang, H. Sun) AHG on DCinema (W. Husak and E. Edwards) AHG on Studio Profile (Y. Yagasaki) AHG on 3-D Video Coding (R. Yamashita) AHG on Interframe Wavelet Technology (Jens-Rainer Ohm, Touradj Ebrahimi) AHG on FGS (Jens-Rainer Ohm, Weiping Li, K. Kim) AHG on JVT Complexity Analysis (Michael Horowitz) Work Relating to JVT M8028 Initial Memory Complexity Analysis of the JVT Codec (Kristof Denolf, Carolina Blanch) M8127 TV Profile for AVC codec (Sherman (Xuemin) Chen, José Roberto Alvarez, Alexander (Sandy) MacInnis) M8149 Report of 1st JVT Meeting M8150 Report of 2nd JVT Meeting MPEG-4 Visual Work Topics M7919 A proposal for syntax amendment to use the error resilience tools in the MPEG-4 Simple Scalable Profile (Tamer Shanableh, Paola Hobson) M8110 Editorial Update on New Levels and Tools Amendment (Chun-Jen Tsai, Yuval Fisher, Philippe Gentric) M8201 New Problem Reports Relating to MPEG-4 Visual (G. Sullivan) Exploration M8040 Broadcast Requirements on 3D Video Coding (Christoph Fehn, Marc Op de Beeck, Etienne Fert, Peter Kauff) M8130 Comparison of MC-EZBC and H.26L TML 8 on Digital Cinema Test Sequences 90 (Peisong Chen and John W. Woods) M8131 Interframe Subband/wavelet Coding Results for Digital Cinema using MCTF and JPEG 2000 (Robert A. Cohen, Peisong Chen, John W. Woods) M7906 Wavelet-based fine granularity scalable video coding with in-band prediction (Yiannis Andreopoulos, Adrian Munteanu, Geert Van der Auwera, Peter Schelkens, Jan Cornelis) M7977 Architecture and features of a fully scalable motion-compensated 3D subband codec (Eric Barrau, Arnaud Bourge, Vincent Bottreau) M8107 Requirements for Standardisation of 3D Video (JEITA 3DMM Committee / Takashi Matsuyama Ryozo Yamashita) M8207 Principles for evaluation of scalable wavelet coding technology (Jens-Rainer Ohm, Konstantin Hanke) M7991 Block-based FGS Coding with Optimized Truncation for MPEG-4 Streaming Video (Yuwen He, Shiqiang Yang, Yuzhuo Zhong) M8003 Fine Granularity Scalability for MPEG-4 Part 10 (Weiping Li) M8014 Study on Advanced Fine Granularity Scalability in MPEG-4 video (Kyuheon Kim, Won-Sik Cheong, Gwang Hoon Park and Jinwoong Kim) M8023 Water Ring Scan Method for MPEG-4 and H.26L based FGS Methodologies (Gwang Hoon Park, Won-Sik Cheong, Kyuheon Kim, Yoon Jin Lee, Young Kwon Lim, and Jinwoong Kim) M8128 FGS+: A framework for improved Joint Spatio-Temporal Video Quality of Fine Grained Scalable Coding (Mihaela van der Schaar, Raj Kumar Rajendran, Shih-Fu Chang) M8140 Using S-Frames for fast switching between FGS streams and switching between MCFGS structures to limit prediction-drift (Mihaela van der Schaar) M8204 Description and Proposed Syntax of JVT-based FGS (Xiaoyan Sun, Feng Wu, Shipeng Li) M8214 The framework for seamless switching of scalable video bitstreams (Xiaoyan Sun, Feng Wu, Shipeng Li, Wen Gao) MPEG-4 Visual Related Voting Results M7874 M7875 M7876 M7877 M8016 M7969 Report of Studio Profile Voting (14496-2 FDAM 1) Report of Streaming Video Amendment Voting (14496-2 FDAM 2) Report of Reference Software (14496-5) Voting Report of Reference Software (14496-5 FPDAM 1) Voting Table of Replies on ISO/IEC 14496-4:2000/FDAM 1 Report of New Levels and Tools (14496-2 PDAM 3) Voting Activities in MPEG-7 The following issues related to MPEG-7 visual were addressed: Review and Approval of the Visual Ad Hoc Group Recommendations Inclusion of new technology into Visual Experimental Model (for version 2) Review of the input documents and planning of new Core Experiments for version 2 Technical work interface with System 91 Review and Approval of the Visual Ad Hoc Group Recommendations All AdHoc group recommendations were approved. Good progress achieved in Shape Sequence CE o Database enlarged o Two technologies participating merged the technologies o Significant improvement achieved, both in performance and functionality o Continue CE to test within the software XM model Excellent progress in VCE-2 on Face Recognition o Four technologies competing o M7952, M7953, M7993, M7997 o Face Database significantly enlarged with examples exhibiting pose and illumination variations o MPEG has the most comprehensive testing approach o Very good results presented – significant performance improvement over version 1. Two Core Experiments were discontinued due to lack of sufficient progress: Camera Parameters Descriptor and 3D coordinate system Descriptor. 4 Core Experiments approved for continuation (see below). Inclusion of new technology into Visual Experimental Model (for version 2) Review of the input documents and planning of new Core Experiments for version 2 4 Core experiments are defined (N4585): VCE-1: Development of a Shape Sequence Descriptor VCE-2: Face recognition descriptor VCE-3: Binary Representation of Visual Descriptors VCE-4: Illumination Independence for MPEG-7 Color Descriptors Review of NB comments on Part-8 All NB comments have been addressed and DOC issued. Review of the input documents The following input document were reviewed and appropriate action taken: 7914 7947 7948 7949 7950 7951 7952 Component-based 2nd-order ICA face descriptor The test result of the BiM S/W Verification of MPEG-7 Visual Descriptors Report of AHG on editing ISO/IEC PDTR 15938-8 Report of AHG on editing MPEG-7 Visual XM Editor's note on Study text of ISO/IEC PDTR 15938-8 MPEG-7 Visual XM 12.1 Results of the Face Recognition Descriptor Using a Confidence Factor 92 7953 7993 7994 7995 7997 7998 8012 8019 8021 8025 8104 8111 8158 8212 8216 Proposal of the Face Recognition Descriptor based on Fourier spectral Principal Component Analysis Report of VCE-6 on MPEG-7 Color Temperature Descriptor for Display Preference Consideration of illuminant independence in MPEG-7 Color Descriptor Implementation plan for MU reference software Face Recognition Descriptor Using the Embedded HMM with the 2nd-order Blockspecific Eigenvectors Consideration of illuminant independence in MPEG-7 Color Descriptor Comments on VCE-1 Core Experiment for shape-sequence descriptor Report of Core Experiment result on Shape Sequence Descriptor (VCE-1) Comments on face description Comments on face description Face recognition descriptor with new properties Report on Core Experiment VCE-5 Report of Core Experiment result on Shape Sequence Descriptor (VCE-1) Report of the AHG on Visual Core Experiments Known problems in MPEG-7 Visual (ISO/IEC 15938-3) Joint meetings with other groups The following joint meetings were held: a. Joint meeting with ISG on software implementation. All Video tools are fully integrated, performance of each tool has been checked and confirmed by two parties. A new schedule for software integration, including version 2 technology was approved. b. Conformance issues discussed with Systems, Audio, MDS Discussion on Profiles and Levels Profiles based on functionality, across part domains Levels based on complexity Still no clear notion of “conformance” due to problems with the definition of “use “of descriptors 93 Annex 8 Audio report Source: J. Herre, Substituting Chair, Audio Subgroup (S. Quackenbush) Opening of the meeting The MPEG Audio Subgroup meeting was held during the 59th meeting of WG11 in JeJu Island, Korea, Mar 11-15, 2002. The list of participants is given in Annex A-1. Administrative matters Approval of agenda The agenda, shown in Annex A-II, was discussed, edited and approved. Pattaya meeting report The Audio Subgroup Pattaya meeting report, December 2001, had been previously distributed by email and was approved. Allocation of contributions All contributions (see Annex A-IV) were allocated to the agenda and were discussed either in the task groups or in Audio plenary. The Chair brought other relevant documents from Requirements, Systems and MDS to the attention of the group. Communications from the Chair The Chair summarised the issues raised at the Sunday evening Chair’s meeting, proposed task groups for the week, and proposed agenda items for discussion in Audio plenary. Joint meetings The joint meetings with Audio over the course of the week are listed here and are reported on below. Group 1 Group 2 What Where When Time Audio ISG MPEG-7 XM Audio Tue 17:00integration Breakout 18:30 Video, MDS & Audio MPEG-7 profiles Requirement Wed 14:00Requirements s 15:30 Audio Video & MDS MPEG-7 Video Wed 15:30conformance 16:30 Audio Requirements MPEG-4 Profiles and Audio Thu 9:00Lossless Audio 10:00 Coding Audio MDS Multi-channel audio MDS Thu 11:00description 11:30 Audio ISG BWE tool complexity Audio Fri 10:0010:45 Received National Body Comments and Liaison matters 94 There were two relevant NB Comments and one relevant Liaison document, as shown below. Docume Title Source Author of nt Response 7966 Comment on MPEG-4 audio extension 1 Singapore NB Audio (Edler, Herre) 7976 Comments on MPEG-4/Audio Bandwidth Japan NB Audio (Edler, Extension Herre) 7881 Liaison to MPEG on Audio profiles M4IF Requirements & Audio (Pereira, Herre) Task Groups Five task groups were convened for the duration of the MPEG meeting, as shown in ANNEX-III. Results of task group activities are reported below. Record of Audio plenary, joint meetings and task group activities Audio plenary discussions Lossless coding: During audio plenary, a number of contributions related to the issue of a potential new work item on lossless audio coding were presented and discussed. After ongoing discussion on this topic over a number of recent AhG periods, it was understood that a decision had to be taken at the 59th MPEG meeting as to whether to adopt a new work item on lossless audio compression or to abandon the activity. Mr. Moriya presented the associated AhG report (7955). A number of contributions on the technical feasibility and potential applications of lossless audio coding were presented next, including 7956 (Lossless scalable audio coding based on MPEG-4 standard, Moriya), 7975 (Evaluation results of scalable lossless coding based on AAC, Nomura), 8024 (Evaluation Results of Scalable Lossless Audio Coding Based on MPEG-4 BSAC, Kim) and 8013 (Report on the audio lossless compression market investigation, Moriya). During the subsequent discussion it was agreed that sufficient evidence was given to indicate the technical feasibility and efficiency of a scalable system comprising a lossy coding core based on an MPEG-4 General Audio coder and an enhancement layer which will enhance the signal towards lossless reconstruction. In addition, it was felt that such a scalable approach would feature sufficient distinction over existing systems and would complement MPEG's existing general audio coding technology. It was further noted that the requirements from Digital Cinema call for lossless audio coding for archiving, and lossless or perceptually lossless coding for distribution purposes. Consequently, a new work item on lossless audio coding was adopted after a joint meeting with the requirements subgroup and positive assessment from their side (see section on joint meetings). An AhG will be started after the meeting to work on requirements for this work item until the next meeting. In the best case, a Call for Proposals could be drafted at the upcoming 60th meeting. A number of companies announced their support for the technical development process (NTT, NEC, Samsung, FhG, University of Wollongong, University of Nanyang), product deployment (NEC, Dolby, Samsung) or services (NTT) in case a work item on MPEG lossless Audio Coding was installed. Audio software & conformance status document: In order to also provide non-audio MPEG members with a better understanding of the current status of the audio reference software / conformance data, the audio subgroup will produce a summary document as a container for this type of information (see output document N4601). This may evolve into a 'living' document for purposes of internal documentation. Names of MPEG-4 Audio Extensions: Official names were decided for the two extensions to MPEG-4 audio currently under development: 95 1. "Backward Compatible Bandwidth Extension for General Audio Coding" (ISO/IEC 144963:2001 Amendment 1), MPEG-4 Audio Extension 1 2. "Parametric Coding of High Quality Audio" (ISO/IEC 14496-3:2001 Amendment 2), MPEG-4 Audio Extension 2 Joint Meetings Joint meeting with ISG on MPEG-7 XM Integration In a joint meeting with ISG the status of integration of the MPEG-7 Audio tools in the MPEG-7 XM was examined. A number of issues still need to be addressed, including outstanding tool documentations and the extraction tools. It was pointed out that further work on the extraction tools is required such as to: Provide some documentation of each tool using the dummytype template file Make usage of each extractor self-documenting (e.g. batch file or MATLAB wrapper 'startextract.m/.bat') Enable integration of extraction tools and XM application (extractor should output XML, also required for conformance testing) A workplan document will define next steps to be performed to advance the integration. Joint meeting with Video, MDS and Requirements on MPEG-7 Profiles Acknowledging the need for a better understanding of the notion of ‘profiles’ in MPEG-7, two contributions related to profiling (M7918, M8038) were presented and inspired extensive discussion. Two key questions evolved: How to chose the profile (i.e. subsets of MPEG-7) ? How to express / address the subset of elements in an XML-based environment (the “mechanics”)? Clearly, MPEG-7 may differ from previous MPEG technologies (which related to coding) in “what one has to be able to rely on” – a certain set of descriptions to be present in a description or applications being able to use certain descriptive elements or … ? In the past (MPEG coding), it was mandatory for the decoder to fully support a specified set of tools, while the encoder did not need to support such a full support. In MPEG-7 a “decoder” in an application does not necessarily need to exploit all elements present in a description. One possibility might be to specify profiles based on fixed sets of elements being present in the MPEG-7 description data in order to achieve interoperability. Some basic agreements were reached, e.g. Profiles will be defined across part boundaries (Audio/Video/MDS) A profile relates to a set of functionalities related to a certain area of applications Levels will address the issue of complexity (what does “complexity” mean in this context – extraction and/or matching complexity? In both cases this not only depends on the tools used but also on their usage) A summary of the achieved consensus will be given in the resolutions of the requirements subgroup. Further work on this issue will happen within a requirements AhG. Joint meeting with Video and MDS on MPEG-7 Conformance The NB comments on the MPEG-7 conformance FCD were reviewed and responses were drafted. Further editing of the audio part of the conformance document took place in the corresponding audio task group (see below). Joint meeting with Requirements on MPEG-4 Profiles and Lossless Coding An answer to the M4IF liaison input (doc. 7881) on MPEG-4 profiles was drafted. With respect to a decision on a further work item on lossless audio coding, the corresponding contributions were 96 briefly summarized and the previous discussion within the audio subgroup was reviewed (see section on plenary discussion). Based on these inputs the requirements subgroup supported the recommendation for installing lossless audio coding as a further work item. Joint meeting with MDS on description of multi-channel audio signals It was acknowledged that the handling of stereo and multi-channel audio signals may not be sufficient within MPEG-7. Although there are currently MDS mechanisms which allude to the notion of audio channels, this construct cannot be used to allow description of common constellations, such as description of a mono signal downmix or descriptors describing interchannel properties (cross-correlation). A proposed AttributeGrp addressing these concerns was included in the MDS Experience Model XM output document. The issue will be pursued further within the AhG on MPEG-7 Version 2 to be installed after the meeting. Joint meeting with ISG on Bandwidth Extension tool complexity The evaluation of computational complexity for the RM0 Bandwidth Extension (BWE) tool which had been conducted previously (see task group activities) was reviewed in a joint meeting with the Implementation Studies Group. It was agreed that further analysis will be carried out on the basis of the algorithmic structure of the tool. Task group discussions MPEG-4 Extension 1 Core Experiments (B. Edler) The task group reviewed the technical description of the RM0 BWE tool (N7943) and edited the Working Draft on Backward Compatible Bandwidth Extension for General Audio Coding (ISO/IEC 14496-3:2001 Amendment 1). The workplan for MPEG-4 Audio Extension 1 Core Experiments was updated. The relevant contributions were reviewed: 1. The AhG report (N8132) 2. 2 NB comments on issues of low delay and reduced complexity BWE (N7966, N7976) 3. Indication of potential core experiments on low delay and reduced complexity BWE (N7967) The complexity of the RM0 BWE tool was discussed intensively. Coding Technologies provided complexity figures of a 24 bit real time implementation, which were appended to the workplan document for further reference. After a discussion about specifying acceptance criteria for reduced complexity BWE tools, it was decided, not to include fixed rules for a final acceptance in the workplan. Potential CEs on reduced complexity BWE have to provide evidence for possible acceptance. Regarding potential variants, the group agreed, that combinations of low delay BWE with AAC types other than AAC-LD would not be useful. Therefore acceptance criteria for the performance of AAC-LD/BWE combinations in comparison to AAC-LD had to be set up. The group agreed that the initial performance targets for the BWE work item apply, that is the coder/BWE system must perform at least as good as the coder without BWE at a 25% higher bitrate. Due to the difference in efficiency between AAC and AAC-LD, this translates into a comparison between AAC-LD/BWE at 32 kbps/ch and AAC-LD at 40 kbps/ch. Work will be continued in an ad-hoc group on Extension 1/2 Core Experiments MPEG-2 AAC, Ref Sw and Conformance (R. Sperschneider) A study on the DCor 1for MPEG-2 Part-7 (AAC) was prepared. Draft Corrigenda for MPEG-2 Part-4 (AMD 1 & AMD 3, AAC Conformance) and MPEG-2 Part-5 (AMD 1, AAC Software) were prepared and will be delivered to the SC29 secretariat at the end of the editing period. All AAC conformance test sequences are now available. MPEG-4 Audio Text, Ref Sw and Conformance (M. Väänänen, B. Edler, R. Sperschneider) 97 A study on the DCor 1for MPEG-4 Part-3 was prepared. Draft Corrigenda for MPEG-4 Part-4 (Audio V1 and V2 Conformance) were prepared and will be delivered to the SC29 secretariat at the end of the editing period. The status of the MPEG-4 conformance test sequences was updated. All AAC test sequences reused from the MPEG-2 Conformance are now available. The review of the reference software documentation (README_usage) was delegated to the appropriate AhG. MPEG-7 Core Experiments and Conformance (J. Bitzer, J. Herre) The task group reviewed following input documents: 1) Report of AhG (M8036) 2) CE Cross Check (M7957) Result: The proposed descriptor for AudioSignalQuality is useful and presents a significant enhancement of the WD document. 3) Editing Notes on WD (M8031) Result: Enhancement of WD 4) Multichannel Attribute Group (M8034) Result: It was acknowledged that the handling of stereo and multi-channel audio signals is not clear within MPEG-7. A joint meeting with the MDS subgroup was scheduled for further discussion. The Audio part of the MPEG-7 conformance CD was revised according to the NB ballot comments received and the ‘Status and Workplan’ document for MPEG-7 Audio conformance was updated by adding/defining a number of tasks, responsibilities and milestones. The ‘status and workplan’ document for XM integration was updated and the software on the MERL ftp-site was reviewed. Information on the availability of software and conformance bitstreams was gathered. MPEG-2 Layer III Issues (K. Brandenburg) The adhoc group report of the Adhoc Group on MPEG-2 Audio Reference Software identifies several small inconsistencies and missing definitions within MPEG-1 and MPEG-2 (13818-3) audio, especially errors in the reference software. The inconsistencies include one obvious typo (“right” instead of “left”, the correct word is clear from the same and other clauses) in 11172-3 clause 2.4.3.4.9.3. The task group recommends: to continue the adhoc group as recommended in the adhoc group report (m7978.doc) to start work on a draft corrigendum of 13818-5 to emphasize that the errors and incompleteness in the specification (11172-3 and 13818-3) do not affect audio quality in any way since in all practical cases the error condition would probably not be reached and, if otherwise, the resulting signal differences would be inaudible Meeting deliverables Press statement An outline of the Audio part of the press statement was prepared and approved. Dispositions of Comments There DoC on MPEG-7 conformance CD was written and returned to the NBs via the MDS group.. Responses to Liaison and NB comments A liaison statement from M4IF on MPEG-4 Audio profiles was presented, discussed and answered together with the requirements subgroup. Responses to two NB comments on the complexity of the RM0 bandwidth extension tool (N7966, N7976) were drafted. Both responses to liaison and NB comments were returned via the Liaison group. 98 Recommendations for final plenary A list of Audio recommendations were reviewed and approved. Establishment of new Ad-hoc Groups The following ad-hoc groups were proposed for establishment by the Audio subgroup: Title Chair Jens Spille AHG on MPEG-2 Audio Reference Software AHG on MPEG-2 AAC Ralph Sperschneider AHG on MPEG-4 Audio DCorr Text and Reference M. Väänänen, H. Software Purnhagen AHG on Audio part of MPEG-4 Conformance R. Sperschneider AHG on MPEG-4 Audio Extension 1 Core Experiments S. Quackenbush AHG on MPEG-7 Audio J. Bitzer, J. Herre AHG on Audio part of MPEG-7 Conformance I. Wolf, J. Flaks AHG on Requirements and methods for MPEG-4 Lossless Takehiro Moriya, Audio Coding Fernando Pereira No. Mtg 4616 No 4617 Yes Yes 4618 4619 4620 4621 4622 4623 Yes Yes Yes Yes Yes Approval of output documents All output documents, shown in Annex-IV, were presented in Audio plenary and were approved. Future activities Schedule of future meetings Ad Hoc group meetings are shown in the table listing the Ad Hoc groups. Agenda for next meeting The agenda for the next MPEG meeting, shown in Annex V, was reviewed and approved. All other business There was none. Closing of the meeting The Chair thanked everyone for their contributions throughout the week. Audio plenary was closed at 12:20hrs. 99 Annex A-I: Participants First Name Joerg Last Name Country Affiliation e-mail address Bitzer DE j.bitzer@hda.de Ian Burnett AUS Matt Uwe SangWook Kristofer Fellers Jost Kim USA UK KR Houpert Digital Audio Univ of Wollongong Dolby Canon Samsung Kjörling S kk@codingtechnologies.com Marc NL Stefan Klein Middelink Meltzer Coding Technologies Philips mlz@codingtechnologies.com Takehiro Sua-Hong Werner Ralph Mauri Moriya Neo Oomen Sperschneider Väänänen JP SG NL DE FIN David Virette FR Ingo Wolf DE Jason Juergen Karlheinz Christian Pierrick Flaks Herre Brandenburg Neubauer Philippe USA DE DE DE FR Patrice Collen FR Toshiyuki Manhe Jeongil Byungsik Bernd Masahiro Kok Seng Naoya Takeshi Nomura Park Seo Yoon Edler Iwadare Chong Tanaka Norimatsu JP KR KR KR DE JP SG JP JP Coding Technologies NTT Panasonic Philips FhG IIS-A Nokia Res. Center France Telecom R&D T-Nova Berkom Dolby FhG-IIS FhG AEMT FhG-IIS-A France Telecom France Telecom NEC ETRI ETRI ETRI Uni Hannover NEC Panasonic Matsushita Matsushita DE 100 l.burnett@elec.uow.edu.au mcf@dolby.com uwe@cre.canon.co.uk sangwookkim@samsung.com Marc.Klein.Middelink@philips.com Moriya.takehiro@lab.ntt.co.jp shneo@psl.com.sg Werner.oomen@philips.com sps@iis.fhg.de mauri.vaananen@nokia.com david.virette@francetelecom.com wolfi@t-systems.com jsf@dolby.com hrr@iis.fhg.de bdg@iis.fhg.de neu@iis.fhg.de pierrick.philippe@rd.francetelecom.com patrice.collen@rd.francetelecom.com t-nomura@ccm.cl.nec.co.jp mano@etri.re.kr seoji@etri.re.kr bsyoon@etri.re.kr edler@tnt.uni-hannover.de iwadare@cm.cl.nec.co.jp kschong@psl.com.sg natanaka@arl.drl.mei.co.jp norima2@arl.drl.mei.co.jp Annex A-II: Agenda for the Jeju Audio Meeting Agenda Item 1. Opening of the meeting 2. Administrative matters 2.1. Approval of agenda 2.2. Approval of Pattaya meeting report 2.3. Allocation of contributions 2.4. Communications from the Chair 2.5. Joint meetings 2.6. Review of AhG reports Contributions 7955 7961 7978 8036 8115 8119 8132 8054 2.7. Review of task group mandates 2.8. Received national body comments and liaison matters 2.9. Audio plenary topics 3. Task group activities 3.1. MPEG-4 Extension 1 Core Experiments 3.2. MPEG-2 AAC, Ref Sw and Conformance 3.3. MPEG-4 Audio Text, Ref Sw and Conformance 3.4. MPEG-7 Core Experiments and Conformance 3.5. MPEG-2 Layer III Issues 4. Discussion of unallocated contributions 7881 7966 7976 8132, 7943 7967 8115, 8116 8117 8118 7961, 7986 8120 8121 8122 8123 8036, 7957, 8031, 8034, 7917, 8038 7978 Profiles & Levels: (7872, 7881) Lossless Audio: (7956 7975 8013, 8024) 5. Meeting deliverables 5.1. Press statement 5.2. Dispositions of comments 5.3. Responses to NB comments 5.4. Liaison statements 5.5. Recommendations for final plenary 5.6. Establishment of new Ad-hoc groups 5.7. Approval of output documents 6. Future activities 6.1. Agenda for next meeting 7. A.O.B. 8. Closing of the meeting 7966, 7976 101 Annex A-III: Task Groups 1. MPEG-2 AAC Chair Ralph Sperschneider Mandates: 1.1. Review contributions 1.2. Update Study on ISO/IEC 13818-4:1998/Amd 1:1998/DCor 1 1.3. Update Study on ISO/IEC 13818-4:1998/Amd 3:2000/DCor 1 1.4. Update Study on ISO/IEC TR 13818-5:1997/Amd 1:1999/DCor 1 1.5. Update Status and Workplan on AAC Conformance 1.5.1. Gather remaining conformance test data 1.6. Create status document for MPEG-2 Audio reference software/conformance data 2. MPEG-4 Audio Text, Reference Software and Conformance Chairs Mauri Väänänen, Bernd Edler, Ralph Sperschneider, Mandates: 2.1. Review contributions 2.2. Gather any comments on ISO/IEC 14496-3:2001/DCor 1 (ballot on 2002-04-28) 2.3. Review README_usage for mp4AudVm 2.4. Update Study on Audio Part of ISO/IEC 14496-4:2000/DCor X 2.5. Update Study on Audio Part of ISO/IEC 14496-4:2000/Amd1:2001/DCor X 2.6. Update Status and Workplan for MPEG-4 Audio Conformance 2.7. Create status document for MPEG-4 Audio reference software/conformance data 3. MPEG-4 Extension 1 Chair Bernd Edler Mandates: 3.1. Review contributions 3.2. Update Workplan for MPEG-4 Extension 1 Core Experiments 3.3. Create Working Draft Text for Bandwidth Extension Part 4. MPEG-7 Core Experiments, Reference Software and Conformance (15938-7, FCD Mar 02) Chair Juergen Herre, Jörg Bitzer Mandates: 4.1. Review contributions 4.2. Review status of reference software, Harmonization 4.3. Update Workplan for MPEG-7 Core Experiments 4.4. Update Audio Contribution to MPEG-7 Conformance 4.5. Update Status and Workplan for MPEG-7 Audio Conformance 4.5.1. Conformance FTP site and associated conformance tools 4.5.1.1. DDL parser 4.5.1.2. BIM encoder and decoder 4.6. Create status document for MPEG-7 Audio reference software/conformance data 4.7. Review status of Audio part of MPEG-7 Overview Document (doc. 7933) 4.8. Consider aspects of MPEG-7 Audio profiling 4.9. Review Version 2 WD w.r.t. Version 1 technology components 5. MPEG-2 Layer-3 Audio Reference Software Issues Chair Karlheinz Brandenburg Mandates: 102 5.1. Review contributions 5.2. Make recommendations to Audio plenary 5.3. Create a workplan on for corrections, if applicable 103 Annex A-IV: Input and Output Documents Contributed documents The following documents were contributed to the Audio Subgroup or were related to audio subgroup business and were considered during this meeting: Available Group Title Date Source No. Section 20011210 MPEG-4 Levels for MPEG-4 Audio Profiles 7872 01/12 Requirements Fernando Pereira (editor) 20020129 MPEG-4 Liaison Statement from MPEG-4 Industry Forum to WG 11 on MPEG-4 Audio Profiles (SC 29 N 4595) 02/01 MPEG-4 Industry Forum via SC 29 Secretariat 7881 Liaison 20020301 MPEG-7 MPEG-7 Interoperability Test Bed (M7ITB) Status Report 02/02 Wo Chang 7917 General/All 20020305 MPEG-4 Technical Description of Coding Technologies’ Proposal for MPEG-4 v3 General Audio Bandwidth Extension: Spectral Band Replication (SBR) 02/02 Kristofer Kjörling, Andreas Ehret, Per Ekstrand, Jonas Engdegård, Fredrik Henn, Lars Liljeryd, onas Rödén, Michael Schug, Lars Villemoes 7943 Audio 20020305 MPEG-4 Report of AHG on issues in lossless audio coding 02/02 Takehiro Moriya 7955 Audio 20020305 MPEG-4 Lossless scalable audio coding based on MPEG-4 standard 02/02 Takehiro Moriya, Akio Jin 7956 Audio 20020228 MPEG-7 Verification of CE AudioQualityDS for MPEG-7 Version 2 02/02 Ingo Wolf, Bernhard Feiten, Jason Flaks 7957 Audio 104 20020301 MPEG-4 Report of the AhG on MPEG-4 Audio Corrigendum and Reference Software 02/02 Mauri Vaananen, Heiko Purnhagen 7961 Audio 20020301 MPEG-4 Comment on MPEG-4 audio extension 1 03/02 National Body of Singapore 7966 Audio 20020305 MPEG-4 Proposal of an additional low-complexity and low-delay technology for BWE tool 03/02 Takeshi Norimatsu, Naoya Tanaka, Mineo Tsushima (Matsushita), Masahiro Iwadare, Masahiro Serizawa, Toshiyuki Nomura, Yuichiro Takamizawa (NEC), Sua Hong Neo, Kok Seng Chong (Panasonic Singapore Lab.) 7967 Audio 20020305 MPEG-4 Evaluation results of scalable lossless coding based on AAC 03/02 Toshiyuki Nomura, Yuichiro Takamizawa 7975 Audio 20020305 MPEG-4 Comments on MPEG-4/Audio Bandwidth Extension 03/02 JNB 7976 Audio 20020305 MPEG-2 AHG Report on MPEG-2 Audio Reference Software 03/02 Jens Spille 7978 Audio 20020305 MPEG-4 Comments on MPEG-4 HILN Text, Reference Software, and Conformance 03/02 Bernd Edler, Heiko Purnhagen, Nikolaus Meine 7986 Audio 20020312 MPEG-4 Report on the audio lossless compression market investigation 03/02 Xiao Lin, Takehiro Moriya 8013 Audio 20020312 MPEG-4 Evaluation Results of Scalable Lossless Audio Coding Based on MPEG-4 BSAC 03/02 Doh-Hyung Kim, Jung-Hoe Kim, Sang-Wook Kim 8024 Audio 20020312 MPEG-7 Editing Notes for Audio Quality Descriptors 03/02 Joerg Bitzer, Stefan Kudras 8031 Audio 105 20020312 MPEG-7 Proposal for a Multichannel Attribute Group 03/02 Joerg Bitzer, Stefan Kudras 8034 Audio 20020312 MPEG-7 Report of the ad-hoc group on MPEG-7 Audio 03/02 Joerg Bitzer 8036 Audio 20020311 MPEG-7 MPEG-7 Profiles and Levels using XML Namespaces 8038 03/02 Requirements Eric Rehm 20020311 MPEG-7 MPEG-7 AHG Report on Audio Conformance 03/02 Frank Klefenz 8054 Audio 20020311 MPEG-2 AHG Report on MPEG AAC 03/02 Ralph Sperschneider, on behalf of the AhG on MPEG AAC 8115 Audio 20020310 MPEG-2 Study on Text of ISO/IEC 13818-4:1998/Amd 1:1998/Dcor 1 03/02 Ralph Sperschneider, on behalf of the AhG on MPEG AAC 8116 Audio 20020310 MPEG-2 Study on Text of ISO/IEC 13818-4:1998/Amd 3:2000/Dcor 1 03/02 Ralph Sperschneider, on behalf of the AhG on MPEG AAC 8117 Audio 20020310 MPEG-2 Status and Workplan for AAC Conformance 03/02 Ralph Sperschneider, on behalf of the AhG on MPEG AAC 8118 Audio 20020311 MPEG-4 AHG Report on MPEG-4 Audio Conformance 03/02 Ralph Sperschneider, on behalf of the AhG on MPEG AAC 8119 Audio 20020310 MPEG-4 Study on Text of ISO/IEC 14496-4:2000/Dcor 1 03/02 Ralph Sperschneider, on behalf of the AhG on MPEG-4 Audio Conformance 8120 Audio 20020310 MPEG-4 Study on Text of ISO/IEC 14496-4:2000/Amd 1:2001/Dcor 1 03/02 Ralph Sperschneider, on behalf of the AhG on MPEG-4 Audio Conformance 8121 Audio 106 20020310 MPEG-4 Status and Workplan for MPEG-4 Audio Conformance 03/02 Ralph Sperschneider, on behalf of the AhG on MPEG-4 Audio Conformance 8122 Audio 20020310 MPEG-4 Comments on Text of ISO/IEC 14496-3:2001/DCor 1:2002 03/02 Ralph Sperschneider, on behalf of the AhG on MPEG-4 Audio DCor Text and Reference Software 8123 Audio 20020313 MPEG-4 Report of the AHG on AHG on MPEG-4 Audio Extension 1 Core Experiments 03/02 S. R. Quackenbush 8132 Audio Output Documents The Audio Subgroup produced the following output documents. Those approved for public release by WG11 are indicated by the entry “Yes.” Title No. TB P Status of MPEG-Audio Conformance and Software Packages 4601 No Study on Text of ISO/IEC 13818-7:1997/DCor 2 4602 No Text of ISO/IEC 13818-4:1998/Amd 1:1998/DCor 1 4603 No Text of ISO/IEC 13818-4:1998/Amd 3:2000/DCor 1 4604 No Text of ISO/IEC TR 13818-5:1997/Amd 1:1999/DCor 1 4605 No Study on Text of ISO/IEC 14496-3:2001/DCor 1 4606 No Text of ISO/IEC 14496-4:2000/DCor2 (Audio Part) 4607 No Text of ISO/IEC 14496-4:2000/Amd1:2001/DCor1 (Audio Part) 4608 No Status and Workplan for MPEG-4 Audio Conformance 4609 No Workplan for MPEG-4 Extension 1 Core Experiments 4610 No WD on Backward Compatible Bandwidth Extension for General Audio Coding No 4611 (ISO/IEC 14496-3:2001 Amendment 1) Status and Workplan for MPEG-7 Audio Extension 1 Core Experiments 4612 No Audio Contribution to Text of MPEG-7 Conformance CD 4613 No Status and Workplan for MPEG-7 Audio Conformance 4614 No WD of MPEG-7 Audio Extension 1 4615 No 107 Annex A-V: Agenda for the Fairfax Island MPEG Audio Meeting Agenda Item 9. Opening of the meeting 10. Administrative matters 10.1. Approval of agenda 10.2. Approval of Jeju meeting report 10.3. Allocation of contributions 10.4. Communications from the Chair 10.5. Joint meetings 10.6. Review of AhG reports 10.7. Review of task group mandates 10.8. Received national body comments and liaison matters 10.9. Audio plenary topics 11. Task group activities 11.1. MPEG-2 Reference Software 11.2. MPEG-4 Extensions 1 & 2 Core Experiments 11.3. MPEG AAC 11.4. MPEG-4 Audio Conformance 11.5. MPEG-7 Core Experiments 11.6. MPEG-7 Conformance 11.7. Lossless Audio Coding 12. Discussion of unallocated contributions 13. Meeting deliverables 13.1. Press statement 13.2. Dispositions of comments 13.3. Responses to NB comments 13.4. Liaison statements 13.5. Recommendations for final plenary 13.6. Establishment of new Ad-hoc groups 13.7. Approval of output documents 14. Future activities 14.1. Agenda for next meeting 15. A.O.B. 16. Closing of the meeting 108 Contributions Annex 9 SNHC report Author: Euee S. Jang, Chair of SNHC subgroup SNHC Meeting Summary SNHC objectives were: to discuss and evaluate the AFX CE results and update VM to promote AFX into the PDAM stage to discuss the AFX S/W development and produce workplan till next meeting. and to review the FAQ of SNHC and e-mail reflectors. SNHC Objectives & Work Items The outline of more detailed meeting objectives and work is given below: MPEG-4 Ext. 4 AFX A. Animation Framework eXtension 1. PDAM study 2. Review CE contributions 3. Update VM & WD 4. S/W development SNHC Contributions & Related Review AFX – Interpolator Compression 1. M7873, “Technical Description of Interpolator Compression Tools”, Do Kyoon Kim, Sang Oak Woo, Seok Yoon Jung, Gyeong Ja Jang, ShinJun Lee, Mahnjin Han, Euee S. Jang 2. M7902, “Result of Core Experiment on Interpolator Compression”, Michael Steliaros AFX – Subdivision Surfaces 3. M7960, “Complexity assessment of MPEG-4 mesh subdivision tools”, Nicolaas Tack, Gauthier Lafruit”, Eric Delfosse, Gauthier Lafruit 4. M7984, “Wavelet Surface bitstream proposal”, Patrick Gioia AFX – PDAM Study 5. M8008, “FNB comments for the JeJu meeting”, FNB 6. M8011, “Study of the 14496-1:2001/PDAM4”, FNB AFX – View-dependent scalability 7. M8106, “Proposal of Unified Backchannel syntax for view-dependent 3D transmission.”, Gauthier Lafruit, Alexandru Salomie, Eric Delfosse, Rudi Deklerck, Peter Schelkens, Jan Bormans, Jan Cornelis 3D Video Requirements 8. M8107, “Requirements for Standardisation of 3D Video”, Takashi Matsuyama (tm@i.kyoto-u.ac.jp), Ryozo Yamashita AFX – MeshGrid 9. M8126, “MeshGrid stream description”, Alexandru Salomie, Rudi Deklerck, Gauthier Lafruit, Adrian Munteanu, Ilse Ravyse, Peter Schelkens, Jan Cornelis AFX – Skin and Bone 10. M8151, “BBA within an AFX profile”, Marius Preda and Françoise Prêteux 109 (INT) AFX – IBR 11. M8037, “Result of Core Experiment on Depth Image-based Representation”, Mahnjin Han, et. al. Output Document Editors SNHC Homepage review VM/PDAM Editor AFX S/W development plan MPEG-4 overview (AFX) AFX CE Editor SNHC FAQ review Collection of Presentations Publication coordinator Mahnjin Han Mahnjin Han, Francisco Moran, Michael Steliaros, Alexandru Salomie, Alain Mignot, Marius Preda, Patrick Gioia, Michael Steliaros, James D.K. Kim Michael Steliaros, CD editors Marius Preda Francisco Moran, Gyungja Jang, Shinjun Lee Mahnjin Han Euee S. Jang, Francisco Moran, Michael Steliaros, Mahnjin Han 110 SNHC Schedule SNHC group had the following work schedule along with joint meetings with other groups: Friday TIME Monday Tuesday Wednesday Thursday 9:00 CE review Resolutions MPEG MPEG plenary AFX Forum -Int. Compress. VM/CD Review plenary -Sub. Surfaces SNHC FAQ -MeshGrid 10:00 AHG doc. -VD 3D trans. 11:00 -Skin/Bone 12:00 SNHC docs. -IBR CE text review SNHC Hompage S/W plan Lunch Lunch Lunch Lunch 13:00 14:00 Lunch PDAM review MPEG-4 AFX-Aw MPEG plenary -FNB comment Conformance Day. -Bitstream bitstreamsAFX SW Syntax where??? Implementatio -PDAM (VTC) n overview System proposal MPEG4 Ref. summary SW 15:00 Roll call JM (Systems) JM (Systems) Agenda AFX PDAM AFX PDAM review SNHC Editors MPEG4 Ref S/W 16:00 WEMP4 CSVT & WEMP4 17:00 JM PDAM Study (Req/Video) – review 3D Video 18:00 19:00 Chairs Meeting Social Event 24:00 Joint meetings Group 1 SNHC SNHC SNHC Group 2 Video, Req Systems Video, Req What 3D Video AFX 3D Video Where Requirements Sys(BIFS) Req SNHC Systems AFX Systems 111 Day Mon Wed Thur s Thur s Time 5/6 3:30/5:30 2/4 :30 3/4 Discussion MPEG-4 Animation Framework eXtension (AFX) AFX Technical Review: During this meeting, most of the time has been spent to review the text of PDAM. Most of the technologies in the PDAM have been reviewed again for the clarity and conciseness. Thorough review on bit stream syntax and node definition turned out to be very effective on reshaping the PDAM text. The changes are all incorporated into the study document (N4627) Subdivision Surfaces: Complexity analysis has been made (M7960) and reported the complexity acceptable. More discussion on the bit stream syntax and node definition is conducted. Interpolator Compression: Continuing core experiments: A2 Subdivision surfaces A8 Multi-texturing A9 View-dependent coding A10 Physics-based animation Verification Model 6.0 and PDAM 1.0: VM Status: i. VM 6.0 has been updated both technically and editorially (N4626). PDAM Status: i. Solid modeling is newly included in the WD because it has been successfully finished in the CE. ii. From this meeting, the text of WD will be the text of PDAM 1.0 with a few exceptions described below. iii. Curve interpolator is to be removed, since NURBS interpolator has a generic format to support this functionality. iv. SFVec4f, MFVec4f: In order to support new tools in solids, it was necessary to define these new nodes. Since this is relevant with the general structure of BIFS, a joint meeting with Systems has been a good practice to understand the issue jointly. And more analysis on the impact of the new nodes will continue till Jeju. AFX S/W implementation: S/W implementation is continuing the progress. Further workplan can be found in N4628. AFX Forum As an outside activity, the discussion on AFX Forum has been launched at this meeting with the following details. Objective •Initiate the discussion among the participating companies. •Identify the goals and workplan for the future. Discussed issues •AFX-based technologies & applications •Interested companies •Licensing Preparation Committee Established •Chairs: Euee S. Jang (Hanyang Univ.) & Omid Moghadam (Intel) Future plan •Meeting on May 4 (Fairfax) •E-mail reflector: afx-forum@gti.ssr.upm.es (members only) SNHC Presentations The electronic presentation materials are available in the SNHC homepage (http://www.sait.samsung.co.kr/snhc). 112 SNHC FAQ update FAQ 7.0 of SNHC was reviewed by SNHC members and got fixed with new Q&As (N4624). 113 Annex 10 Test group report Source: Vittorio Baroncini, Chair Introduction During the 59th MPEG meeting, held in Jeju (Ko), the Test Subgroup produced the following documents: Revision of Dynamic Test 3 in MPEG-4 Visual Fine Granularity Scalability Tools Verification Test Plan (N4581), Furthermore the following AhG have been established: AhG on Dcinema, chaired by W. Husak; E. Edwards (doc N4590), AhG on Fine Granularity Scalability, chaired by J.-R. Ohm, W. Li, K. Kim (doc N4587). Fine Granularity Scalability Verification tests Document N4581 describes the prolonging of the, formerly agreed, schedule of the Fine Granularity Scalability verification test. In the previous FGS verification test plan (N4456), three different dynamic tests under variable network conditions were defined. Due to implementation reasons (i.e. the use of a real-time system for the tests), it had been decided that the dynamic tests category iii) (IP network simulator with best effort and error correction) should be performed in the FGS-only mode (without FGST) in contrast to dynamic tests i) (IP network with priority) and ii) (IP network with best effort). During the preparation of the FGS verification test report in the MPEG Jeju meeting, it was found that it was hard to compare these results, as apparently the reactions of the tests subjects were biased due to the lower temporal resolution. It was therefore decided to repeat the dynamic test related to “IP network simulator with best effort and error correction”, with the same FGST coder settings that had already been used in tests i) and ii). Finally it has been decided that, the report of the new tests, together with all the test results of the previous tests, will be presented at the 60th MPEG meeting and approved for publication at the meeting. Activity on Digital Cinema The Requirements, Video and Test groups undertook several activity on the Digital Cinema. As first it has been recognised that, according to the number of requirements received by some relevant organisations (e.g. SMPTE, NATO etc.), the existing requirements document on Dcinema need to be revised. The existence of new requirements lead to the decision to begin a new video and test joint activity (conducted by an informal drafting group) aiming at the definition of the rules for a “Call for Proposal” for contribution to the Digital Cinema profile. To better achieve results in this area, the AhG on digital cinema has been renewed (doc. N4590) chaired by W. Husak and E. Edwards, with the following mandates: 1. Continue the collection of inputs related to requirements on Digital Cinema to improve the Digital Cinema Requirements document 2. Improve the “expert viewing” methodology for Digital Cinema applications, as described in doc. N4458, 3. Continue the collection of the material necessary to run further testing activities, 4. Prepare an input document to the next meeting describing the Draft Test Plan of further testing activities. 114 The above AhG will meet at Burbank (CA) on 2002-05-1-2, with some representative of the Hollywood studios, to improve the requirements and the definition of the forthcoming competition tests. 115 Annex 11 ISG report Source: Editor: ISG Chair Marco Mattavelli (EPFL) Overview The main work items of the Implementation Studies Subgroup in Jeju are: 1. MPEG-7 XM reference software development for video/audio descriptors and Descriptor Schemes and related activity for the MPEG-7 Part 6: Reference Software for Version 1 and Version 2. 2. The acknowledgement of the first submission of HDL module received for the MPEG-4 “Part 9 Reference hardware description”. 3. The review of the first complexity analysis of the AVC codec and the draft of a guideline document for further contributions to complexity analysis. Input contributions w.r.t. the above items are summarized according to the following table: Contributions M8108 “Report of AHG on XM Development”. M8030 “Report of the AHG on MPEG-4 Part 9 "Reference Hardware Description" M8028 “Initial Memory Complexity Analysis of the AVC Codec” Stephan Herrmann Marco Mattavelli, Robert Turney Kristof Denolf and Carolina Blanch Detailed Report MPEG-7 XM reference software development Three joint meetings have been taken place during the week between the ISG team involved in the XM development and video, MDS and audio. Discussions have started with the Video group with the review of the current status of the integration of the XM. The main outcomes of the discussions can be summarized as follows: Joint Meeting ISG-Video The status of the integration of video Ds is excellent. All Ds are fully integrated, documented and verified. The only possible improvement on the quality of the software is to verify the compilation warnings so as to prevent possible interface violations. Commitments have been taken to proceed with that verification by next meeting. A work-plan for the integration of Ds for version 2 has been defined (N4573). Joint meeting ISG-Audio 116 Audio group and ISG verified the status of the submission and the integration. All modules have been finally submitted. Some documentation modules are still missing and most of the modules need functional verification. Commitments have been taken to complete the missing tasks by next meeting. Joint ISG-MDS All modules are integrated, but some of them are not compiling correctly on both platforms. Commitments have been taken to solve the problems. Two new DSs will probably be included in version 2 Meeting outcomes about Reference Software development In conclusion main achievements of the meeting concerning the Reference Software development are: The update of Work schedules for the XM integration (video tools, audio tools and DS) including both Version 1 and Version 2. Integration of Version 2 tools will start after the CVS repository will be transferred to the TUM. Reference hardware description for MPEG-4 First module for MPEG-4 part 9 “Reference hardware description” has been submitted on the ftp site. It is a DCT/IDCT MPEG conformant module. There are commitments for the submission of other modules for the next meetings. Complexity analysis of AVC codec The first contribution on the complexity of the AVC codec has been reviewed. On the basis of this contribution ISG acknowledge that the complexity analysis of video codecs is a difficult and timeconsuming task. Therefore contributions coming from different sources and using different methodologies must be based on the same experimental settings so as to validate other contributor results and help in a synergic way to build a complete picture of the codecs complexity under analysis. For these reasons a guideline document containing detailed recommendations (Guidelines and work-plan for the complexity analysis of the AVC reference software N4571) has been drafted and an apposite ad hoc group has been established to proceed with such analysis N4576. 117 Annex 12 Liaison report Source: Jan Bormans, Chair The Liaison Group considered the following input documents: Input Contribution Number M7878 M7881 M7897 M7898 M7907 M7908 M7909 M7938 M7939 M7940 M7941 M7954 M7958 M7965 M7966 M7968 M7976 M7981 M7996 Title CEN/ISSS Electronic Commerce Workshop; Frameworks, Architectures and Models for Electronic Commerce Group; CEN Workshop Agreement 14228: 2001; Summaries of some Frameworks, Architectures and Models for Electronic Commerce; Draft Revision 1.b (for version 2); January 2002 Liaison Statement from MPEG-4 Industry Forum to WG 11 on MPEG-4 Audio Profiles IEC CD 60958-1 (2nd Edition): Digital audio interface -- Part 1: General [IEC 100/466/CD] IEC CDV 61937-1 (2nd Edition): Digital audio -- Interface for non-linear PCM encoded audio bitstreams applying IEC 60958 -Part 1: General [IEC 100/467/CDV] IEC CDV 61937-2 (2nd Edition): Digital audio -- Interface for non-linear PCM encoded audio bitstreams applying IEC 60958 -Part 2: Burst-info [IEC 100/468/CDV] IEC CDV 61937-3 (2nd Edition): Digital audio -- Interface for non-linear PCM encoded audio bitstreams applying IEC 60958 -Part 3: Non-linear PCM bitstreams according to the AC-3 format [IEC 100/469/CDV] IEC CDV 61937-4 (2nd Edition): Digital audio -- Interface for non-linear PCM encoded audio bitstreams applying IEC 60958 -Part 4: Non-linear PCM bitstreams according to the MPEG Audio formats [IEC 100/470/CDV] USNB Contribution: Recommendation to Digital Cinema Liaison Statement from ITU-T SG 16 to SC 29/WG 11 on MPEG-4 on IP [LS12/16] Response to Liaison Statement to ITU-T SG 16 regarding the JVT Liaison Statement from ITU-T SG 16 to SC 29/WG 11 on Mediacom 2004 [LS35/16] UK National Body Position on Document Distribution CDN NB comment on 14496-1:2001/AMD 3 (IPMP) Comment on JVT work (SgNB) Comment on MPEG-4 audio extension 1 (SgNB) Liaison Statement from NATO to SC 29/WG 11 on Digital Cinema Comments on MPEG-4/Audio Bandwidth Extension (JNB) Liaison Statement on Rights Expression Language (Open eBook Forum) ILNB Position on ISO/IEC 14496-1:2001/PDAM3 and ISO/IEC CD 21000-4 118 M8101 M8157 M8159 M8165 M8166 M8221 M8228 Concerns about the IPR situation within the JVT group (DNB) JNB Comment on JVT activity KNB comment on JVT work UKNB Comments on PDAM 6 for ISO/IEC 14496-1 UKNB Comments on PDAM 5 for 14496-1, PDAM 1 for 154443 Updated description of the relationship between the MPEG-21 and Mediacom 2004 Projects USNB Contribution: Recommendations to JVT Additionally, informal communications with SMPTE, 3GPP2 and TV-Anytime Forum were taken into account. 119