INTERNATIONAL ORGANISATION FOR STANDARDISATION
ORGANISATION INTERNATIONALE DE NORMALISATION
ISO/IEC JTC 1/SC 29/WG 11
CODING OF MOVING PICTURES AND AUDIO
ISO/IEC JTC 1/SC 29/WG 11
N2251
July 1998
Source:
Title:
Status:
1
Leonardo Chiariglione – Convenor
Report of the 44th WG 11 meeting
Opening
The 44th WG11 meeting was held at the Dublin Castle Conference Centre, Dublin, IE, at the kind
invitation of National Standards Authority of Ireland and hosted by Teltec Ireland and Radio
Telefís Éireann on 98/07/06-10. Mr. Noel Treacy, T.D., Minister for Science, Technology and
Commerce and Dr. Ian Cowan, NSAI welcomed the participants.
2
Roll call of participants
This was not made for reasons of time
3
Approval of agenda
This appears as Annex 1
4
Allocation of contributions
This appears as Annex 2
5
Communications from Convenor
The Convenor reported to the group that he had informed the ISO Central Secretariat of the AAC
patents problems, as requested by the Tokyo meeting Resolution 2.5.2. At the end of the week
representatives of the companies owning AAC-related IPR informed the meeting that an
agreement had finally been reached entrusting Dolby as the single licensing point for ACC
patents.
6
Report of previous meetings 1978
The reports of the San Jose and Tokyo meetings were approved.
7
Processing of NB Position Papers
2
Papers were received from the National Bodies of ES, JP, KR, PT, SE, SG and US. Responses
were drafted and approved.
8
MPEG Phase 2
8.1 MPEG-2 parts
No specific work was done. It was considered useful to revise ISO/IEC 13818-1:1996 and
ISO/IEC 13818-2:1996 including all the Amendments and Corrigenda after Amendment 6 to
ISO/IEC 13818-1:1996 reaches the publication stage.
8.2 Verification of MPEG-2
No specific results were made known.
8.3
Amendments
8.3.1 Systems
WG 11 N2268 contains revised proposed modification to ISO/IEC 13818-1.
WG 11 N2267 is the text of ISO/IEC 13818-1/PDAM6.
8.3.2 Video
WG 11 N2255 is the Disposition of Comments Report and WG 11 N2256 is the text of FPDAM5
for ISO/IEC13818-2/PDAM5.
8.3.3 Audio
Work on MPEG-2 AAC dynamic range control continued
8.3.4 DSM-CC
Part 10 being under ballot a "Study on MPEG-2 DSM-CC Conformance 13818-10 FCD" was
produced. Further the following document was approved:
 Text of ISO/IEC 13818-6/FPDAM1 (WG 11 N2264)
8.3.5 Conformance
The following documents were approved:
 Disposition of Comments Report for ISO/IEC 13818-4/FPDAM1 (WG 11 N2257) and the
text of FDAM1 (WG 11 N2258).
 Proposed modification to ISO/IEC 13818-4 as specified in WG 11 N2259.
 Text of ISO/IEC 13818-4/PDAM2 (WG 11 N2263).
8.3.6 Technical Report
The following documents were approved:
 Disposition of Comments Report for ISO/IEC TR 13818-5/DAM1 (WG 11 N2261) and the
text of AMD1 (WG 11 N2262)
8.4
Corrigenda
8.4.1 Conformance
3
The following corrigenda were approved
 Text of ISO/IEC 13818-4/COR2 (WG 11 N2260).
 Disposition of Comments Report for ISO/IEC 13818-7/DCOR1 (WG 11 N2265) and the
text of COR1 (WG 11 N2266)
8.5 Workplan
This was approved
9
MPEG Phase 4
9.1
Version 1
9.1.1
Patent statements
A report of the situation of statements received was made. Members who had not submitted a
statement were encouraged to do so.
9.1.2 Final Committee Draft
9.1.2.1 System
Further studies of the Systems FCD were made
9.1.2.2 Visual
Further studies of the Visual FCD were made
9.1.2.3 Audio
Further studies of the Audio FCD were made
9.1.2.4 Reference software
Further studies of the Reference software FCD were made
9.1.2.5 DMIF
Further studies of the DMIF FCD were made
9.1.3 Verification Tests
9.1.3.1 Systems
Work was done on MPEG-4 Audio/Systems issues
9.1.3.2 Video
Work was done on
MPEG-4 video encoder optimization and MPEG-4 video verification tests
9.1.3.3 Audio
Work was done on MPEG-4 Audio NADIB verification tests and MPEG-4 Audio Verification
tests
9.1.4 Quality of service
Work was done on video decoder Quality of Service
9.1.5 Conformance Testing
4
A new WD was approved.
9.1.5.1 System
An editor was appointed
9.1.5.2 Visual
Three editors were appointed
9.1.5.3 Audio
An editor was appointed
9.1.5.4 DMIF
An editor was appointed
9.2
Version 2
9.2.1 Requirements
MPEG-4 version 2 requirements were continued.
9.2.2 Tools
9.2.2.1 DMIF
Work on use of DMIF ver. 2 for Mobile Network Connections was continued
9.2.2.2 Systems
Substantial work was accomplished for Advanced BIFS, MPEG-J Specification and
Implementation, M4 File Format and Intellectual Property Management & Protection. The
maturity of the last item prompted the group to consider introduction of the technology to ver. 1 if
National Body will so support.
9.2.2.3 Natural Visual
This part of the work received reduced priority because of the need to clarify all items for ver. 1.
9.2.2.4 Synthetic Visual
Substantial progress was made on Computational Graceful Degradation, Body Animation, and
Face and Body Animation
9.2.2.5 Natural Audio
This part of the work received reduced priority because of the need to clarify all items for ver. 1.
9.2.2.6 Synthetic Audio
Most of this work falls under Advanced BIFS
9.2.3 Verification Models
9.2.3.1 System
Work was continued
9.2.3.2 Video
Work was continued
5
9.2.3.3 Audio
Work was continued
9.2.3.4 SNHC
Work was continued
9.2.4 Working Drafts
9.2.4.1 Systems
WD of all new technologies were produced
9.2.4.2 Video
A new WD was produced
9.2.4.3 Audio
A new WD was produced
9.2.4.4 Simulation software
Work to collect ver. 2 sofware has barely started
9.2.4.5 DMIF
A new WD was produced
9.3 Workplan
This was approved
10 MPEG Phase 7
10.1 Requirements
A new version of the requirements document was produced
10.2 Call for proposals
The text of the CfP was refined
10.3 Workplan
This was approved
11 Overall WG11 workplan
This was approved.
12 Explorations
Discussions of Advanced Layered Coding (ALC) and High Quality Video were made.
Demonstrations of ALC were also made.
13 Liaison matters
6
Input documents were received and discussed. Responses were drafted and approved.
14 Administrative matters
14.1 Schedule of future MPEG meetings
An offer from Australia to host a meeting on 99/10/04-08 was received and gratefully accepted.
14.2 Promotion of MPEG
Subgroups dealt with the update and improvement of their web sites.
15 Organisation of this meeting
15.1 Tasks for subgroups
The following tasks were assigned
Requirements
 Study of MPEG-4 Profiles
 MPEG-4 ver. 2 Requirements
 MPEG-7 Applications
 MPEG-7 Requirements
 MPEG-7 PPD
 MPEG-7 test material
 MPEG-7 Proposal Evaluation
 Update MPEG-4 ver. 1 description
 Update MPEG-4 ver. 2 description
 Press release
Delivery
 Study of MPEG-2 part 10 FCD
 Study of MPEG-4 part 6 FCD
 Ver. 1 reference software
 Conformance testing
 MPEG-4 part 6 ver 2 WD
 Conformity of ver. 2 to versioning policy
 Ver. 2 reference software
 Update of FAQ
Systems
 Study of MPEG-4 part 1 FCD
 Ver. 1 reference software
 Conformance testing
 Conformity of ver. 2 to versioning policy
 MPEG-4 part 1 ver 2 WD
 Ver. 2 reference software
 Update of FAQ
7
Video
 Study of MPEG-4 part 2 FCD
 Ver. 1 reference software
 Conformity of ver. 2 to versioning policy
 Conformance testing
 MPEG-4 part 2 ver 2 WD
 Ver. 2 reference software
 Update of FAQ
Audio
 Study of MPEG-4 part 3 FCD
 Ver. 1 reference software
 Conformance testing
 Conformity of ver. 2 to versioning policy
 MPEG-4 part 3 ver 2 WD
 Ver. 2 reference software
 Update of FAQ
SNHC
 Study of MPEG-4 part 2 FCD
 Ver. 1 reference software
 Conformance testing
 Conformity of ver. 2 to versioning policy
 MPEG-4 part 1&2 ver 2 WD
 Ver. 2 reference software
 Update of FAQ
Test
 Final report of fist Verification Tests
 Planning of remaining Verification Tests
 Publication policy of MPEG AV sequences
 Test FAQ
ISG
 Complexity of all parts of MPEG-4
 Quality of service
 ISG FAQ
Liaison
 Study incoming liaison statements
 Produce outgoing liaison statements
 Produce responses to NB papers
HoD
 AAC patents and related issues
 Publication of MPEG standards
 NB position papers
 Promotion of MPEG
 MPEG Monday plenary
 MPEG trademark
8



Meeting schedule
Dublin meeting accounts
Support to Friday plenary
15.2 Room allocation
This was agreed
15.3 Joint meetings
Joint meetings were held as described in the table below
Group 1
Audio
Audio
System
System
Test
SNHC
Delivery
Requir.
Audio
Audio
Video
Video
ISG
Test
Test
SNHC
SNHC
SNHC
SNHC
SNHC
Systems
Video
Group 2
Test
Req., Sys., ISG
DMIF
Req., Audio, Video
Video
ISG
Systems
ISG
Test
Systems, Req.
Req, ISG
Req.
Audio
Req.
Video
Syst
ISG
ISG
Req, ISG
Req
Video
Day
Time
Mon 17-18
Tue 17-18
Mon 16-17
Tue 14-15
Mon 19-20
Mon 17-18
Thu 10-11
Thu 09-10
Thu 11-12
Thu 11:30-13
Wed 17:30-18:30
Thu 10:30-11:00
Wed 4-5
Wed 15-17
Wed 17-18
Wed 5-6
Wed 3-4
Thu 10-11
Thu 9-11:30
Thu 8:30-9
Wed 4-5
Thu 13-14
Where
Audio
Audio
Delivery
System
Video
SNHC
Systems
Requir.
Audio
Systems
Video
Req
ISG
Req
Test
Syst
SNHC
SNHC
Req
Req
Syst
Video
About
Verification Tests
Audio Composition
Evolution, QoS, URL
M4F
Verification Tests
Decoder adaptation
URL and stream control
Profiles
Verification tests
Adv. BIFS, MPEG-J, N. comp
Comb. tools, profiles
SNR scalab. et al.
SA complexity
MPEG-7 eval.
Scalability
Body Anim
CGD
CGD
Profiles
New requir., 3D meshes
M4F
MPEG-7
16 Planning of future activities
The following ad hoc groups were established
No.
2357
2345
2338
2306
2371
2367
2295
2319
2344
2347
Title
2D BIFS scene editor
Error resilience verification in MPEG-4 video
MPEG-4 Video Verification tests
3D Model Coding
Advanced BIFS
Audio activities in MPEG-7
Completion MPEG-2 TR 13818-1/AMD1
Computational Graceful Degradation
Core experiments in MPEG-4 video
Editing the documents of the MPEG-4 video verification model and the MPEG-4
visual working draft
9
2307
2375
2374
2315
2293
2292
2296
2297
2373
2364
2294
2348
2365
2366
2372
2376
2363
2308
2346
2370
2369
2320
Face Body Animation
IM 1 Software Platform
Intellectual Property Management & Protection within MPEG-4
Mobile Network Connections
MPEG-4 Audio Conformance and complexity
MPEG-4 Audio FDIS and Reference Software FDIS progression
MPEG-4 Audio Verification tests
MPEG-4 Audio Version 2, error resilience,
MPEG-4 File Format
MPEG-4 Levels
MPEG-4 Structured Audio
MPEG-4 video encoder optimization
MPEG-7 Requirements
MPEG-7 Test and Evaluation issues
MPEG-J Specification and Implementation
MPEG-X
Requirement study for High Quality Applications
SNHC VM Editing
Software integration and verification in MPEG-4 video
Systems Conformance
Systems Specifications Editing
Video Decoder Quality of Service
17 Resolutions of this meeting
These were approved
18 A.O.B
There was no other business
19 Closing
The meeting closed on 98/07/10 21:55 with thanks to the hosting organisation
10
Annex 1
Agenda
19. Opening
20. Roll call of participants
21. Approval of agenda
22. Allocation of contributions
23. Communications from Convenor
24. Report of previous meetings
25. Processing of NB Position Papers
US1, US2, US3, US4, US5
19. MPEG Phase 2
19.0._._._._._._._?_ MPEG-2 parts
19.0._._._._._._._?_ Verification of MPEG-2
8.3 Amendments
8.3.1 Systems
8.3.2 Video
8.3.3 Audio
8.3.4 DSM-CC
8.3.5 Conformance
8.3.6 Technical Report
8.4 Corrigenda
8.4.1 Conformance
8.5 Workplan
9. MPEG Phase 4
19.0._._._._._._._?_ Version 1
19. .._._._._.?_?_ Patent statements
19. .._._._._.?_?_ Final Committee Draft
9.1.2.1 System
9.1.2.2 Video
9.1.2.3 Audio
9.1.2.4 Reference software
9.1.2.5 DMIF
19. .._._._._.?_?_ Verification Tests
9.1.3.1 Systems
9.1.3.2 Video
9.1.3.3 Audio
9.1.4 Quality of service
19. .._._._._.?_?_ Conformance Testing
9.1.5.1 System
9.1.5.2 Video
9.1.5.3 Audio
9.1.5.4 DMIF
19.0._._._._._._._?_ Version 2
19. .._._._._.?_?_ Requirements
19. .._._._._.?_?_ Tools
19...._._._?_?_
DMIF
19...._._._?_?_
Systems
19...._._._?_?_
Natural Visual
19...._._._?_?_
Synthetic Visual
11
19...._._._?_?_
Natural Audio
19...._._._?_?_
Synthetic Audio
19. .._._._._.?_?_ Verification Models
9.2.3.1 System
9.2.3.2 Video
9.2.3.3 Audio
9.2.3.4 SNHC
9.2.5 Working draft
9.2.5.1 Systems
9.2.5.2 Video
9.2.5.3 Audio
9.2.5.4 Simulation software
9.2.5.5 DMIF
19.0._._._._._._._?_ Workplan
10. MPEG Phase 7
10.1 Requirements
10.2 Call for proposals
10.3 Workplan
11. Overall WG11 workplan
12. Explorations
13. Liaison matters
14. Administrative matters
19.0._._._._._._._?_ Schedule of future MPEG meetings
14.2 Promotion of MPEG
15. Organisation of this meeting
19.0._._._._._._._?_ Tasks for subgroups
15.2 Room allocation
15.3 Joint meetings
16. Planning of future activities
17. Resolutions of this meeting
18. A.O.B
19. Closing
12
Annex 2
List of documents submitted
Number
3513
Pete Schirling
Source
3514
ITU-T SG 12 via the SC 29 Secretariat
3515
ITU-T SG 12 via the SC 29 Secretariat
3516
INTELSAT via the SC 29 Secretariat
3517
3518
MPEG Systems Spec AHG, A. Eleftheriadis,
O. Avaro
SC 29 Secretariat
3519
ISO Central Secretariat via SC 29 Secretariat
3520
SC 24 via the SC 29 Secretariat
3521
SC 29/WG 1 via the SC 29 Secretariat
3522
the SC 24 Secretariat via the SC 29 Secretariat
3523
CEN/ISSS/WS-MMI via the SC 29 Secretariat
3524
EPO via the SC 29 Secretariat
3525
ITU-R via the SC 29 Secretariat
3526
ITU-R via the SC 29 Secretariat
3527
DAVIC via the SC 29 Secretariat
3528
DAVIC via the SC 29 Secretariat
3529
JTC 1 Secretariat
3530
Jiankun Li, C.-C. Jay Kuo, Homer Chen
3531
Karen Hsing, Chilsung Seo
3532
Karen Hsing, Chilsung Seo
Title
Document Register for 44th Meeting in Dublin,
Ireland
Liaison Statement from ITU-T SG 12 on
MPEG-4 Video Verification (SC 29 N 2499)
Liaison Statement from ITU-T SG 12 on
MPEG-4 Audio Test (SC 29 N 2501)
Request for Category A Liaison between SC 29
and INTELSAT (SC 29 N 2498)
MPEG Systems (1-2-4-7) FAQ, Version 5.1
Summary of Voting on ISO/IEC 138184/FPDAM 1 ÕSC 29 N 2521å
Notice of Designation, SMPTE as the RA for
ISO/IEC 13818-1:1996/Amd 2 ÕSC 29 N
2523å
JTC 1 NP: ISO/IEC 14472-2: VRML External
Authoring Interface (EAI) (SC 29 N 2625)
Liaison Statement from SC 29/WG 1 to SC
29/WG 11 on JPEG2000 ÕSC 29 N 2535, SC
29/WG 1 N 818å
ISO/IEC WD 14472-2, VRML External
Authoring Interface (EAI) ÕSC 24 N 1861, SC
29 N 2552å
Liaison Statement from CEN/ISSS/WS-MMI to
SC 29/WG 11 ÕSC 29 N 2545å
Request for Category B Liaison between the
European Patent Office (EPO) and SC 29 ÕSC
29 N 2547å
Proposed SMPTE Standard for Television,
Channel Assignments and Levels on
Multichannel Audio Media ÕSC 29 N 2553å
ITU-R Draft New Recommendation:
Parameters for International Exchange of
Multi-channel Sound Recordings ÕSC 29 N
2554å
The 12th DAVIC Call for Proposal, Generic
Multimedia Contribution Systems and
Components ÕDAVIC 486, SC 29 N 2555å
The 13th DAVIC Call for Proposal, IP
Forwarding Mechanisms for the Control of IP
Network Performance ÕDAVIC 487, SC 29 N
2556å
Summary of Voting on ISO/IEC TR 138185/DAM 1: Information technology -- Generic
coding of moving pictures and associated audio
information -- Part 5: Software simulation,
AMENDMENT 1: Advanced Audio Coding
(AAC) SC 29 N 2557, JTC 1 N 5291
Mesh Connectivity Coding by Dual Graph
Approach
Revision on the test case of testing DSM-CC
U-U Stream Interface
The additional set of the Conformance Abstract
Test Cases for testing DSM-CC U-N Session
Protocol
13
Number
3533
Source
Karen Hsing, Chilsung Seo
3534
AESSC via the SC 29 Secretariat
3535
3536
3537
Niels Rump as chair of IPMP Ad-hoc
Niels Rump, Keith Hill, Gene Itkis, Jack Lacy,
Talal Shamoon, and Dominique Yon
Talal Shamoon for the IPMP ad hoc
3538
Jack Lacy for the IPMP Ad Hoc
3539
3540
3541
3542
itaru-k@ascii.co.jp
Vahe Balabanian
Vahe Balabanian
SC 24 via the SC 29 Secretariat
3543
IEC TC 100 via the SC 29 Secretariat
3544
3545
3546
Zvi Lifshitz et al.
G. Fernando, A. Puri, V. Swaminathan, R. L.
Schmidt, P. Shah, K. Deutsch
SC 29 Secretariat
3547
SC 29 Secretariat
3548
Zvi Lifshitz
3549
A. Eleftheriadis
3550
ITU-T via the SC 29 Secretariat
3551
3552
Peter Kuhn
Dave Singer
3553
Euee S. Jang, Visual CD Editors
3554
3555
3556
Ananda Allys, Olivier Avaro, Bruno Loret
Ananda Allys
Riitta Vaananen, Julien Signes
3557
3558
3559
Jean-Claude Dufourd for the AHG
Jean-Claude Dufourd
Riitta Vaananen, Jyri Huopaniemi
3560
3561
Weiping Li
Weiping Li
3562
NB of Japan via the SC 29 Secretariat
3563
NB of Japan via the SC 29 Secretariat
3564
SC 29 Secretariat
Title
Conformance Abstract Test Cases for testing
DSM-CC U-N Session Protocol implemented
at a Server
AESSC Item of Interest ÕIEC 100C/226/INF,
SC 29 N 2565å
Report of IPMP Ad-hoc Group
MPEG-4 IPMP FAQ
MPEG-4 Intellectual Property Management
and Protection (IPMP) Technical Specification
The Why and How of Intellectual Property
Mangement and Protection in MPEG-4
A proposal on IPMP
DMIF March 1998 (Tokyo) Meeting Report
DMIF March 1998 (Tokyo) Meeting Report
SC 24 NP: ISO/IEC 14472-1/Amd.1, VRML
Interoperability Enhancements ÕSC 24 N
1852, SC 29 N 2580å
IEC TC 100 3rd WD: Model and Framework
for Standardization in Multimedia Equipment
and Systems ÕIEC 100/PL/PT61998, SC 29 N
2583å
Im1 interim report
MPEG-J Architecure and API
Summary of Voting on ISO/IEC 138186/PDAM 1
Summary of Voting on ISO/IEC 138184/DCOR 2
MPEG-4 Off-line Multiplex Software Release
1.3
National Body Comment Template and Visual
Basic Macros for MPEG-4 Systems
Liaison Statement from ITU-T Q.11 and
15/WG 16 to SC 29/WG 11 on ITU-T Rec.
H.263 and MPEG-4 Video Issues ÕSC 29 N
2611, ITU-T Q15-D-67, Q11-E-24å
A complexity analysis tool: iprof (version 0.41)
Contact points between systems and elementary
streams
MPEG-4 Version 2 Visual Working Draft Rev.
3.1
Streams Data Base v2
Quick guide for MPEG-4 scene creation
Report of the Ad-hoc Group on Advanced
BIFS
Report of AHG on Systems Conformance
Proposals for BIFS specification improvement
Additions to Advanced Audio BIFS (MPEG-4
Version 2)
Status Report on Bit Plane Coding
Comparison of Bit-Plane Coding with Adaptive
I-VOP VLC on QCIF Sequences under the
Condition of One I-VOP in Every 10 VOPs
Late Comments on ISO/IEC 13818-7/DCOR 1
ÕSC 29 N 2620å
Late Comments on ISO/IEC TR 13818-5/DAM
1 ÕSC 29 N 2621å
Summary of Voting on ISO/IEC 13818-
14
Number
Source
3565
David Meares
3566
David Meares
3567
3569
Gauthier Lafruit, Lode Nachtergaele, Andy
Scherpenberg, Tom Huybrechts, Jan Bormans
Gauthier Lafruit, Mercedes Peon, Bart
Vanhoof, Jan Bormans
Peter Kauff, Klaas Schueuer, Minhua Zhou
3570
Shigeru Fukunaga, Hideaki Kimata
3571
3572
Hideaki Kimata, Shigeru Fukunaga
Christoph Heer
3573
D.CURET, C.ISLAS
3574
3575
3576
3577
3578
Frank Nack
Frank Nack
Seishi Takamura (NTT), Yuichiro Nakaya
(Hitachi), Yoshinori Suzuki (Hitachi)
Robert Danielsen, Gisle Bjontegaard
Peter G. Schreiner III
3579
B.S.Manjunath, Hyun Doo Shin
3580
B.S.Manjunath, Hyun Doo Shin
3581
B.S.Manjunath, Hyun Doo Shin
3582
B.S.Manjunath, Hyun Doo Shin
3583
Michael Frater
3584
Hiroyuki Fukuchi
3585
SMPTE via the SC 29 Secretariat
3586
ITU-R TG 8/1 via the SC 29 Secretariat
3587
3588
Ulrich Horbach, Attila Karamustafaoglu
Ali Nowbakht Irani, Ralph Sperschneider,
Martin Dietz
David Thom, Heiko Purnhagen
3568
3589
3590
3591
3592
Francoise Preteux,, Marius Preda, and Gerard
Mozelle
Francoise Preteux,, Mircea Curila, Sorin
Curila, Jose Paumard, and Gerard Mozelle
3593
Francoise Preteux,, Marius Preda, and Gerard
Mozelle
Paulo Nunes, Fernando Pereira
3594
Portuguese National Body (IPQ)
Title
2/PDAM 5 ÕSC 29 N 2622å
Bibliography of WG11 Input Documents:
m0551 to m3511, December 1995 to March
1998
Bibliography of WG11 Output Documents:
N0965 to N2247, July 1995 to March 1998
Computational Graceful Degradation Analysis
in SNHC
Complexity Analysis of FCD still texture
coding
Experimental Results on a Fast SA-DCT
Implementation
streamType of Backward Video for Error
Resilience
Features of NEWPRED for Version 2
VLSI implementation of repetitive padding:
cost and architecture
MPEG4 Synchronisation Layer: A graphical
representation.
MPEG-7 Requirements Document V.6
MPEG-7: Context and Objectives V.8
Results of bitstream exchange and combination
experiment for Global Motion Compensation
Telenor coding efficiency improvements
Report of the Ad-Hoc Group on AAC Dynamic
Range Control
Texture Descriptor for Browsing and Retrieval
of Image Data
Texture Descriptor for Browsing and Retrieval
of Image Data
Texture Descriptor for Browsing and Retrieval
of Image Data
Texture Descriptor for Browsing and Retrieval
of Image Data
Report of the adhoc group on error resilience
aspects of MPEG-4 video
Brief Report of AAC Conformance Testing
(SSR profile)
Request for Category A Liaison between
SMPTE and SC 29 ÕSC 29 N 2624å
Liaison Statement from ITU-R Task Group 8/1
to ISO/IEC on Support of Mobile Multimedia
Service by IMT-2000 ÕSC 29 N 2628å
Quality Aspects of MPEG-4 Audio Processing
Core Experiment Proposal on Error Resilient
Scalefactor Coding for MPEG2-AAC
Ad-Hoc group report on Audio Web Page
activity
Donation to ISO of Hand Animation Software
Geometry and Topology Compression of 3D
Meshes: Results of Core Experiment M1 and
M2
Hand Animation and BAPs Extraction: Reports
on Core Experiment 3
Rate Control in Object-based Video Coding
Frameworks
Portuguese National Body Position regarding
quarter-pel and global motion compensation
15
Number
3595
3596
3597
Source
Frederic Dufaux
Xuemin Chen, Bob Eifrig
Guido Franceschini
3598
Laura Contin
3599
Laura Contin, Marco Quacchia
3600
Laura Contin, Marco Quacchia, Vittorio
Baroncini, Stephane Pefferkorn
Giorgio Zoia
Giorgio Zoia
3601
3602
3603
3604
Wee Sun Lee, Michael Frater, John Arnold
Giorgio Zoia, Laurent Le Bourhis, Ulrich
Horbach, Attila Karamustafaoglu
3605
Jens Spille
3606
Jens Spille
3607
3608
Rob Koenen
Bo Burman for the AHG
3609
3610
3611
Structured Audio AHG, MIDI Manufacturers
Association
Eric Scheirer, Lee Ray
Eric Scheirer
3612
Dave Pawson
3613
Jens-Rainer Ohm
3614
3615
3616
3617
Spanish National Body
Marc Mongenet, Marco Mattavelli
Marco Mattavelli
A. Eleftheriadis
3618
3619
3621
3622
Krit Panusopone, Xuemin Chen, Ajay Luthra
Manish Singhal, Mark Banham, Kevin
O'Connell,, Mike Danielsen (Motorola),, Ajay
Luthra (GI),, Ali Tabatabai (Tektronix),,
Yingwen Chen(Phillips)
Takanori Senoh/Matsushita Elec. Indst.
Co.,Ltd.
Yoshihiro Ueda, Zhixiong Wu
T.K.Tan
3623
G.R. Hu, T.K.Tan
3624
3625
C.Y. Law, Y. Matsui
Bruce Penney, SMPTE
3626
3627
3628
Youngjik Lee, Jeorn Ostermann
Youngjik Lee, Jung-Chul Lee, Hang-Seop Lee
Joon Hyeon Jeon, Jechang Jeong
3620
Title
Performance list for dynamic sprite
Video Rate Buffer
Report of the Ad Hoc Group on Systems and
DMIF Specification Evolution
List of audio, video and audiovisual excerpts
that have been released to MPEG
Experiment for the validation of an objectbased quality evaluation method
Report of the formal verification test on
MPEG-4 video error resilience
Proposed revisions to FCD 14496-3 Subpart 5
A method for complexity measurements in
Structured Audio
Results for Core Experiment E16
Proposed revision of Systems and Audio
profiles and levels from an analysis of audio
composition
Report of Ad-Hoc Group on MPEG-4 Audio
Tools Complexity
Report of Ad Hoc Group on MPEG-4 Audio
Conformance
Report of AHG on Profiles and Levels
Report of AHG on Mobile Network
Connections
Revised Structured Audio Sample Bank Format
Report of AHG on Structured Audio
A method different than Giorgio's for
complexity measurements in SA
Analysis of MP4 Sample Table for Random
Access
Report of Adhoc Group on Multifunctional and
Advanced Layered Coding Aspects of MPEG-4
Video
Video tools for MPEG-4 Version 1
Some results of MB coding complexity
Report of the ad-hoc group on decoder QoS
Report of Ad Hoc Group on Systems
Specification Editing (N2236)
Proposal for MPEG-4 4:2:2 video
Request for HDTV level for Main Visual
Combination Profile
MPEG-7 Test Data Format and Content
Description Language
Scalable Shape Coding for Still Texture
Report of the Adhoc group on core experiment
on coding efficiency in MPEG-4 video
Simplification of the DC/AC Inverse Prediction
and Inverse Quantization for MPEG-4 Texture
Decoding
Extension of Valuator Node Functionality
SMPTE Comments on MPEG-2 Video
PDAM5
AHG Report on TTS/FBA Convergence
MPEG-4 Audio Markup TTS
Editorial Comments on Texture Coding Mode
of VM and CD
16
Number
3629
Source
The National Body of Japan
3630
H. Luo, A. Eleftheriadis
3631
Mercedes Peon, Lode Nachtergaele, Gauthier
Lafruit, Peter Vos, Jan Bormans
Teruhiko Suzuki, Takefumi Nagumo, Yoichi
Yagasaki
Teruhiko Suzuki, Takefumi Nagumo, Yoichi
Yagasaki
Kuniaki Takahashi, Teruhiko Suzuki, Yoichi
Yagasaki
The National Body of Japan
Giuseppe Russo, Romolo Latino
3632
3633
3634
3635
3636
3637
3638
3639
3640
Teruhiko Suzuki, Yoichi Yagasaki
Anne-Claude Doux (LEP), Jean Gobert (LEP),
Andrea Barbieri (PACT)
Munchurl Kim,, Jinsuk Kwak,, Myoung Ho
Lee, and Chieteuk Ahn
3641
3642
Jens-Rainer Ohm,, Karsten M?ller,, Christian
Stoffers
I. Sezan, F. Nack, V. V. Vinod
P. van Beek, M. Tekalp, I. Sezan
3643
P. van Beek
3644
3645
3646
3647
P. van Beek
Gauthier Lafruit, Mercedes Peon, Bart
Vanhoof, Jan Bormans
Vahe Balabanian
A. Hutter
3648
3649
Olaf Barheine
Werner Kriechbaum
3650
3651
3652
Dave Pawson
Paulo Villegas
Jiankun Li, C.-C. Jay Kuo, Homer Chen
3653
3654
3655
3656
3657
3658
Xuemin Chen, Krit Panusopone, Bob Eifrig
Javier Zamora
Javier Zamora
Sadik Bayrakeri, C.C. Lee
Sadik Bayrakeri, C.C. Lee
R. L. Schmidt, B. G. Haskell, A. Puri
3659
3660
3661
I-Jong Lin, Anthony Vetro, Huifang Sun, SunYuan Kung
Jae S. Lim, Wade K. Wan
Francoise Preteux, and Marius Malciu
3662
Ajay Luthra, Yoichi Yagasaki
3663
Eishi Morimatsu
3664
3665
Gary Demos
Gerard Fernando
Title
JNB Comment on Simple and Core
Combination Profiles
An Analysis of the Timing and Synchronization
Models in MPEG-4 Systems
Computation Complexity Profiling of the IM-1
MPEG-4 Player
The Preliminary results of scalable video
verification test
The results of CE B1.2
The Results of Advanced Layered Coding
Comments on FCD 14496-1 (Systems)
Development of a user assisted segmentation
system in JAVA
Proposal to support 4:2:2/4:4:4 video
Parameters for shape: alpha_threshold and
conversion ratio
User-assisted Video Object Segmentation by
Object Boundary Tracking with a Graphical
User Interface
Report on Multiview CE M1
Report of AHG on MPEG-7 Requirements
Level parameters for 2D mesh object
(combination) profiles
Mesh software for MPEG-4 systems player
implementation (im1)
Input for Study of MPEG-4 Visual FCD
Complexity analysis and guidelines for profile
definition of Still Texture Coding
DMIF FCD Comments
AC/DC Prediction tool without division
operations
MPEG-4 Profiles/Levels Summary
Some remarks on Document Structure and
Description Schemes
Source code for MP4 seeking benchmark
User Contexts for MPEG-7
Progressive Mesh Coding by Independent
Vertex Split
Results of BBM for interlaced video
Summary and lessons learned from DMIF V1
DMIF V1: DAI Library Description
Multi-User Interactions
Requirements for Multi-User Interactions
Advanced BIFS Nodes to support
Transparency
Circular Viterbi: Boundary Detection With
Dynamic Programming
Proposal for Advanced Layered Coding
Model-Based Face Tracking and 3D Pose
Estimation
Report of the Ad-hoc Group on MPEG2
4:2:2P@HL
Current Status of Dynamic Resolution
Conversion
Results of ALC tape experiments
Report on MPEG-J AHG
17
Number
3666
Atul Puri (AT&T)
3667
3668
Renaud Cazoulat
Mike Coleman, Eric Scheirer, Carsten Herpel
3669
3670
3671
3672
3673
3674
Mike Coleman, Chuck Lueck, Mark Paley,
David Thom
Aharon Gill
Zvi Lifshitz
Zvi Lifshitz
Mika?l Bourges-S?venier, Zvi Lifshitz
Zvi Lifshitz
3675
3676
3677
3678
3679
Zvi Lifshitz
Zvi Lifshitz
Zvi Lifshitz
Zvi Lifshitz
Jan Bormans, Marco Mattavelli
3680
3681
3682
Young-Kwon Lim, Youngjik Lee
Itaru Kaneko
Itaru Kaneko
3683
3693
3694
3695
Yong-Sung Kim, Whoi-Yul Kim, Young-Sum
Kim
The National Body of Japan
Yong-Sung Kim, Whoi-Yul Kim, Young-Sum
Kim
Takehiro Moriya, Akio Jin, Takeshi Norimatsu,
Mineo Tsushima, Tomokazu Ishikawa
The National Body of Korea, ksc29@kisi.or.kr,
ahnc@etri.re.kr
The National Body of Korea, ksc29@kisi.or.kr,
ahnc@etri.re.kr
The National Body of Japan
The National Body of Korea, ksc29@kisi.or.kr,
ahnc@etri.re.kr
The National Body of Korea, ksc29@kisi.or.kr,
ahnc@etri.re.kr
The National Body of Korea, ksc29@kisi.or.kr,
ahnc@etri.re.kr
Gerard Fernando
Gerard Fernando
Singapore National Body
3696
Singapore National Body
3697
3698
Hiroyuki Imaizumi, Shinichi Sakaida, Wentao
Zheng, Osamu Mizuno, Yoshiaki Shishikui
Yuji Maeda, Masayuki Nishiguchi
3699
Ulrich Benzler, Mathias Wien, Sven Bauer
3700
3701
3702
3703
Yuji Maeda, Masayuki Nishiguchi, Akira Inoue
Jean H.A. Gelissen
G. De Petris
Jean-Claude Dufourd, Souhila Boughoufalah,
Frederic Bouilhaguet
R. Beccini, B. Silano
3684
3685
3686
3687
3688
3689
3690
3691
3692
3704
Source
Title
Report of MPEG-J AHG meeting (Menlo Park,
May 27-28)
Text of the VM/WD for BIFS
Report of the Ad-hoc group on MPEG-4
Audio/Systems issues
Report of Ad-Hoc group on AAC technical
report & conformance
46th WG11 meeting notice (draft)
IM1 Software Platform AHG Report
Comments on Systems FCD
Efficient float coding in BIFS
Test Application for Systems Core Code
Release 1.3
DMIF Development Kit for IM1 version 1.0
Decoder Development Kit for IM1 Version 1.2
BIFS/OD Encoder Software Release 1.3
MPEG-4 Player Core Code Release 1.3
Report of the Ad-Hoc Group on Computational
Graceful Degradation
On the MPEG-4 TTS application with FA
JNB Comment on MPEG-4 IPMP
Level of the abstraction in the MPEG-4 IPMP
and it's interoperability
A Rotation Invariant Shape Descriptor using
Zernike Moment and Its Application
Comments on MPEG-4 Audio
A Rotation Invariant Shape Descriptor using
Zernike Moment and Its Application
Reports on the AAC-TwinVQ convergence
work
MPEG-4 content in mobile and Internet
environments
On the development of 3-D mesh coding tools
Comments on FCD 14496-2 (Visual)
Editorial comment on FCD 14496-2 ANNEX
Comments on BBM and FCD 14496-2 Visual
A study on the FCD 14496-3 Audio and FCD
14496-5 Software
Text for WD3.0 Systems version 2 (MPEG-J)
Text for VM3.0 Systems version 2 (MPEG-J)
Singapore National Body Comments on Visual
Profiles
Singapore National Body Comments on
Typecasting in BIFS
Experimental results for studio profile in
MPEG-4 version 2
EP tool version 0.5 with parametric speech
coder
Results of bitstream exchange for Quarter Pel
Motion Compensation
Listening test results of CELP coder
Conditional Access API for MPEG-J
Decoder API for MPEG-J
MDS: a 2D BIFS scene editor, freely available
Network API for MPEG-J
18
Number
3705
3706
3707
3708
Source
J.H.A. Gelissen
J.H.A. Gelissen
L. Deri
3709
Toshio Miki, Michael Wollborn, Teruhiko
Suzuki
The National Body of Japan
3710
Yoichi Yagasaki, Teruhiko Suzuki
3711
3712
Klaus Diepold (editor)
Kyu-Won Lee,, and Munchurl Kim
3713
3714
3715
3716
Toshiro Kawahara, Sanae Hotani, Takashi
Suzuki, Toshio Miki
Graham Thomas
UK National Body
Giorgio Zoia, Ulrich Horbach
3717
Kai-Kuang Ma and Prabhudev I. Hosur
3718
3719
The National Body of Japan
The National Body of Japan
3720
3722
3723
Jens-Rainer Ohm, Wolfram Liebsch, Bela
Makai,, Karsten M?ller, Detlef Zier
Jens-Rainer Ohm, Wolfram Liebsch, Bela
Makai,, Karsten M?ller, Detlef Zier
Kunihiko Miwa
Touradj Ebrahimi, Caspar Horne, Euee Jang
3724
Touradj Ebrahimi
3725
3726
3727
3728
Swiss NB
T. Nagumo, T.Suzuki, Y.Yagasaki
Guido Franceschini
T. Nagumo, T. Suzuki, Y. Yagasaki
3729
The National Body of Japan
3730
3731
The National Body of Japan
The National Body of Japan
3732
Hiroyuki Katata
3733
Hiroyuki Katata
3734
Norio Ito, Shin-ya Hasegawa, Hiroyuki Katata
3735
Jin Soo Choi, Myoung Ho Lee, Chieteuk Ahn
3736
3737
3738
Jens Vollmer, Sven Bauer, Henning M?ller,
Gerald Spreitz
Peter Kauff, Klaas Schueuer, Minhua Zhou
Fernando Pereira
3739
NEMESIS 2nd Phase (ESPRIT, IT28265),
3721
Title
Section Filter API for MPEG-J
Service Information API for MPEG-J
Terminal Capabilities & MPEG-4 Profile API
for MPEG-J
Report of ad-hoc group on video verification
test
JNB Comment on the extension of
4:2:2Profile??High Level & other Profiles and
Levels
Requirements of MPEG4 video coding for
studio application
MPEG-4 Applications Document (Revision)
Some considerations on the Evaluation
procedure and Distribution of Test Material
Core Experiment of Common EP tool for
MPEG-4 Audio error resilience
Report of AHG on Normative Composition
UK NB comments on FCD 14496-2 (visual)
Proposal for new SAOL core opcodes for high
quality equalizing and dynamic processing
The Second Status Report of Core Experiment
on Fast Block-Matching Motion Estimation
(Q4)
JNB comments on ISO/IEC13818-1
T-STD buffer model for the ISO/IEC13818-7
ADTS
Some Aspects related to MPEG-7 Data
Structure and Access
Some Aspects related to MPEG-7 Description
of Visual Object Features
CPTWG/DHSG status update
Report of the ad hoc group on video VM and
visual WD/FCD editing
Report of the ad hoc group on 3D model
coding
Swiss national body comments
Proposal for intra dc precision
DMIF URL formats used in IM1
The Preliminary Results for High Bitrate
Application
JNB Comment on Global Motion
Compensation
On the wording of the copyright desclaimer
JNB Comment on Quarter-pel Motion
Compensation
Result of the core experiment B1.2(arbitrary
shaped spatial scalability)
Result of the verification test for temporal
scalability
Result of the core experiment of tiling for still
texture object
Results of core experiment M2: Geometry
coding using PRVQ
ISO/IEC 14496 Content embedded in ETS 300
401 Multiplex
Classification of the SA-DCT Tool
MPEG-7 Content Donated by Portuguese
Broadcasters (RTP & SIC)
Contributions from NEMESIS to MPEG-4
19
Number
3740
3741
3742
Source
Peter Kauff (HHI), Jean Figue (TCO), JeanMarc Vezien, (INRIA/SYNTIM), Henri
Nicolas (INRIA/TEMICS)
Adam Lindsay
Swedish National Body
3744
Jae-won Chung, Jong Deuk Kim, Dongkyoo
Shin, Joo-hee Moon
Jae-won Chung, Ji Heon Kweon, Dongkyoo
Shin, Joo-hee Moon
Naoya Tanaka
3745
Heiko Purnhagen, Bernd Edler
3746
Jae-won Chung, Ji Heon Kweon, Joon-Ho
Song, Hae-Kwang Kim and Joo-hee Moon
Cheol Soo Park, Nam-Kyu Kim, Hae-Kwang
Kim, Joo-hee Moon
3743
3747
3748
Dongkyoo Shin, Joo-hee Moon
3749
3750
Jae-won Chung, Sung Moon Chun, Dongkyoo
Shin, Joo-hee Moon
Naoya Tanaka
3751
Yo-Sung Ho, Jeong-Hwan Ahn
3752
Yo-Sung Ho, Jeong-Hwan Ahn
3753
Jeong-Hwan Ahn, Yo-Sung Ho
3754
Akihiko Sugiyama
3755
Eric Petajan, Tolga Capin
3756
3757
3758
Toshiyuki Nomura, Masahiro Iwadare
Martina Eckert, J. Ignacio Ronda
Gael RICHARD, Ariane LEDORE, Philip
LOCKWOOD
3759
Akira Inoue, Masayuki Nishiguchi
3760
3761
The National Body of Japan
Bernhard Grill, Heiko Purnhagen
3762
Sehoon Son, Euee S. Jang, Jae-Seob Shin
3763
Ralf Funken, Werner Oomen, Frans de Bont
3764
Sehoon Son(Samsung AIT), Hiroyuki
Katata(Sharp),, Teruhiko Suzuki(Sony), Cliff
Reader(Samsung AIT)
Ralf Funken, Werner Oomen, Frans de Bont
3766
3765
Jae-Seob Shin(Samsung AIT), Jae-Won
Chung(Hyundai),, Seokwon Han(Daewoo)
Title
Studio Profile
MPEG-7 Applications Document
Comments on the use of software in the
normative parts of MPEG4
Syntax for Error Resilience on Interlaced Video
Coding
Syntax of Greyscale Alpha Shape in Error
Resilient Mode
A proposal to handle PICOLA speed change
tool in the Audio profiles
A Study of Parametric Audio FCD and HILN
Scalability
Results on BBM with Interlaced Sequence
Coding
Chrominance Decimation and Interpolation
Filtering for the Interlaced Object-based
Coding
Status of Interlaced Shape Coding for MPEG-4
Version 2
The Results of CE S12 : Interlaced Shape and
Texture Coding
Listening test results of optimized MPEG-4
CELP coders
Geometry Compression of 3D Meshes using
Optimal Quantization for Prediction Errors
Adaptive Quantization Method for 3D Mesh
Representation using the Spherical Coordinate
System
Results of Core Experiment M2 on 3D Model
Coding
Report of the Ad-Hoc group on MPEG-4
Audio CELP optimization
Report of ad hog group on Face and Body
Animation
Listening test results of MPEG-4 Audio CELP
Bit-rate allocation in multi-object video coding
Comparative test results for speech coders
(MPEG4 CELPs, G723.1, Scalable coder based
on G723.1)
Proposed Conformance Testing Procedures on
Noise Component Generator for Parametric
Speech Coder(HVXC)
JNB Comments on 422P@HL
Report of the AHG on MPEG-4 Audio FCD
and Reference Software FCD progression
CE results on shape and texture spatial scalable
coding
Results of an informal listening test assessing
the quality of MPEG-4 Wideband CELP with
an optimized VQ w.r.t. the MPEG-4 Audio VM
The features of shape and texture spatial
scalable coding for MPEG-4 version 2
Results of an informal listening test assessing
the quality of a modified MPEG-4 Narrowband
CELP codec w.r.t. the MPEG-4 Audio VM
Description of CE S12 (Interlaced Shape &
Texture Coding)
20
Number
3767
Source
Sung-Jin Kim, Sehoon Son, Jae-Seob Shin
3768
3769
Mun-Sub Song, Mahn-Jin Han, Euee S. Jang,
Y.S. Seo(SAIT),, Hyungin Choi(SNU)
Mahn-Jin Han, Mun-Sub Song, Euee S. Jang
3770
Damian Lyons
3771
German National Body
3772
Tolga K. Capin, Joaquim Esmerado
3773
Tolga K. Capin, Joaquim Esmerado
3774
USNB
3775
USNB
3776
3777
Frank Nack (GMD), Michael J. Hu (NanYang
Technological University)
Tolga K. Capin, Joaquim Esmerado
3778
USNB
3779
USNB
3780
Carsten Herpel (Thomson), Alexandros
Eleftheriadis (Columbia U)
USNB
3781
3782
3786
Gwendal Auffret, Remi Ronfard, Bruno
Bachimont
C. Sibade, S. Weisse, A. Ledore, G. Richard
Jie Liang, Raj Talluri
JEANNIN Sylvie, LINDSAY Adam,
PEREIRA Fernando
Wei Wu, Homer Chen
3787
Shipeng Li, Iraj Sodagar, Hung-Ju Lee
3788
Joern Ostermann
3789
Ulrike Pestel, Michael Wollborn
3790
3791
3793
Ulrike Pestel, Michael Wollborn
Sanghoon Lee, Sungryul Cho, Jinhun Kim,
Seokwon Han
Yingwei Chen, Cecile Dufour, Hayder Radha,
Robert A. Cohen, Marion Buteau
Frank Bossen (editor)
3794
Frank Bossen
3795
Martin Dietz, Laura Contin, Jean-Bernard Rault
3783
3784
3785
3792
Title
Results of CE S12 (Interlaced Shape & Texture
Coding)
Experimental Results on Mesh Connectivity
Coding based on Looping Triangle Strip (M1)
Experimental Results on Geometry
Compression for Mesh Coding using Optimal
Quantization for Prediction Errors (M2)
STatus of Body Animation Quantization Core
Experiment
Definition of Visual Combination Profiles in
FCD of 14496-2
Results of Body Animation Core Experiments
BAP2, BAP3, BAP6, BAP7
Report on Local Processing Scalability for
Body Animation
USNB Contribution -- MPEG-2 Compliance
Bitstreams
USNB Contribution -- New MPEG-4 Video
Tools
Some Aspects on MPEG-7 Ds,DSs,DDL and
their evaluation
Proposal for Update to Body Animation
Specification
USNB Contribution -- Predictable Appearance
of SFO
USNB Contribution -- VRML and SC 24
Liaisons
Report of ad hoc group on Elementary Stream
Management
USNB Contribution -- Comments on MPEG-2
4:2:2@VHL
Proposal for a minimal MPEG7 DDL for
temporal media
MPEG4 Audio demonstrator
Study of the FCD Visual Texture Coding
Report of the Ad Hoc Group on MPEG-7
Evaluation
Report on Core Experiment Results of Encoder
Complexity Reduction Based on Intelligent
Pre-Quantizaton
Proposal for a generic scalable shape coding
scheme
Report of the Ad-Hoc Group on Core
Experiments on Coding of Arbitrarily Shaped
Objects in MPEG-4 Video
UH-Results of core experiment B1.2b (Spatial
scalability)
Proposal of small changes for spatial scalability
Interlaced shape coding for arbitrary shape
object(S12)
Request for Fine Granular Video Scalability for
Media Streaming Applications
Description of core experiments on 3D model
coding
Results of core experiments on 3D model
coding
Report of the Ad-Hoc Group on MPEG-4
narrowband audio broadcasting verification
tests
21
Number
3796
3797
Source
Catherine Colomes, Caroline Jacobson, Eric
Scheirer, Laura Contin, Jean-Bernard Rault,
Martin Dietz
Martin Dietz, Toshio Miki
3798
Martin Dietz, Roland Bitto
3799
3800
Viswanathan Swaminathan, Gerard Fernando
Viswanathan Swaminathan, Shivakumar
Govindarajapuram, Yihan Fang
Francisco Moran
3801
3802
3814
3815
Anurag Bist, Iole Moccagatta, Osama
Alshaykh, Homer Chen
Iole Moccagatta, Osama Alshaykh, Homer
Chen
Iole Moccagatta, Osama Alshaykh, Homer
Chen
Iole Moccagatta, Osama Alshaykh, Homer
Chen
C.Guillemot (INRIA), P.Christ (RUS), D.Curet
(CCETT)
D.Curet
Yoshinori Suzuki, Yuichiro Nakaya, Satoshi
Misaka
Gabriel Taubin
Gabriel Taubin, Claudio Silva, Andre Gueziec,
Bill Horn
Gabriel Taubin, Claudio Silva, Andre Gueziec,
Bill Horn
Gabriel Taubin, Claudio Silva, Andre Gueziec,
Bill Horn
Radu S. Jasinschi, T. Naveen, Ali J. Tabatabai,
Alfred She, Anil Murching
Francoise Preteux
Hung-Ju Lee, Tihao Chiang
3816
3817
Tihao Chiang, Hung-Ju Lee
Tihao Chiang and Huifang Sun
3818
3819
3820
Yuval Fisher
Yuval Fisher
Sang-Wook Kim, Bernd Edler
3821
3825
Iraj Sodagar, Hung-Ju Lee, Bing-Bing Chai,
Paul Hatrack, Shipeng Li, B.S. Srinivas
Iraj Sodagar, Hung-Ju Lee, Paul Hatrack,
Shipeng Li, Bing-Bing Chai, Bing-Bing Chai
Joern Ostermann, Yao Wang
Iraj Sodagar, Hung-Ju Lee, Paul Hatrack,
Shipeng Li, Bing-Bing Chai
Sang-Wook Kim, Bernd Edler
3826
Iraj Sodagar, Bing-Bing Chai, B.S. Srinivas
3827
Hung-Ju Lee, Iraj Sodagar
3828
Sang-Wook Kim,, Bernd Edler
3803
3804
3805
3806
3807
3808
3809
3810
3811
3812
3813
3822
3823
3824
Title
Report on the NADIB verification tests
Ad-hoc group on MPEG-4 Audio error
resilience for Version 2
Proposal for correction of AAC conformance
test procedure
Streaming Byte Code for MPEG-J
EAI based and other proposals for Scene Graph
API in MPEG-J
Progressive 3D mesh coding with subdivision
surfaces
Mini Experiment on Adaptive Quantization for
Video Coding
Mini experiment on scanning for low
complexity wavelet texture coding
Core experiment on error resilience for still
texture using a packet approach
Verification test report for MPEG-4 low and
high bit-rate video coding
proposed amendments to DAI & DNI
Comments on FCDs
Study of Possible Combination on Global
Motion Compensation
SNHC Verification Model 9.0
Report on Results of Core Experiment M1 on
3D Model Coding
Report on Results of Core Experiment M3 on
3D Model Coding
SNHC VM 9.0 Source Code for TS and PFS
Connectivity Encoding and Decoding
Comments on Description and Feature
Requirements in MPEG-7
Liaison CEN-ISSS MMI
Results for MPEG-4 video verification test
using rate control
Study of FCD text for rate control
Report of AHG on MPEG-4 Encoder
Optimization
Quantization of CoordIndex
Script Node Implementation Status
Report of the Ad-Hoc group on MPEG-4
Audio verification tests
Implementation of Visual Texture Coding in
Microsoft FCD software and IM1
Bitstream exchange result for visual texture
coding
Bookmarks for TTS-FBA Synchronization
Editorial and minor technical changes of Visual
Texture Coding ("proposed study of FCD")
Report of the Ad-Hoc Group on MPEG-4
Audio Verification tests
Report of results on CE-E16: Error Resilient
Still Texture using a Packet Approach
Verification of result on CE-F1: Tiling function
for visual texture
List of selected items for the MPEG-4 Audio
verification test: Music on Internet
22
Number
3829
Source
Iraj Sodagar, Iole Moccagatta
3830
S.-W. Kim (Samsung),, M. Lindqvist
(Ericsson),, M. Nishiguchi (Sony)
Sang-Wook Kim
3831
3832
3834
Sen-ching Samson Cheung, Ralph Neff, Avideh
Zakhor
Eugene Miloslavsky, Sen-ching Samson
Cheung, Avideh Zakhor
Avideh Zakhor,, Sen-ching Samson Cheung
3835
Yingwei Chen, Ali Tabatabai, T. Naveen
3836
3837
Andrew Clinick, Phil Chou, Bill Powell, Weige Chen
Tom Geary (Rapporteur)
3838
Tom Geary (Rapporteur)
3839
3840
3841
Hiroshi Inoue
Jean-Claude Dufourd,, Souhila Boughoufalah,,
Frederic Bouilhaguet
US NB via the SC 29 Secretariat
3842
Riitta Vaananen, Jyri Huopaniemi
3843
3844
J. van den Beld(ECMA Secretary General)
VRMLC via the SC 29 Secretariat
3845
Michael F. Vetter
3846
3847
3848
Ji Heon Kweon, Cheol Soo Park, Jong Deuk
Kim, Jae-won Chung, Hae-Kwang Kim,
Dongkyoo Shin, Joo-hee Moon
Yuichiro Takamizawa, Masahiro Iwadare
US NB via the SC 29 Secretariat
3849
VRML MPEG-4 WG
3850
3851
3852
3853
Dave Pawson
Dave Pawson
Dave Pawson
R. Dreier, T. Stingl, G. Wendt, S. Skatulla, O.
Barheine
Jorgen Kiderud
Hiroyuki Fukuchi, Masahiro Iwadare
3833
3854
3855
Title
Report of the ad-hoc group on Visual Texture
Coding
List of selected items for the MPEG-4 Audio
Speech verification test
Perfect AM coding results check for
verification test on MPEG-4 narrowband Audio
broadcasting
Changes regarding Matching Pursuits in Video
VM V.11
SNR scalability using Matching Pursuits
Cost and benefit analysis for Matching Pursuits
as a version 2 tool
Request for Higher Chroma Format Support in
MPEG-4
Use of ECMAScript in AAVS
Liaison statement from ITU-T Q.11/16 to
SC29/WG11 on MPEG-4 video
Liaison statement from ITU-T Q.11/16 to
SC29/WG11 on MPEG-4 future work
IPMPS with back-channels
Software described in contribution m3703
Late Comments on ISO/IEC 13818-7/DCOR 1
(SC 29 N 2637)
Requirements of Advanced Audio BIFS in
MPEG-4 version 2
Liason Letter from ECMA
Liaison Statement from VRML Consortium to
WG 11(SC29N2645)
Report on SMPTE Metadata Dictionary and
Encoding to MPEG-7
Report on Bitstream Exchange for BBM
Source Codes for MPEG-2/AAC pulse coding
Late Comments on ISO/IEC 13818-2/PDAM 5
(SC 29 N 2652)
Text of the minutes of the June 25 VRML MPEG-4 WG meeting
Post-Tokyo AHG Report for M4F
Proposed initial glossary for M4F
Improved treatment of FlexMux in M4F
Structure and Interaction of two IM1 Demo
Applications
A proposal of DAI syntax specification
Bug Fix in MPEG-2/AAC TR
23
Annex 3
Requirements meeting report
Source: Rob Koenen, Chair
(Thanks to Bob Bell, Ed Hartley and Mike Zeug for keeping notes)
MPEG-2
PDAM on 4:2:2 @ High Level
It was decided to specify 1152 lines and not 1088, because otherwise the hierarchy with lower
profiles would be broken. Having heard the comments from the Japanese and US National
Bodies, and recognizing the desire (e.g. by SMPTE and the USNB) to specify 1088 because this
is what everybody seems to be using anyway, it was decided to ask National Bodies to comment
on the desirability to go to 1088 lines for all high levels.
It was also decided not to take the MB/second approach that is used in MPEG-4. The
Requirements group felt that we should stick to the MPEG-2 approach for MPEG-2 Levels, and
consider the new approach for all MPEG-4 Levels. All participants agreed that the new approach
is useful in principle.
MPEG-2 / MPEG-4
MPEG-2 @ Very High Level & MPEG-4 in the Studio
Higher quality requirements for broadcast, production were discussed, on the basis of input
documents (see agenda below for numbers).
It was shown that MPEG-4 syntax can be extended to 4:2:2. There were differing opinions on
how MPEG-4 performs at very high level. It was noted that higher quality issues should be
separated into levels for Broadcast and for Production/Studio. The latter requires significantly
higher quality.
Main Video Requirements were up to 4:4:4 and 10 bit. JNB wants to work VHL in MPEG-4 for
simple, main and 4:2:2. USNB wants work on Very High Levels in MPEG-4.
The conclusions were:
 There is a need for a standard addressing digital audiovisual material that cannot be supported
by MPEG-2 at the moment. Requirements include higher SNR and/or larger pictures and
advanced composition functionality.
 It would not be wise to extend both MPEG-2 and MPEG-4 with similar tools or addressing
similar applications. This would lead to confusion.
 The requirements should be studied further; not just Video requirements but also Systems and
perhaps Audio.
 After the Requirements Study, MOPEG must decide if, and if yes, when and where (MPEG-2
or -4) to address which requirements. A special AHG was installed for this study.
An AHG was installed to deal with the issue. (N2363: Requirement study for High Quality
Applications, chaired by Y. Yagasaki and A. Luthra,)
MPEG-4
Visual Profiles and Levels
General
Based on NB comments, other input, and quite some discussion, the following decisions were
24
taken:
1. The change of terminology, from ‘Object Profile’ to ‘Object Type’ and ‘Combination Profile’
to ‘Profile’ was confirmed
2. Simple and Core Object types will remain unchanged (on request of several NBs)
3. Simple and Core Profiles will also remain unchanged (on request of several NBs)
4. It was decided that some tools were OK for addition to the Main Object in principle (1/4 pel,
GMC), but the Video Group later on decided they were not ripe, and hence they were not
added.
5. Levels for the Mesh Object were defined
6. Facial Animation was not included in Main; a Hybrid extension of Main foreseen for Version
2, which includes FA. The Requirements Group did not accept the argument that the Face
would not have to be rendered, or only barely (a few points). This did however raise the issue
of what minimum rendering requirements would be for the Simple Face Object, an issue that
could not be resolved during the meeting.
Some NBs asked for a clear separation of profiles with natural and synthetic tools. After
discussion it was decided not to do this, because there was no consensus to make the change.
Reasons for not making the change were also:
a. it would introduce an extra dimension in Profiling, which was seen as undesirable
b. for some tools it is unclear where they belong (e.g. is a texture in Natural or Synthetic?)
Related to this issue, there was a long discussion about concerns (also from NBs) about the
inclusion of the still texture Object in the Main Profile. However, the discussion was not based on
evidence but on assumptions. Hence, it was decided not to change Main, and to ask concerned
parties to back their concerns with evidence.
New way of defining Levels included in Study on FCD
In a joint meeting with Implementation Studies, the new way of defining levels was discussed.
While there was consensus on the desirability of such a new and more flexible way of defining
levels, there were concerns for the following reasons:
a. Are the numbers really a good measure in all types of decoders (i.e. Hardware and Software)
b. how will Encoders implement the measure?
Both the old and the new way of defining Levels is included in the Study on FCD, and a
resolution was adopted asking for NB comments:
The Requirements Group recommends that NBs comment on the proposed new way of defining
levels using a complexity formula.
Numbers in Levels need cleaning up
will be done in AHG
Audio Profiles and Levels
The Profile and Level situation in Audio did not change much. It was decided to introduce two
new Audio Object types:
1. Null: for including local Audio in Scene Graph (= mixing)
2. Test: for generating test signals
It was confirmed that Parametric Speech should combine the HILN and HVXC tools.
Overview of Profiles and Levels
The Requirements Group agreed that the Profile and level situation in MPEG-4 is hard to follow,
and that it would be very useful to have a concise overview that would list all Profiles and Levels
defined within MPEG-4. Such a document was drafted by Olaf Barheine (based on his input
m3648 MPEG-4 Profiles/Levels Summary) and Kevin O’Connell.
Application Document
25
It was concluded that the applications document needs cleaning up. In the absence of Klaus
Diepold (and the uncertain return) the Requirements Group was very pleased to receive an offer
from Fernando Pereira to update the document after the meeting.
Version 2 related Requirements issues
Fine-grain scalability
Requirements for fine-grain scalability were confirmed and slightly extended in the MPEG-4
Requirements document. The primary goal is streaming over links for which the bitrate is not
known in advance, such as over IP networks. It was noted that such ‘fine grain scalability’:
 should work with pre-encoded material;
 should work in multicast environments.
Based on core experiments, it will be seen whether there is technology that can satisfy these
requirements (which will of course be after Version 1).
Because there was discussion about the practical applicability of the fine grain scalability, a
resolution was adopted as follows:
The Requirements Group recommends that a study be made to the applications and
operational environments for fine-grain scalability, to help deciding which tools suit the
requirements. In particular, this applies to how the proposed tools would work together with
transport protocols used on the Internet.
3D Meshes
Requirements on 3D meshes were updated in the Requirements Document. It was confirmed that
progressive download and error resilience -general MPEG-4 objectives are also important for 3D
meshes in particular. The Requirements Group was pleased to learn that the technology is likely
available in the SNHC group.
Overview
A new MPEG-4 Overview was drafted quickly after the meeting, based on contributions and
remarks received during the meeting, and on the changes to the standard introduced during the
meeting. There is now only one single Overview, which covers both Versions 1 and 2.
MPEG-7
MPEG-7 Requirements issues
Again the issue of push versus pull was discussed. The conclusion was that there was no impact
on the Requirements Document. Also again, the issue of real-time vs. non real time was brought
to the discussion. Again it was decided that there is no need for a split in two tracks. The Ad Hoc
Group on MPEG-7 Requirements would be the place to discuss whether requirements were
adequately addressed for real-time database applications.





The definition of a DS was changed to allow hierarchical nesting of DSs.
Examples were included in the Main body rather than in annexes.
The issue of embedding code was discussed again. The conclusion was that it may or may not
be needed, but that the requirements for it are unclear, and that nothing can be done until they
are clear. Also, it was noted that a similar thing was developed in MPEG-4, but that this was
done at a later stage. Not all problems need to be solved at the same time.
IPR was confirmed to be an issue for MPEG-7 Descriptions too, and of course MPEG-7
descriptors need to be able to identify IPR on content itself. (Note that MPEG-4 OCI provides
a solution for this, that was much debated with the creative industries).
Storing user preferences was recognized as an important issue in MPEG-7 enabled
applications, but not as a prime responsibility for MPEG-7 at the moment.
26

New requirements for the DDL were identified. Among them are the capability to describe
spatial and temporal links, and inheritance.
Common (Intermediate) Language?
It was clarified that textual descriptions should support all languages (i.e. international character
sets). Note that MPEG-7 will not focus on descriptors for text. It was noted that ‘a textual
descriptor’ (for possibly non-textual content) is not the same as ‘a descriptor for text’.
The desirability of a ‘Common Intermediate Language’ was discussed. Although everybody was
sympathetic with the idea, people with experience in the field (and there were quite a few around)
explained why this is very hard - or even impossible - to achieve.
In the light of this discussion, a requirement was added that MPEG-7 should support textual
descriptions in multiple languages, and that it should be possible to indicate that the descriptions
are supposed to be multiple representations of the same description.
MPEG-7 Systems?
In a discussion and a joint meeting with Systems, the possible need for an MPEG-7 Systems layer
was discussed. Olivier Avaro explained that many features could be provided by MPEG-4
Systems/DMIF, among which:
 synchronization and multiplexing of different MPEG-7 and content streams (implementation,
not just a specification like SMIL)
 client-server interfaces
 abstraction from service model (broadcast or on-line)
Note that MPEG-4 Systems has already defined a streamtype called ‘MPEG-7’.
The conclusion of the discussion was that the AHG on MPEG-7 Requirements would have a
study item ‘Requirements for MPEG-7 Systems’.
MPEG-7 Documents
The duplications between the various MPEG-7 Documents (notably C&O, Requirements, PPD,
CfP and Evaluation Documents) were removed. New versions were issued for all these
documents, based on work done in the Ad Hoc Group. Definitions and drawings were clarified in
these documents.
The fact that MPEG-7 is an open, platform-independent standard was reconfirmed as a matter
beyond all doubt.
Applications Document
The distinction between ‘Application Requirements’ and ‘MPEG-7 Requirements’ was made
explicit.
MPEG-7 Evaluation
First, it was clarified that the tests under discussion were for the evaluation of answers to the Call
for Proposals, not for all experiments during the entire MPEG-7 development phase (i.e. for
‘Core Experiments’)
Long discussions took place on the way evaluation would be done. After the AHG meeting in
Paris and discussion with usability experts, it became clear that evaluation in the context of
applications would not be a good approach. It would leave too many questions about a) what is
exactly evaluated? and b) how generic are the results?
Therefore, a different path was chosen, that concentrates on the basic functionality of the
elements of the MPEG-7 Standard.
The result is that experts, against the requirements, will evaluate the DDL and DSs. For
Descriptors (and for some Description Schemes) some kind of testing will be devised. This
testing is entails making an assessment of how well material is retrieved based on similarity
(‘query by example’). Proposers are further invited to explain and demonstrate their proposals.
27
It was decided to make not only the draft CfP and the PPD, but also the draft Evaluation
Document publicly available - with the proper disclaimers.
A timeline was agreed; it can be found in the output documents. There will be a compulsory preregistration in December.
UML was proposed as a ‘loose’ basis for the specification proposals. A one/two page guideline
will be developed for proposers who don’t know UML. It was made clear that this does not
constitute a choice with respect to the DDL.
An AHG on MPEG-7 Evaluation was put into place. It will have an AHG meeting on Saturday 10
and Sunday 11 October in Atlantic City.
Questionnaire
During the meeting draft questionnaires were developed for the different types of submissions.
There were some concerns on the length of the forms.
eXperimentation Model and Software Policy
Just as in MPEG-4, proposers will be required to donate source code for their descriptors upon
acceptance of their proposal in the eXperimentation Model. The same policy and conditions as in
MPEG-4 will apply.
This means source code for experimentation, and possibly object code for validation.
Meeting venue offer
The Requirements Group was extremely happy to receive an offer to host the MPEG-7
Evaluation meeting, from:
Lancaster University Computing Department,
Distributed Multimedia Group,
located in Lancaster, UK
The contact: Ed Hartley (e.hartley@lancaster.ac.uk)
The offer was confirmed during the meeting and the dates were fixed as follows: February 15-19,
1999
Test Corpus
The available content was reviewed during the meeting. It was good to see that many people and
companies had taken - sometimes great - trouble to get content cleared and available to MPEG.
The Requirements Group was happy with the effort of these companies.
It was concluded, however, that some material is still lacking and hence an additional Call for
Content was drafted during the meeting. The call asks for Images, Video and Audio. The exact
conditions for usage were fixed during the closing plenary (see Resolutions).
Seungyup Paek kindly volunteered to be responsible for the collection and distribution of the
Corpus. The Requirements Group was very glad to accept his offer, as well as Telefónica’s offer
to perform encoding.
Commercial CD’s will be chosen for some of the Audio content. Everyone can buy the CD’s.
Joint meeting with Video Group.
Two MPEG-7 contributions on descriptors were discussed in a joint meeting with Video. The
meeting was well visited. The group looks forward towards receiving the descriptors as proposals
in response to the CfP.
Liaisons
Liaisons were discussed with CEN and SMPTE, who are both doing work in the same area. The
group was pleased to have not just liaison documents, but actual people present to explain what
28
they are doing.
Audio Issues
Audio involvement is still lacking in MPEG-7. Therefore, a special AHG was installed to
organize Audio involvement.
Agenda Requirements Group
When
What
Where
Monday
9.00 - ??.??
opening plenary meeting
until 1 hour after closing of plenary (estimate: 13.30 – 14.30):
lunch
14.30 - 15.30 Meeting goals Requirements, Approval of agenda, Assignments (MPEG-2, 4 & -7)
3607 Rob Koenen - Report of AHG on Profiles and Levels
Review of MPEG-7 AHGs
15:30 - ????
3574 Frank Nack - MPEG-7 Requirements Document V.6
3575 Frank Nack - MPEG-7: Context and Objectives V.8
3641 I. Sezan, et. al. - Report of AHG on MPEG-7 Requirements
3740 Adam Lindsay - MPEG-7 Applications Document
3785 JEANNIN Sylvie et. al. - Report of the Ad Hoc Group on MPEG-7 Evaluation
xxxx Draft MPEG-7 Evaluation Procedures Document
Cloak
done
Thu
done
 Thu
done
 Thu
Tuesday
09.00 -10.00
MPEG-2 Business (with interested Video people)
3625 Bruce Penney, SMPTE - SMPTE Comments on MPEG-2 Video PDAM5
3662 Ajay Luthra, Yoichi Yagasaki - Report of the Ad-hoc Group on MPEG2
4:2:2P@HL
3760 The National Body of Japan - JNB Comments on 422P@HL
3781 USNB - USNB Contribution - Comments on MPEG-2 4:2:2@VHL
10.00 - 10.45
MPEG-4 at higher quality (with interested Video people)
3618 Krit Panusopone et.al. - Proposal for MPEG-4 4:2:2 video
3637 Teruhiko Suzuki, Yoichi Yagasaki - Proposal to support 4:2:2/4:4:4 video
3697 Hiroyuki Imaizumi et.al. - Experimental results for studio profile in MPEG4 V.2
3739 NEMESIS - Contributions from NEMESIS to MPEG-4 Studio Profile
11.00 - 13.00
MPEG-4 Applications & Profiling (for Study on Visual FCD)
3648 Olaf Barheine - MPEG-4 Profiles/Levels Summary
3711 Klaus Diepold (editor) - MPEG-4 Applications Document (Revision)
3629 The National Body of Japan - JNB Comment on Simple and Core Profiles
3642 P. van Beek et.al. - Level parameters for 2D mesh object (combination)
profiles
3695 Singapore National Body - Singapore National Body Comments on Visual
Profiles
3771 German NB- Definition of Visual Combination Profiles in FCD of 14496-2
3775 USNB - USNB Contribution - New MPEG-4 Video Tools
3778 USNB - USNB Contribution - Predictable Appearance of Simple Facial
Object
13.00 - 14.00
Lunch
Joint
with
Systems
(File Format)
14.00 - 15.00
done
done
done
done
done
done
 Thu
done
done
 Thu
done
 Thu
 Thu
done
done
(open)
Cloak
29
15.00 - 17.00
17.00 - 18.00
MPEG-7 Business
Joint with Systems and Audio (Composition and Level definition)
3604 Giorgio Zoia, et. al. - Proposed revision of Systems and Audio profiles and
levels from an analysis of audio composition
3587 Ulrich Horbach, Attila Karamustafaoglu - Quality Aspects of MPEG-4
Audio Processing
Cloak
Audio
done
MPEG-7 Contributions
3580 B.S.Manjunath, et.al. - Texture Descriptor for Browsing and Retrieval of
Image Data
3620 Takanori Senoh - MPEG-7 Test Data Format and Content Description
Language
3649 Werner Kriechbaum - Some remarks on Document Structure and DSs
3651 Paulo Villegas - User Contexts for MPEG-7
3720 Jens-Rainer Ohm, et. al. - Some Aspects related to M7 Data Structure and
Access
3721 Jens-Rainer Ohm, et. al. - Some Aspects related to M7 Description of
Visual Object Features
3776 Frank Nack et.al. - Some Aspects on MPEG-7 Ds,DSs,DDL and their
evaluation
3782 Gwendal Auffret, et.al. - Proposal for a minimal MPEG7 DDL for temporal
media
3813 Radu S. Jasinschi, et. al. - Comments on Description and Feature
Requirements in MPEG-7
13.00 - 14.00
Lunch
14.00 - 18.00
MPEG-7 continued from the morning
Spill-over from Contributions listed for the morning
Continuation of discussion on PPD and Evaluation Document
Liaisons
3712 Kyu-Won Lee, and Munchurl Kim - Some considerations on the Evaluation
procedure and Distribution of Test Material
17.30 - 18.30
Joint with with Video and ISG about Profiling
at night
Social Event
Cloak
done
done
done
done
done
done
done
Wednesday
11.00 - 13.00
done
done
??
Cloak
done
Thursday
8.30 - 9.00
9.00 - 10.30
Joint with SNHC
New 3D requirements
Joint with ISG: MPEG-4 Visual Version 1 Issues
3619 Manish Singhal et. al. - Request for HDTV level for Main Visual
Combination Profile
3695 Singapore National Body - Singapore National Body Comments on Visual
Profiles
3645 Gauthier Lafruit et. al. - Complexity analysis and guidelines for profile definition of Still
Texture Coding.
3642 P. van Beek et.al. - Level parameters for 2D mesh object (combination) profiles
10.30 - 11.30
MPEG-4 Requirement Issues (1st part joint with Video)
???? Requirements for fine-grain scalability (Contribution to be provided)
3697 Hiroyuki Imaizumi et.al. - Experimental results for studio profile in MPEG4 V.2
3710 Yoichi Yagasaki, et. al.- Requirements of MPEG4 video coding for studio
application
Cloak
Cloak
done
done
done
done
done
done
done
30
11.30 - 13.00
Joint with Systems
3657
N.A.
3842
3714
Sadik Bayrakeri, C.C. Lee - Requirements for Multi-User Interactions
MPEG-J Requirements
Something about sound BIFS requirements???
Graham Thomas - Report of AHG on Normative Composition
Systems
Atlantic
C
Atlantic
C
Atlantic
C
done
13.00 - 14.00
Joint meeting with Video
3685 Yong-Sung Kim, Whoi-Yul Kim, Young-Sum Kim - A Rotation Invariant
Shape Descriptor using Zernike Moment and Its Application
3580 B.S.Manjunath, Hyun Doo Shin - Texture Descriptor for Browsing and
Retrieval of Image Data
14.00 - 15.00
Joint meeting with Systems on 'MPEG-7 Systems'
15.00 - 18.00
MPEG-7 Issues Notably evaluation
Evaluation
PPD
Friday
9.00 - 9.30


9.30 - 10.30


10.30 - 11.30


12.30 –
14.00
14.00 –
21.30
wrapping up MPEG-2
PDAM, Disposition of comments, resolution on 1088 lines
AHG on High Quality Applications in MPEG-2/-4
wrapping up MPEG-4
Requirements Document, Studies on FCD's, (Applications document ?)
AHG on Profiles and Levels? Overviews???
wrapping up MPEG-7
nd
PPD, 2 advance CfP, Draft Evaluation Procedures Document,
Requirements Document, Applications Document,
AHG MPEG-7 Requirements; AHG MPEG-7 Evaluation; AHG MPEG-7
Audio
Lunch
plenary meeting
done
done
Systems
Cloak
done
done
31
Annex 4
DMIF meeting report
Source: Vahe Balabanian (Nortel), Chair
DMIF experienced a record attendance of 20 delegates at the Dublin meeting.
Note: The full report is uploaded as M3857 on the drop.chips.ibm.com (userid sc29wg11 + a
password)under Atlantic/Contributions. All the documents identified in this report are also
available on the same MPEG ftp site under the Dublin directory. The passwords can be obtained
from the National Body Head of Delegations.
The following are the results of the meeting grouped under the headings of DMIF and DSM-CC.
DMIF:
1)
Study of DMIF V1 FCD N2310

Good individual inputs and discussion at this meeting.
Inputs from M3646, M3654, M3727 and M3806

QoS operation over transport moved to DMIF V2. However some elements were added such as stream
dependency across DAI for local management of the stream transport in DMIF V1. (See Note 1 below)
Need to make ES dependencies visible through DAI.
(See Note 1 below)







Application signaling e.g., for VCR-like stream control, is now supported across DAI through a normal
reliable 2-way channels. The only changes required to DMIF are in the Direction and QoS Descriptor
parameters. (See Note 1 below)
A consensus was reached on schemes for URL(s) in DMIF
New URL tags are required for new delivery technologies integrated in DMIF. Existing URLs will be
used by an xd prefix when DMIF signaling is involved or as is, when no DMIF signaling is involved. (See
Note 1 below)
Annex D, BIFS Carousel moved from DMIF spec to the Systems spec. The alignment of the Systems
and DMIF FCD documents will be finalized in conjunction with the Study of the Systems FCD, see AHG
N2369.
Need to make SLConfigDescriptor visible through DAI. This to allow for a single stream mapping of
the Elementary Stream to RTP. (See Note 1 below)
DMIF needs to clarify that its channel management mechanism is symmetric and independent of
channel direction. (See Note 1 below)
Note 1: A national Body comment for this change with actual
replacement text is requested.
2)
Review and Demo of the DMIF V1 Reference code




3)
A DMIF implementation was demonstrated by Xbind Inc. using MPEG-4 FlexMux over IP.
Only executable code is available from Xbind Inc. see, M3655
A DMIF development Kit for IM1 version 1 is available in M3727
Plan to interoperate the Xbind implementation with IM1 after Atlantic City Oct 12-16/98
Review and update DMIF V1 Conformance (folded into N2273, MPEG-4
Conformance)

The existing document was reviewed and changes outlined.
Test cases will be developed for Oct/98 with the
participation of Mr. Vahe Balabanian, Nortel, Canada,
32
Mr. Ulrich Mayer of Darmstadt Univ., Germany and
Dr. Javier Zamora of Xbind Inc., USA
4)
DMIF V2 WD 3.0 N2312
· Good discussion on how to operate on mobile networks.
An AHG was established see N2315, to improve the extensions to DMIF for mobile. Close coordination with
H.324 is being established through Mr. Yoshihiro Kikuchi Toshiba, Japan as the liaison person see N2384.
· Proposal for normative DAI interface see M3854
· QoS Management and feedback of monitoring is a critical piece of DMIF V2, since it requires
interoperability. A survey of QoS monitoring in RTCP and H.245 is required for proper
decision making in October/98. Inputs are requested.
· DMIF V2 will operate with network servers e.g., Session and Resource Managers (SRM) and
gateways. Input is required for backward compatibility of the DMIF SRM with the DSM-CC
SRM.
· The same policy of integration as adopted in DMIF V1 will be followed in V2 for network
servers and gateways. A liaison letter was sent to IETF indicating the MPEG-4 intent to
integrate with SDP, RSVP, RAP, INT SERV, DIAMETER, LDAP, COPS, RTSP and SIP as
appropriate. The designated informal liaison person is Mr Vahe Balabanian, Nortel, Canada,
see N2377.
5)
DMIF FAQ N2313

The DMIF FAQ has been updated to reflect the DMIF V1 FCD specification text. This can also be
found on the MPEG home page http://drogo.cselt.it/mpeg/
DSM-CC:
1)
Study of the DSM-CC Conformance FCD N2314

2)
Individual inputs M3531, M3532, M3533, were reviewed.
Four missing test cases were identified and require National Body input at Oct/98.
Text of ISO/IEC 13818-6/FPDAM1 N2264

The status of the PDAM1 was raised to FPDAM1 as a result of successful ballot approval.
Next Meeting:
MPEG 45 Oct 12-16/98 Atlantic City NJ
Next Target Dates:DSM-CC Conformance 13818-10 FDIS – Oct. 1998
DMIF 14496-6 FDIS – Oct. 1998
DMIF ver. 1 conformance WD 2.0 –March 1998
DMIF V2 CD—December 1998
33
Annex 5
Systems meeting report
Source: Olivier Avaro (France Telecom), Chair
Overview
The MPEG Systems Sub-group delivered in Dublin a major improvement of Version 2
specifications for each of its sub-activities : advanced scene description (BIFS), MPEG-4 Java
based application engine (MPEG-J), file format (MP4) and management and protection of
intellectual property (IPMP). This improvements are described below. In parallel to these efforts,
revision of the Version 1 FCD is continuously taking place through the numerous comments
made by National Bodies. Finally, during the Dublin meeting, several real time software
applications based on the Im1 framework have been demonstrated, bringing the MPEG-4
specifications to reality. The various Systems break-out group reports can be find in an attached
document.
Advanced BIFS
The advanced BIFS activity extends the Version 1 set of BIFS nodes. Among these nodes, the
specification and implementation of nodes existing in VRML and not supported by MPEG
Version 1 (e.g. : PROTO, scripts, …) is making significant progress. If the activity continues at
this speed and MPEG customers request so, these nodes may be included in Version 1.
Remaining Version 2 nodes will unable the description of spatialization properties of virtual
worlds as well as the creation of multi-user environments.
MPEG-J
The MPEG-J activity addresses a flexible system for programmatic control of an audio visual
session to adapt to the operating conditions of the terminal. At the Dublin meeting, the existing
architecture of MPEG-J was refined. Several companies (Sun, AT&T, Philips, Microsoft,
CSELT, SIA, FINSIEL) contributed to this activity, in particular by providing Java API’s to this
meeting. Through a process of convergence, a first set of API’s has been defined. Additional
API’s proposed by Sony to allow multi-user world to be supported by MPEG-4 are under
consideration and should be introduced in the current architecture.
File Format
Work continued on the development of the MP4 format, the stored content format for MPEG-4.
Further progress was made in integrating the MP4 format with the other portions of the MPEG-4
specification, and development of reference software has begun. Content authors, providers, and
other interested parties are encouraged to join the effort at defining this format specification
scheduled for December 1998.
IPMP
The proposed technical specification for IPMP (M 3537) was refined and introduced into the
MPEG-4 Systems VM for Version 2. To facilitate this, a dedicated Systems Plenary was held on
Tuesday morning. As a result of this meeting, the IPMP specification was refined and passed on
to the VM/WD editor. To enable the IPMP specification to be included into the MPEG-4 standard
Version 1, a Verification Test, described in the Im1 workplan needs to be conducted.
Logo
A competition for Systems logo has been proposed. The best logo will be chosen in Atlantic City
34
upon the vote of the Systems people. The Systems chair promised to allocate a Magnum bottle of
Champagne for the happy winner.
Detailed Report
Version 1
Study on FCD
The comments from National Bodies as well as personal input contributions related to the FCD
have been collected and discussed during the meeting. The list of comments is available as Study
of FCD (N2349).
Only the main issues were discussed. These discussion should continue on the spec-sys@fzi.de
reflector (the esm-sys@fzi.de is discontinued). New issue should be brought up as early as
possible.
An interim editors meeting is planned to integrated Study on FCD input document for Atlantic
City meeting. This document will be the starting point for the creation of FDIS, in anticipation of
the resolutions of NB comments.
The main issues concerning the study on Systems FCD were the following :
1. Handling of upstream control channels (a solution is provided with a control Stream type)
2. Stream control : play, pause, etc... (a solution is provided with the new BIFS Message node)
3. Broadcast carousel (a solution is provided in the Systems Sync-layer)
4. URLs (a solution is provided in the DMIF specification)
5. IPMP compatibility in Version 1 (a solution is provided in the study of FCD)
6. Global stream identification (a solution is provided in the study of FCD)
7. Association of Face and Audio nodes to a TTS stream (specification improved but further
work needed to integrate it).
Cross checking of the items above and final drafting of the study of FCD needs now intensive
work on the specification reflector : spec-sys@fzi.de.
Conformance
The activity on conformance clearly insufficient. If the needed resources are not allocated and if
the work does not make significant progress, there is a big risk that further MPEG-4 Version 2
activity will stop. Jean-Claude Dufourd has volunteered to be the main editor as well as the
Systems editor of what will be MPEG-4 Part 4 “Conformance”.
The activity on video normative composition has been stopped because of lack of contributions.
Methodology for evolution from FCD to FDIS
We have produced in Dublin a Study on Systems Final CD. This document has no official value.
The Systems sub-group will now :

Continue to work on the study of FCD in order to provide for clean normative text for the
bugs that have been identified and fixed.

Take care that all the comments that we foresee are taken into account by at least one national
body, that will report them at the second round of comment in Atlantic City.
35
In Atlantic City, Systems will produce the FDIS, and no more technical changes to the Version 1
specification (only editorial) will then be possible.
Version 2
Advanced BIFS
The following items have been treated in advanced BIFS :
· The audio nodes have been enhanced.
· The user interaction nodes have been enhanced.
· The specification of missing VRML nodes has been enhanced.
· The nodes related to multi-user world have been introduced.
The relation ship between the current version 2 specification on user interaction node and the new
version BIFS node needs to be clarified.
A new node has been proposed to allow the coding of visual objects with existing algorithms like
MPEG-1/2, H.261/3, GIF, JPEG, … The node has been introduced as core experiment in the
Version 2 BIFS VM. The AHG on BIFS should evaluate with the Requirement group, the Video
group and the ISG group if such a functionality should enter the MPEG-4 standard.
MPEG-J
The contributions Java API’s have been reviewed by the group and a set of API has been chosen.
During a discussion with IPMP, the conditional access API’s are withdrawn. There were no
consensus on inclusion of Multi User Interaction (MUI) API’s in MPEG-J as proposed by Sony.
A place holder has been created in MPEG-J and the issue shall be resolved within the MPEG-J
AHG.
A list of companies have committed themselves for software validation and implementation. For
validation, the presentation engine can be proprietary and only made available in the form of an
executable. The software associated to the application engine has to be provided in source code
according to WG11 rules on software donation. After validation, the API’s go to WD stage. For
Part 5 version 2 implementation, a complete and unique software implementation of the
presentation engine will be developed jointly by the companies based on Im1. This presentation
engine as well as the application engine will be ready at CD stage and be donated according to
WG 11 rules.
Finally, a contribution has been proposed to use ECMA Script for the application engine. It has
been decided that the best technology will be chosen in accordance to the MPEG procedure of
core experiment. In case both ECMA Script and the current MPEG-4 VM choice (Java), satisfy
equally the MPEG-4 requirements in terms of performance and functionality, the VM technology
will stay as is. A core experiment on ECMA Script for use in the MPEG-4 engine will be
introduced in the current VM and published on the MPEG-J and Systems reflector within 10 days
after the Dublin meeting.
MPEG-4 File Format
The MPEG-4 File Format Break-out Group met throughout the entire week. The work was
chaired by Dave Pawson. All input documents were processed.
The goals of the Subgroup were to review comments since Tokyo, to clarify relationships
between systems and audio/visual, to clean up unnecessary open issues and to assign “owners” to
remaining open issues.
During the meeting, all AHG suggestions and submissions have been reviewed and the results
have been incorporated into the VM. 21 open issues have been reduced to 10, several are already
written up and ready for ad-hoc distribution and discussion.
36
In particular, it has been concluded that the sample table and constituent atoms satisfy our
requirements, the carriage of FlexMux has been resolved by storing relevant tables in Sample
Description Atom of hint tracks, the appearance of SL-Packets in stored content has been defined.
Results of this meeting have been included for version 2 systems VM 3.0. It has been verified that
the file format properly supports audio/visual. An AHG will be created to continue VM
development and track progress of open issues. Implementation will continue; QuickTime code
will migrate towards “true” MP4 and the merging of this code with IM1 will be investigated.
IPMP
The Intellectual Property Management & Protection (IPMP) Break-out Group met throughout the
entire week. The work was chaired by Niels Rump. All input documents were processed.
The proposed technical specification for IPMP (M 3537) was refined and introduced into the
MPEG-4 Systems VM for Version 2. To facilitate this, an exhaustive Systems Plenary was held
on Tuesday morning. As a result of this meeting, the IPMP specification was refined and passed
on to the WD editor.
To enable the IPMP specification to be included into the MPEG-4 standard Version 1, a
Verification Test needs to be conducted. This test will use IM1. A meeting with IM1 was held to
discuss issues related to this test. To conduct the test, a detailed test plan will be set up by July
24. It was agreed that the tests results should be available by September 15, 1998. To facilitate
these tests, an ad-hoc group needs to be established. An ad-hoc meeting may take place in
Sunnyvale, California, in mid-September.
A joint meeting of the IPMP Break-out and MPEG-J Break-out groups was held on Wednesday
to discuss IPMP/MPEG-J issues. Further discussion between these groups is needed to reach full
understanding of the issues.
The comments of the Japanese National Body on MPEG-4 IPMP (M3681) have been answered.
Methodology for evolution in Version 2
The methodology for evolution of the VM is described on the MPEG home page and follows the
Core experiment process. Syntax and semantic specified in the VM will go in the WD only when
validated (implemented, tested and exercised).
Im1 Project
The Im1 project, lead by Zvi Lifshitz has the goal to develop, integrate and demonstrate Systems
Version 1 and 2 Software.
The demonstration took place at the Wednesday plenary. MPEG-4 browser and applications
based on the Im1 technology have been demonstrated in various scenario. Player, samples and
methodology to create the content has been made available to the MPEG community. JeanClaude Dufourd (ENST) also made available and authoring tool to create 2D MPEG-4 scenes.
A new implementation workplan has been defined for Version 1 as well as for Version 2 and
should be accomplished with the help of the committed partners. More specifically, this workplan
includes the demonstration of MPEG-4 over a satellite channel in Atlantic City, the
demonstration of IPMP functionality, the integration of MPEG-J and MP4 software and the new
advanced BIFS feature.
The status of the Im1 software will be published no later than the 15th of September as input to
National Body for their comment.
General Documentation
The overview documents as well as the FAQ for MPEG-4 Version 1 and Version 2 have been
37
reviewed and the relevant parts of both documents have been updated.
Output Document and AHG
Title
Systems Version 1 Study of FCD
Version 1 Templates for FCD Comments
Guidelines to editors for Systems and DMIF specification
harmonisation
Status of the Systems Version 1 Software Implementation
Systems Software Implementation Workplan
Streams data base V.2
Quick guide for MPEG-4 scene creation
IM1 software tools
2D BIFS scene editor
MPEG-4 Systems Version 2 WD 3.0
MPEG-4 Systems Version 2 VM 3.0
MPEG-4 IPMP Overview
MPEG Systems Workplan
Systems FAQ
No.
N2349
N2350
N2351
N2352
N2353
N2354
N2355
N2356
N2357
N2358
N2359
N2360
N2361
N2362
Title
AHG on Systems Specifications Editing
Chair(s)
No.
Eleftheriadis & al.
N2369
AHG on Systems Conformance
Dufourd & al.
N2370
AHG on Advanced BIFS
Signes & al.
N2371
AHG on MPEG-J Specification and
Implementation
AHG on MPEG-4 File Format
Fernando & al.
N2372
Pawson
N2373
AHG on Intellectual Property Management &
Protection
AHG on IM 1 Software Platform
Rump & al.
N2374
Lifshitz & al.
N2375
AHG on MPEG-X
Rob Koenen & al.
N2376
38
Annex 6
Video meeting report
Source: Thomas Sikora (HHI), Chair
The video group addressed in its meeting issues related to MPEG-4 (Version 1 and Version 2),
MPEG-7 and MPEG-2. The major effort in the group was dedicated towards progression to
Committee Draft (CD) of the Visual part of the MPEG-4 standard.
MPEG-2
High Quality Video at High Resolution
At the meeting the parameters for coding video at MPEG-2 4:2:2@HL were reviewed and a
Proposed Draft Ammendment PDAM document was released.
MPEG-4 (Version 1)
FCD
The video group evaluated the NB comments issued on the FCD of MPEG-4 and discussed
possible reactions to NB’s. Based on the outcome of the discussions and taking into account a
number of minor technical problems found in the FCD a “Study on CD” document was
issued.
Software Integration and Verification
A schedule for continuing software integration and verification was developed. A detailed plan
for testing combination of tools was issue. The schedule targets to complete the bitstream
verification by the time the FCD ballot takes place.
Additional Tools for Version 1
The video group reviewed the possibility to include additional tools into Version 1 (GMC, ¼
pel MC and BBM). Considering that the verification and software integration of existing tools
is already at a very late stage, the decision was taken to not support an integration of new tools
into Version 1.
Verification Tests
The results of the “Error Resilience” verification tests were reviewed. In general the results
showed an excellent performance of the new tools developed under experimental testing
conditions. For a bitrate of 128 kbit/s one test sequence showed unexpected artifacts. Further
experimentation prior to the next meeting will clarify the possible testing conditions for a new
verification test.
Further verification tests are under preparation for content-based coding and scalable coding of
video. The test for content-based coding is targeted for the time prior to the November meeting in
Israel. For this purpose a number of test conditions were defined and a number of test sequences
are to be prepared prior to the US meeting in October. Outstanding questions to be clarified are:
39


Rate control for comparison of stand alone MPEG-1 and MPEG-4 coding efficiency
Implementation of multi-layer rate control for object-based coding of video
At the October US MPEG meeting pre-screening of the results will be done in the video group.
Based on the outcome a decision will be taken whether verification tests will be performed prior
to the Nov. Israel meeting or not.
A further subject for verification tests addresses scalable coding of video. Also for this subject
new results will be presented at the next meeting.
Conformance
Good progress was made for the specification of conformance of MPEG-4 video coding systems.
The discussions in the video group identified that MPEG-4 video conformance could be defined
in a similar way as specified for MPEG-2. However, the availability of official software could
introduce a new way of measuring conformance against a benchmark. Further discussions need to
take place to clarify the issues. A new version of the MPEG-4 conformance working draft was
released.
MPEG-4 (Version 2)
Tools to be supported
A major item under discussion was the decision on tools to be supported by Version 2. Based on
input and tape viewing a number of decisions were taken. Based on NB resolutions and Tokyo
meeting plenary resolutions it was agreed to assist the following tools that were already under
discussion for Version 1:




GMC
¼ pel MC
BBM
SADCT
Additional tools agreed to be supported by version 2 are listed below. These tools provide new
functionalities compared to version 1:






Newpred (Error Resilience)
Object Spatial Scalability (Scalability)
Multiple Alpha Channel Coding (Various)
Error Resilience for Still Texture Coding (Error Resilience)
Scalable Arbitrary Shape for Texture Coding (Scalability)
Wavelet Tiling (Still Texture)
Output documents
A new version of the Working Draft for Version 2 was released.
MPEG-4 (Further)
40
Advanced Layered Coding
New proposals for advanced layered coding of video at high bit rates were reviewed. Based on a
number of discussions and results generated between the Tokyo and the Dublin meeting some of
the remaining questions on the techniques used in the proposed schemes were clarified. At the
meeting the attempt was to separate pre-processing techniques used in the proposals from encoder
issues required to be specified for standardization. A plan to verify the merits of the proposals in
comparison to the established MPEG-2 and MPEG-4 scalable coding approaches was issued.
It was decided to discuss the proposals on Advanced Layered Coding in the context of
MPEG-4 rather than for an amendment MPEG-2. The partners involved are Chromatics,
NDS, Philips and U-Hannover.
Fine Granularity Scalability
Various partners expressed the desire to explore the MPEG-4 video system for internet video
applications using fine granularity scalability approaches. It was identified that it is important in
this context to understand the application context in more detail and to issue requirements
accordingly. It was agreed that a fine granularity scalability system should be compatible to
MPEG-4 Version 1 at the based layer. It should also be investigated whether it is already possible
to provide this functionality with existing MPEG-4 technology already.
Studio Applications
The need to provide MPEG-4 solutions for very high quality applications was expressed by a
number of MPEG member companies and NB comments. This would request the MPEG-4 video
coding system to be extended to 4:2:2 and 4:4:4 formats with possible extension of the toolkit
(scalability).
It was decided to identify the needs and technical issue both in the requirements group as well as
in the video group. Further experimentation will be required to clarify the performance of MPEG4 video at very high bit rates.
MPEG-7
The activities of the MPEG-7 group were reviewed and discussed in the video group. Further two
input documents related to MPEG-7 image database query systems were presented and discussed.
41
Annex 7
Audio meeting report
Source: P. Schreiner,
D. Meares,
Chairman Audio Subgroup
Secretary Audio Subgroup
Opening of the meeting
The MPEG/Audio Subgroup meeting was held during the 44th meeting of WG11 in Dublin,
Eire on 6 to 10 July 1998. The list of participants is given in Annex A-1. The Chairman
welcomed the delegates to the meeting and outlined the work for the five days
Administrative matters
Approval of agenda
The agenda as presented in Annex A-II was discussed and approved.
Tokyo meeting report
The Audio Subgroup portion of the Tokyo meeting report, March 1998, had been previously
distributed by email. Comments had been returned demonstrating the need for clarification of
what was written. These changes were made and entered into the record of that meeting. The
resultant report was therefore approved.
Allocation of contributions
All contributions were listed (see Annex A-VI) and allocated to the agenda. All contributions
directly related to the Subgroup except for the MPEG-4 version 2 work on Environmental
Spatialisation were presented in task group discussions, or in Audio plenary. Several relevant
documents from Test, Systems and Requirements were brought to the attention of the group by
the secretary.
Communications from the Chair
The Chairman summarised the detailed allocations and questions raised at the Chairman’s
meeting held on the evening before the main meeting started. The majority of these, by design,
were already in the agenda.
 AAC licensing details were discussed. The matter was noted as improving but not
yet totally resolved. The idea of a ‘one-stop’ licensing contact point was well
received.
 Synchronisation of TTSI and FBA
 Concern on progress of CELP codecs
 Update on MPEG-4 Version 1 and Version 2 Overviews
 General concern over MPEG-4 patents c.f. MPEG-2 AAC patents. Need to start
now.
 The Convenor will be asking for publication of MPEG-4 IS on the Web.
 MPEG needs an overall editor for Conformance
 More work requested on watermarking within Audio.
 “MPEG” has been trademarked but not by MPEG.
 Name change being considered for MPEG-4.
 MPEG-7 audio material needed - very short of examples.
42
 New copyright release form for software needs to be considered.
Joint meetings
Joint meetings were scheduled with Test, Systems, ISG, and Requirements.
Report of ad hoc group activities
Some of the ad-hoc group reports had been presented in the opening MPEG Plenary, some had
not. So all relevant details were presented to the Audio Subgroup and are recorded in the
appropriate part of this report.
Received National Body Comments
The National Body comments were reviewed in the context of specific agenda items as reported
below. Responses were drafted and passed to Liaison.
Liaison matters
Mr. Brandenburg kindly took care of the Liaison matters. He reported the issues to the Audio
Subgroup and worked the Subgroup’s wishes into the responses. During the week, a further
Liaison contact was made by email from DVB Technical Module to the Audio secretary
requesting information on AAC test results. The matter was considered and a response was
prepared by Mr. Meares. The report of the NADIB test results is being distributed through a
variety of liaisons.
Temporary task group formation
To accomplish the large number of tasks to be performed by the Audio Subgroup, 16 task groups
were formed as indicated in
43
Annex A-V.
The results of each of the task groups were presented to and discussed by the entire
Audio Subgroup, including iterations as necessary. The conclusions of the task groups are
presented elsewhere in this report and are included in the output documents.
MPEG-2
IS 13818-3 BC
Technical Report IS 13818-5/Amd 1 (AMD July 98)
No further BC related work was required. The AMD was approved, document WG11/N2262.
IS13818-4/DAM1 (DAM Jul 98)
The USNB comment on a conformance bitstream for the use of MC_CRC in the extension stream
was answered (It was later found that a new conformance bitstream will be required, and this will
be addressed at the next meeting.)
IS 13818-7 AAC
Conformance 13818-4 /DAM 1 (DAM Jul 98)
The viability of some bitstreams was raised, as was the need for additional streams (with ADTS
header or with DRC). Bugs fixing and provision of the new streams were confirmed, together
with volunteers to do the work. The approved FPDAM is given in document WG11/N2258 and
the DoC in document WG11/N2257.
The NB comments on Conformance were considered and resolutions offered. The viability of the
LSB-criterion for conformance testing on non-sine sweep signals with psychoacoustic coders was
questioned in the German NB comments. It was proposed that sine sweep only will be specified.
Mr. Dietz also proposed the use of PEAQ, the newly proposed ITU-R objective measurement
standard, as described in m3798. FhG have already used the system for their conformance work,
and they have found it useful. However this is a new standard with commercial IPR, and the
equipment is not yet available nor proven in practice. The problem appears to be that good
sounding codecs may be thrown out by the LSB-criterion: the PEAQ criterion is not so stringent.
The group agreed to delay the use of PEAQ until the commercial devices can be evaluated by
MPEG members. MPEG-2 AAC will use sine-sweep/LSB only tests for conformance.
Mr. Toguri presented the conformance test report m3584 from Nippon Steel for Mr. Fukuchi.
They had correctly decoded 10 bitstreams but had had difficulties with a further 8 bitstreams.
This had been identified as a bug in the pulse coding process, which had been recently fixed,
m3847. Double checks of these bitstreams with the bugs fixed will be completed shortly after
this meeting.
Technical Report 13818-5 /DAM 1 (AMD Jul 98)
A few bugs had been identified and were being corrected. The missing encoder codes to active
pulse coding were provided by m3855. It was additionally decided that the Technical Report
would be kept in line with the Technical Corrigendum, 13818-7/Cor 1. To this end, DRC and
other features of the corrigendum are being added to the Technical Report. The workplan for the
final work on Convergence and Technical Report is given in document WG11/N2298. The AMD
was approved, document WG11/N2262. The disposition of comments is given in document
WG11/N2261.
IS 13818-7 COR1 (COR Jul 98)
Mr. Johnston chaired a task group during the week that worked on all outstanding details in the
corrigendum. It was noted that the recent editing of the draft introduced PNS syntax into 13818-7,
which was essentially against the intentions of the Tokyo meeting. Mr. Herre noted that what the
group had tried to do was generate a text which was common between MPEG-2 and MPEG-4 in a
44
fashion that generated no PNS elements for MPEG-2 but did generate PNS elements in the
bitstream for MPEG-4. It was agreed that the essence of the intention had been that no existing
MPEG-2 hardware or bitstreams would be invalidated by these changes. The PNS element in the
MPEG-2 AAC will appear only in the informative text. It was determined that objects were
already defined in MPEG-4 for AAC without PNS ensuring that backward compatibility of
MPEG-4 to MPEG-2 AAC exists. Mr. Johnston prepared the DoC and the revised corrigendum
as given in document WG11/N2265 and 2266.
IS 13818-7COR1 (AAC Dynamic Range Control Issue)
Mr. Schreiner reported the progress at the ad-hoc meeting on AAC DRC. Not enough work was
done to allow a report of verification testing completion but editing continued throughout this
meeting and will be finalised within two weeks of the end of the Dublin meeting. Mr. Fellers
prepared a workplan showing how the remaining proving tests could be completed within two
weeks of the end of the Dublin meeting, document WG11/N2270
AAC licensing actions
The issue of delay in agreements on AAC licensing was discussed in Plenary. Mr. Brandenburg
reported the fairly recent, rapid progress on this matter. Four companies (AT&T, Dolby, FhG,
and Sony) had signed an agreement on exploitation and licensing, and the essence of the licensing
charges were provided to interested parties during the meeting. However, it was observed that if
the licensing arrangement for AAC took two years (approx.), the negotiations relating to MPEG-4
Audio are likely to be even more difficult and time consuming. Discussion was initiated during
the meeting to try to ensure as rapid a period of negotiations as possible.
MPEG-4
Technical issues
Compression techniques
Mr. Moriya presented m3686 reporting the convergence of Twin-VQ and AAC. The
rationalisation of the two toolsets covered extension of sampling rates and introduction of
Flexmux interface. Various sampling rates from 8 kHz to 48 kHz are now supported. However,
it was reported that there is some loss of quality as a result at certain combinations of
bitrate/sampling frequency/programme_item. It was noted that the complexity is significantly
reduced and some minor modifications to the quantisers and enhancement parts will be checked
out by the end of August. Mr. Moriya also has to submit bitstreams for conformance testing.
Mr. Nishigushi presented the Sony Labs appraisal of the proposed changes to NB- and WBCELP, m3700. This showed small improvements (typically one quarter of ‘slightly better than’)
in the quality in all modes tested, using Japanese listeners listening to English and German.
M3756 was presented by Mr. Nomura, describing the changes that they were proposing to their
CELP coder and their test results. The changes relate to the LSP-codebook and the LSP
Parameter. Modified syntax was provided. Again, very little improvement is given (it is
statistically significant, but is very small in terms of quality). Mr. Paley reported informal tests
done by TI, where they had evaluated CELP coding with noise signals. He reported problems
with noisy signals. It was ascertained that the changes in NB-CELP were constrained to the
contents of a code table.
In m3763, Philips report test results relating to WB-CELP Optimised VQ and MPEG-4 VM
(990508) Scaleable VQ. The results show a small improvement.
Mr. Richard presented m3758, which showed test results for three of the CELP options.
Modified NB-CELP is worse than G.723.1 but better than the unmodified NB-CELP. Modified
WB-CELP (mode7) is better, most of the time, than WB-CELP (mode3).
Mr. Tanaka also presented m3750 showing additional results with small differences.
45
Three decisions were required of the Subgroup.
1) NB-CELP mode 8 VM replace? Changes are to the informative post filter, normative
codebook changes and new values for LPC window. Accepted.
2) Modified additional mode, 6.2 kb/s and 30 ms frame size? Changes are an additional
configuration table entry in encoder and decoder (number of subframes and parses). 30
ms frame already there for lower bitrates. Accepted.
3) WB-CELP mode 7, modification to add additional modes? Add some tables (size 3K
words of ROM, 850 words RAM), no new tools, but increased complexity, with 75%
increase in ROM. Mr. Oomen carried out further analysis of the complexity of the new
mode, showing significant extra computational complexity in the encoder (perhaps 10:1)
and some increase in the decoder (2:1). Additional comparative listening was conducted
in the task group to quantify the benefits or otherwise of the new mode. Even on limited
listening, the improvements with respect to mode 3 of the NADIB test were clearly
noticeable, which in the context of the NADIB test results is good news. What is not
known is the benefit of the new mode with and without optimised VQ. Accepted.
It was noted that the addition of mode 7 allowing RPE and MPE for each of the earlier modes
requires an additional bit in the CELP configuration syntax. A proposal for this change was
approved and included in N2271. The reference software will be updated to reflect this change in
the ad-hoc activity until the Atlantic City meeting.
TTSI (Text-to-Speech Interface)
The TTS/FBA ad-hoc report was presented by Mr. Lee. They had concentrated on assessing
options for a markup language to convey the FBA information. 4 candidates, SSML, STML,
JSML and SABLE. The recommendation was to develop a new tool. Bookmark tools are also
affecting the TTSI functionality. Thus, it is proposed that full functions of facial expression
bookmark should be in the new tool in MPEG-4 version 2. The proposal is given in m3627. It
was suggested that a subset of full functionalities should be in version 1, just to time-lock TTS
and lip movement.
Mr. Ostermann presented a demonstration of the insertion of FBA bookmarks. The audio is not
affected; this has been previously demonstrated, but what about video? This can be affected by
trick-mode, such as skip sequence, which could lose a facial expression change. The solution is
to repeat bookmarks where necessary: in fact for every sentence in the limit. The matter was
resolved and will be covered by appropriate entries in the normative and informative parts of the
standard.
Mr. Lee reported the Korean NB paper on TTSI, m3692. Most of the points are editorial and
were approved. Mr. Lee prepared a response to the Korean NB.
Mr. Lee also demonstrated, in the context of m3680, a combination of TTS/FBA with markup,
showing functionalities of FBA, speed change, forward/reverse. The functionalities were proven.
His work is based on SABLE markup language. In m3680, he also showed how the TTSI could
be used with FBA and how the synchronisation could be achieved. This Markup TTS (N2286)
will be added to the MPEG-4 Version 2 Working Draft.
The report on the harmonisation of TTSI and FBA is presented in document WG11/N2281.
Structured Audio
Mr. Ray presented the report of the SA ad-hoc group, m3610. The MMA contribution is given
in m3609. The alignment of SASBF and MIDI DLS2 has been achieved and so common formats
are now a reality. There was still concern about some incomplete or incorrect details in the not
yet finalised DLS2. These items have been identified and work is continuing to rectify these
shortcomings until the next MPEG meeting. The completed work is now being incorporated into
the FCD. During the Dublin meeting, the matter of Levels for SA was addressed and is covered
in an output document from Requirements.
At a joint meeting with ISG, the matter of complexity of SA was discussed at length. Analysis
46
based on SAOL authorship applications was suggested. The possibility was discussed of new
profile or level where only those portions of SAOL for FX should be supported.
Mr. Ray introduced the question of how one can compute the level of complexity of the SA tools.
This topic is covered in documents m3602 and m3611. The proposal in m3602 was preferred as
it relates to real platforms and is presented in output document WG11/N2282.
Conformance testing of SA was discussed and internal test points that may not be economically
placed in a commercial decoder may be required. This will require further discussion in the SA
ad-hoc group.
The location of PICOLA, the speed change tool, in the standard was debated, and it seemed that
the obvious place for it was as a post-process in the FX processor and that it will be further
discussed within the SA ad-hoc group.
Due to the limited availability of resources the backchannel requirement for SA is being deferred
to MPEG-4 version 2.
Complexity
Mr. Spille presented m3605 the ad-hoc meeting report. Five new entries to the complexity table
were received, but very little email traffic was noted. There are still some open issues for this
meeting: where practical figures are not available, calculated figures will be introduced.
Systems issues
In a joint meeting with Requirements, Systems, and ISG the topic of audio composition was
debated. Mr. Horbach presented m3587 on the topic. Studer AG have looked into the question
of composition with a view to optimising processing power for typical composition actions, e.g.
crossfade, panning, delay. Means of carrying out these operations were suggested and the
principles discussed. Quality parameters were noted as important within composition.
Mr. Zoia presented similar ideas in m3604 to identify profiles and levels from an analysis of
audio composition. Various proposals were made in the document for the Levels within audio
composition and were discussed in the group. The proposals are well timed and will help in the
Task Group to define the SA composition profiles.
Mr. Coleman and Mr. Teichman monitored the Systems discussions during the week and reported
progress into the Audio Subgroup. For instance, random access to audio objects needs to be
considered by Systems for both ‘clean’ access for editing and ‘dirty’ access for break-in. The
issues raised are covered in document WG11/N2280.
Backchannel bitstream syntax
No time was available for discussing the issue of backchannel. It has been agreed that this topic
is work for MPEG-4 version 2.
Other matters
Mr. Richard introduced m3783 describing the MPEG-4 audio demonstrator that he has
developed. It copes with the functionalities of distance, multiple objects, spatialisation and realtime composition. He demonstrated this to members.
Audio 14496-3 FDIS (FDIS Oct 98)
Mr. Purnhagen presented m3745 on a review of the FCD, identifying a number of problems and
offering solutions. His recommendations included adding 9 bits/frame (0.28 kb/s) to HILN for
transmission of extra noise parameters for better coding of noise like signals. However, this has
not been checked on other types of programme material. This is to be checked out during this
week.
Also in m3745, changes in HILN are proposed to add scalability to HILN. Where this is only
applied to the encoder, and where it does not change the bitstream, it would be an informative
47
annex only to the FDIS. This was accepted. The other proposal, relating to normative changes,
was not accepted. Additional editorial changes were accepted.
Mr. Grill presented the reformatted style for the FDIS such that the section editors could prepare
their inputs in this fashion. He also reviewed, for the subgroup, the inputs that had been reviewed
in the ad-hoc group and task group. The Study on the FDIS and the study on the DoCs are given
in documents WG11/N2271 and N2272 respectively.
Conformance Testing 14496-4 WD (CD Dec98)
M3606 was presented by Mr. Spille. The ad-hoc group discussed briefly the issues of noise
generators, HILN sine components, TTS synch with FBA, SA filter specification, and AAC
conformance for perceptual noise tools. Further work was noted to be needed.
In the task group, a model for Audio Conformance elements was generated, as shown above. It
was noted, in doing so, that a PCM-Elementary Stream needs to be introduced directly into the
Compositor: this will need to be added to the FCDs of Audio and Systems. Also some elements
will need specific forms of conformance testing: looking for 1 LSB max. error is no longer
appropriate. Psycho-acoustic objective test methods may be useful (e.g. PEAQ from ITU-R), but
they too have their drawbacks. Mr. Inoue offered, in m3759, a testing procedure for HVXC.
Mr. Spille worked with his editing group during the week and produced version 3 of the
conformance working draft, document WG11/N2273.
Audio Conformance Model
ObjectDescriptors
BIFS
Main Synthesis
Wavetable
+Picola
+DRC Ver2
Sound
13818-7
SSR
in
Ma
-7
8
81
13
PNS
Switch
FX
PNS
13818-7 LC
Media
Streams
FX
LTP
TWIN-VQ
Core
Delay
Mix
incl. SRC
PCMOutput
TLSS BSAC
CELP
HILN
Null
HVXC
TTSI
FA
Audio
Generator
Speed/Pitch
Clip Source
Speed/Pitch
Composition
User
IO
Reference Software 14496-5 FDIS (FDIS Oct 98)
Mr. Purnhagen’s task group reviewed the bug reports on the VM software. Contributions were
merged during the week. The group also discussed the concept of ‘thread-safe’ software and
bitstream exchange. The latter is essential to check that the merged software was working as
expected. But in the absence of an agreed file format for MPEG-4, how can bitstream exchange
take place? Mr. S-W Kim volunteered to extract the bitstream parser from IM1 to be used in the
Audio VM. The study on the FDIS and the study on the DoC on the FCD are presented in
documents WG11/N2274 and N2275.
Requirements
48
Mr. Thom reviewed, with others, the Version 1 and Version 2 MPEG-4 Overview documents and
added further information to them. These were amalgamated into the Requirements’ output
documents, N2323 and N2324.
Profiles & levels
Mr. Tanaka presented m3744 describing the handling of PICOLA speed change tool in profiles
and levels. The suggestion is that it becomes an optional element in any/all of the profiles. And
that it be described in a separate table for optional tools. The input document also gives estimates
for complexity. The Japanese NB position paper, m3684, also makes this point. Mr. Brandenburg
suggested that it be included in the FX block of SA as an alternative. This latter view was upheld
and a response to the Japanese NB was prepared.
Testing
NADIB tests
Mr. Dietz presented the report on the tests, m3796. The results show differences and similarities
between codecs. The report and its conclusions show that
 only reliable listeners were used
 the two test site gave statistically different results, resulting in separate analysis of the two sets
of results
 some codecs gave a very programme-dependent performance
 in 8 kHz test NB-CELP and G.723.1 performed equally well and better than Twin-VQ.
 in 24 kHz test AAC-24 was the best.
 MPEG-4 at 24 kb/s offers a worthwhile improvement to AM broadcasting,
 scalability at 6+18kb/s is better than basic coding at 18 kb/s but not as good as basic coding at
24 kb/s.
 WB-CELP(mode3) did not perform well for speech+music.
The reasons for some of these observations were discussed. It was agreed that the report should
be edited into a form suitable for an output document, as given in document WG11/N2276. An
abstract was added to the report rather than attempting to produce a summary report.
Speech codec tests
It was noted in listening to the collected speech test material that there was an unacceptable
variation of levels. The decision was to adjust four of the German language samples to bring
down this variation. This will be done prior to their use in the forthcoming tests.
There was a great deal of debate over what codecs should be included in the codec tests to be run
and completed by the beginning of September. Great pressure was brought to bear by those who
wanted new tools or variations on themes to be included. It was a requirement that the just
accepted mode 7 WB-CELP coder be included in the testing. The final decisions are reported in
the test plan given in document WG11/N2277.
Internet radio tests
The selection process was discussed in Task Group to determine what critical items should be
included and who could participate. The chair, Mr. S-W Kim, and his team prepared a full
specification and timeline for these tests including 17 codec/bitrate combinations. The plan
shows the results being made available by 4th September and is given in document
WG11/N2278. Additionally, interested members reviewed the full range of test material and
produced a subset for these tests as documented in WG11/N2279.
Archival records of audio source material
The chair of the Test Subgroup inquired whether the Audio Subgroup had plans to establish an
archive site for all of the source material that has been used in MPEG Audio testing. The Video
49
Subgroup has a planned activity. It was agreed that an archival record was of interest. This will
be addressed further at the next meeting.
Version 2 matters
Audio 14496-3/Amd 1 WD (CD Dec 98)
Mr. Dietz led a drafting group during the week and have reviewed the MPEG-4 Version 2
Working Draft. The revised text is given in document WG11/N2283. The list of Audio MPEG4 version 2 work items now includes:
1.
Error resilience
2.
Environmental spatialisation
3.
Low delay
4.
Backchannel
5.
Dynamic range control
6.
Watermarking
7.
Markup TTS
IPR and content protection
Watermarking
Mr. Meares reported on discussions with CRL. They are now in a position to process files for
coding. Mr. Oomen and Mr. Paley volunteered to code/decode the files and send them back to
CRL for watermark extraction checks. The list of source files for these evaluations is given in
document WG11/N2285. The Subgroup discussed ways in which the number of watermarking
proposals could be extended beyond that of CRL’s. A number of codec proponents agreed to
participate in an initial informal evaluation of the CRL watermarking technique and report the
results of listening tests and any other techniques used to determine the effects of a watermarking
technique on codec performance.
Intellectual Property Management and Protection (IPMP)
Mr. Meares reported that the trend of discussions on IPMP during the week was toward defining
just an IPMP Interface which will be used to identify flags to show that IPMP was or was not
active for a particular MPEG-4 Object. The actual IPMP elements would be outside MPEG-4
and would be one or more proprietary systems. There is, however, concern amongst members
that the timing consequences of the IPMPI had not been discussed nor resolved. Indeed, the plans
for the IPMP Group, presented in the final Plenary, confirm that even the first checks on timing
implications will not be carried out until the Atlantic City meeting.
Error resilience
Mr. Dietz reviewed and edited the error resilience workplan in his task group. The resultant
workplan is given in document WG11/N2284.
Low delay
No effort was available to pursue this topic at this meeting.
Environmental spatialisation
This topic was discussed in SNHC but not in Audio.
Other developments
TTSI Markup language for Version 2 was presented by Mr. Lee. He outlined the additional
functionality relative to the version 1 options. The description of the Markup TTS is given in
document WG11/N2286.
50
MPEG-7 15938 Audio (CfP Oct 98)
Mr. Kriechbaum joined the meeting to report on progress in MPEG-7. The essence of his
message is that there was only one other audio person in MPEG-7 and therefore, little progress
has been made. A joint ad-hoc group was proposed as a way of progressing the work and raising
the profile of the work. There is a serious shortage of audio material available for the descriptors
to be tested on. It may be necessary to cite purchasable CDs as a way of providing material. Mr.
Herre volunteered to co-chair the ad-hoc group with Mr. Adam Lindsay.
Promotion of MPEG Audio
FAQ
Mr. Thom worked in his task group and prepared additional FAQs. The revisions are given in
document WG11/N2287.
Audio Web site and content
Mr. Thom also reviewed the web page content and identified volunteers to add additional
content. This is documented in WG11/N2288. Mr.Thom suggested that a group picture be added
to the web page. A picture taken during this meeting is being supplied for the web page.
Discussion of unallocated contributions
Mr. Meares presented documents m3565 and m3566 which are historical lists of the input and
output documents of WG11 since 1995. These were approved for conversion into output
documents, WG11/N2289 and N2290.
Meeting deliverables
Press statement
Mr. Meares prepared the Audio part of the press statement, which was approved.
Dispositions of Comments
The DoC matters are referred to above.
Responses to NB comments
Responses to the National Body comments were prepared and were approved.
Liaison statements
During the week, a request for information from DVB Technical Module on test results on AAC
was received by the Subgroup’s secretary. In response a liaison statement was generated, citing
AAC test results for multichannel, stereo and NADIB
Recommendations for final plenary
A list of recommendations was prepared for approval at the final MPEG plenary meeting. Four
documents from this meeting were approved for public release, see Annex A-VI. Additionally,
N2205 MPEG-4 Reference Software FCD should be made public.
Establishment of new Ad-hoc Groups
The following ad-hoc groups were established:
Ad-hoc group on MPEG-4 Audio FDIS and
Reference Software FDIS progression
(Grill/Purnhagen)
Ad-hoc group on MPEG-4 Audio Conformance
and complexity (Spille)
Ad-hoc group on MPEG-4 Structured
Mandat
e
2292
Meeting
2293
no
2294
no
On the weekend before 45th meet
51
Audio(Scheirer/Ray)
Ad-hoc group on completion of MPEG-2
Conformance 13818-4/FDAM 1, Technical
Report 13818-5/AMD 1 and Corrigendum
13818-7 COR 1 (Paley/Lueck)
Ad-hoc group on MPEG-4 Audio Verification
tests (Dietz/S-W Kim)
Ad-hoc group on MPEG-4 Audio Version 2
error resilience (Dietz/Miki)
Mandat
e
Meeting
2295
no
2296
On the Sunday before 45th meet
2297
1) On September 07, 1998 at FhG
(Erlangen, Germany).
2) On Sunday afternoon before
the Atlantic City meeting.
Approval of output documents
All output documents were presented to Audio plenary and were approved.
Future activities
Schedule of future meetings
The dates of the next MPEG meeting in Atlantic City were confirmed. Dates for the ad-hoc
group meetings were decided. All except one of the ad-hoc group meetings will occur on the
Saturday or Sunday immediately preceding the MPEG meeting.
Agenda for next meeting
The agenda for the MPEG Audio Subgroup meeting in October 1998 in Atlantic City, USA was
presented to the meeting. On behalf of the Chairman, Mr. Meares explained that the task group
identities had been brought into the main agenda specifically so that incoming documents could
be allocated to the particular task groups. The intention is that this would give task groups clearer
mandate for the work that was expected of them. In the future, task groups would be expected to
consider the incoming documents and make recommendations to the Subgroup on a particular
topic. This was briefly discussed and approved (Annex III).
A.O.B.
The Audio Subgroup wished to record their grateful thanks to the
organisers of the 44th meeting for the excellent facilities and support
during the week.
Closing of the meeting
Mr. Schreiner thanked the participants for all their hard work in
preparation for and during this meeting. He also thanked the
secretary, Mr. Meares, for his support during the meeting. With that,
he declared the Audio Subgroup meeting closed and wished members a safe return journey.
52
Annex A-I: Meeting Participants List
Name
Brackenridge, B.
Brandenburg, K.
Dietz, M.
Edler, B.
Eklund, R.
Feige, F.
Fellers, M.
Funken, RFM
Grill, B.
Herre, J.
Horbach, U.
Inoue, A.
Iwadare, M.
Jin, Akio
Johnston, J.
Karamustafaoglu, A
Kawahara, T.
Kim, S-W.
Laborde, R.
Le Guyader, A.
Lee, Y.
Lindqvist, M.
Meares, D. J.
Mlasko, T.
Moriya, T.
Murphy, D.
Neo, S-H
Nishiguchi, M.
Nomura, T.
Noriaki, F
Norimatsu, T.
Ohta, Y.
Ojala, P.
Okuda, Y.
Oomen, W.
Ostermann, J
Paley, Mark
Park, S-H
Parladori, G.
Powell, G.
Purnhagen, H.
Rault, J-B.
Ray, L.
Richard.G.
Schreiner, P. G.
Sperschneider, R
Spille, J.
Sugiyama, A
Suzuki, H.
Tanaka, N.
Teichmann, B.
Thom, D.
Toguri, Y.
Tsushima, M.
Väänänen, M.
Vercoe, B.
White, T.
Zoia, G.
Country
USA
DE
DE
DE
FIN
DE
USA
NL
DE
DE
CH
J
J
J
USA
CH
J
KR
UK
FR
KR
S
UK
DE
J
IRE
RS
J
J
J
J
J
FIN
J
NL
USA
USA
KR
I
RS
DE
FR
USA
Fr
USA
DE
DE
J
J
J
DE
USA
J
J
FIN
USA
USA
CH
Affiliation
Microsoft
FhG - IIS
FhG-IIS
University Hannover
Nokia
Deutsche Telekom Berkom
Dolby
Philips Consumer Electr.
Univ. of Erlangen
FhG-IIS
Studer Professional Audio
Sony
NEC
NTT
AT&T
Studer Professional Audio
NTT DoCoMo
Samsung
PACT, Bristol
France Telecom
ETRI
Ericsson
BBC
Bosch
NTT
Apple Computer
Panasonic Singapore Labs
Sony
NEC
Sony
Matsushita
Fujitsu Laboratories Ltd
Nokia Research Centre
Toshiba
Philips
AT&T
TI
Samsung
Alcatel Telecom
Inst of Microelectronics
Uni Hannover
CCETT
E-mu Systems
Matra Nortel Communication
Scientific Atlanta
FhG-IIS
Thomson Multimedia
NEC
JVC
Matsushita
FhG-IIS
Mitsubishi
Sony
Matsushita
Nokia Res. Center
MIT
MMA (Liaison)
EPFL
e-mail address
BillyB@microsoft.com
bdg@iis.fhg.de
diz@iis.fhg.de
edler@tnt.uni-hannover.de
roberta.eklund@research.nokia.com
F.Feige@Berkom.de
mcf@dolby.com
Ralf.Funken@ehv.ce.philips.com
grl@lte.e-technik.uni-erlangen.de
hrr@iis.fhg.de
ulr.horbach@studer.ch
akira@pal.arch.sony.co.jp
sc29a@dsp.cl.nec.co.jp
jin@splab.hil.ntt.co.jp
jj@research.att.com
attila.karamustafaoglu@studer.ch
kawahara@spg.yrp.nttdocomo.co.jp
swkim@samsung.co.kr
ron@pact.srf.ac.uk
alain.leguyader@cnet.francetelecom.fr
ylee@zenith.etri.re.kr
morgan.lindqvist@era-t.ericsson.se
david.meares@rd.bbc.co.uk
Torsten.Mlasko@fr.bosch.de
moriya@splab.hil.ntt.co.jp
murphy.d@euro.apple.com
shneo@psl.com.sg
nishi@pal.arch.sony.co.jp
sc29a@dsp.cl.nec.co.jp
nori@av.crl.sony.co.jp
norima2@arl.drl.mei.co.jp
kyo@flab.fujitsu.co.jp
pasi.ojala@research.nokia.com
okuda@cns.clab.toshiba.co.jp
oomena@natlab.research.philips.com
ostermann@research.att.com
mpaley@ti.com
shpark@ dspsun.sait.samsung.co.kr
gparladori@tlt.alcatel.it
gpowell@ime.org.sg
purnhagen@tnt.uni-hannover.de
jeanbernard.rault@cnet.francetelecom.fr
leer@emu.com
gael.richard@matranortel.com
pgs@sciatl.com
sps@iis.fhg.de
spillej@thmulti.com
sc29a@dsp.cl.nec.co.jp
suzukihr@KRHM.JVC-victor.co.jp
natanaka@telecom.mci.mei.co.jp
tmn@iis.fhg.de
David.Thom@mea.com
toguri@av.crl.sony.co.jp
tsushima@arl.drl.mei.co.jp
mauri.vaananen@research.nokia.com
bv@media.mit.edu
mma@midi.org
giorgio.zoia@epfl.ch
53
Annex A-II: Agenda for Dublin Audio Subgroup Meeting
1.
2.
Opening of the meeting
Administrative matters
2.1.
Approval of agenda
2.2.
Tokyo meeting report
2.3.
Allocation of contributions
2.4.
Communications from the Chair
2.4.1.
Joint meetings
2.5.
Report of ad hoc group activities
2.6.
3.
4.
Received National Body Comments and Liaison matters
2.7.
Temporary task group formation
MPEG-2
3.1.
IS 13818-3 BC
3.1.1.
IS 13818-5/Amd 1 (AMD July 98)
3.1.2.
Multichannel conformance bitstreams (MC_CRC)
3.2.
IS 13818-7 AAC
3.2.1.
Conformance 13818-4 /Amd 1 (DAM July 98)
3.2.2.
Technical report 13818-5 /Amd 1 (AMD July 98)
3.2.3.
13818-7 Cor 1 (COR Jul 98)
3.2.4.
13818-7 PDAM 1 (AAC DRC)
3.2.5.
AAC licensing actions
MPEG-4
4.1.
Technical issues
4.1.1.
Compression techniques
4.1.2.
5.
6.
7.
8.
TTSI
4.1.2.1. Interface timing, random access,
synchronisation
4.1.3.
Structured audio
4.1.4.
Complexity
4.1.5.
Verification demonstrator
4.1.6.
Systems issues
4.1.7.
Backchannel bitstream syntax
4.1.8.
Other matters
4.2.
Audio 14496-3 FDIS (FDIS Oct 98)
4.3.
Conformance Testing 14496-4 WD (CD Dec. 98)
4.4.
Reference Software 14496-5 FDIS (FDIS Oct 98)
4.5.
Requirements
4.5.1.
Profiles & levels
4.6.
Testing
4.6.1.
Verification tests
4.6.1.1. NADIB tests
4.6.1.2. speech codec tests
4.6.1.3. Internet radio tests
4.7.
Version 2 matters
4.7.1.
Audio 14496-3 /Amd 1 WD (CD Dec 98)
4.7.2.
Ref. Software 14496-5 /Amd 1 WD (CD Dec 98)
4.7.3.
IPR and content protection
4.7.3.1. Watermarking
4.7.4.
Error resilience
4.7.5.
Low delay
4.7.6.
Environmental spatialisation
4.7.7.
Other developments
MPEG-7 Audio 15938 (CfP Oct 98)
Promotion of MPEG Audio
6.1.
FAQ
6.2.
Audio Web site and content
Discussion of unallocated Contributions
Meeting deliverables
8.1.
Press statement
8.2.
Dispositions of Comments
8.3.
Responses to NB comments
8.4.
Liaison statements
8.5.
Recommendations for final plenary
8.6.
Establishment of new Ad-hoc Groups
3578, 3589, 3605, 3606, 3607,
3610, 3626, 3668, 3669, 3754,
3761, 3795, 3797, 3825,
3684, 3692, (3718), (3719), 3730,
3741, 3774,
3847, 3855
3774,
(3718), (3719),
3518, 3584, 3669, 3798,
3529, 3563, 3669,
3562, 3578,
3686, 3700, 3750, 3754, 3756,
3758, 3763, 3766,
3626, 3627, 3680, 3823,
3630,
3609, 3610, 3716,
3602, 3605, 3611,
(3597), 3668,
3587, (3598), 3783,
3601, 3692, 3745, 3761,
3606, 3759,
3604, 3607, (3648), 3744,
3825,
3795, 3796, 3831,
3830,
3828
3698, 3713, 3797,
3559, 3842,
(3574), (3575), (3720), (3738),
(3740), (3813),
3589,
3565, 3566,
3515, 3524, 3525, 3526,
54
9.
10.
11.
8.7.
Approval of output documents
Future activities
9.1.
Schedule of future meetings
9.2.
Agenda for next meeting
A.O.B.
Closing of the meeting
1
Annex A-III: Agenda for the Atlantic City Audio Subgroup Meeting
1.
2.
3.
4.
Opening of the meeting
Administrative matters
2.1.
Approval of agenda
2.2.
Dublin meeting report
2.3.
Allocation of contributions
2.4.
Communications from the Chair
2.4.1. Joint meetings
2.5.
Report of ad hoc group and other interim
activities
2.6.
Received National Body Comments and Liaison
matters
2.7.
Temporary task group formation
2.7.1. MPEG Audio FAQ/Web Page
2.7.2. MPEG Audio - Preparation of press
statement
2.7.3. MPEG-4 Audio/Systems Issues
2.7.4. MPEG-2 AAC Conformance and
Technical Report
2.7.5. MPEG-4 Verification Tests
2.7.6. MPEG-4 FCD study
2.7.7. MPEG-4 Reference Software Study
2.7.8. MPEG-4 Error resilience
2.7.9. MPEG-4 Conformance
2.7.10. MPEG-4 Profiles and levels
2.7.11. Markup TTSI
2.7.12. MPEG-4 SA issues & MMA alignment
2.7.13. Review of MPEG-4 Overview
MPEG-2
3.1. Revision preparation
3.2. IS 13818-7 AAC
3.2.1. Final review of Conformance, Tech Report
and Corrigendum
3.3
13818-4 BC MC_CRC conformance bitstream
MPEG-4
4.1. Technical issues
4.1.1. Compression techniques
4.1.2. TTSI
4.1.3. Structured audio
4.1.4. Complexity
4.1.5. Verification demonstrator
4.1.6. Systems issues
4.1.7. Other matters
4.2. Audio 14496-3 FDIS (Oct 98)
4.3. Conformance Testing 14496-4 WD (CD Dec. 98)
4.4. Reference Software 14496-5 FDIS (Oct 98)
4.5. Requirements
4.5.1. Profiles & levels
4.6. Testing
4.6.1. Verification tests
4.6.1.1. speech codec tests
56
5.
6.
7.
8.
9.
10.
11.
4.6.1.2. Audio on Internet tests
4.6.2
Audio Test Source Material Archive
4.7. Version 2 does not matter
4.7.1. Audio 14496-3 /Amd 1 WD (Oct 98)
4.7.2. Reference Software 14496-5 /Amd 1 WD
(Oct 98)
4.7.3. IPR and content protection
4.7.3.1. Watermarking (CfP?)
4.7.4. Error resilience
4.7.5. Markup TTSI
4.7.6. Low delay
4.7.7. Environmental spatialisation
4.7.8. Back channel
4.7.9. Other developments
MPEG-7 Audio (15938 CfP Oct 98))
Promotion of MPEG Audio
6.1. FAQ
6.2. Audio Web site and content
Discussion of unallocated Contributions
Meeting deliverables
8.1. Press statement
8.2. Dispositions of Comments
8.3. Responses to NB comments
8.4. Liaison statements
8.5. Recommendations for final plenary
8.6. Establishment of new Ad-hoc Groups
8.7. Approval of output documents
Future activities
9.1. Schedule of future meetings
9.2. Agenda for next meeting
A.O.B.
Closing of the meeting
56
57
Annex A-V: Audio Task Groups
1. MPEG Audio FAQ/Web Page - Thom
2. 13818-7 AAC Corrigendum - Johnston
3. MPEG Audio - Preparation of press statement - Meares
4. MPEG-4 Audio/Systems Issues - Paley
5. MPEG-2 AAC Conformance - Paley
6. MPEG-2 AAC Technical Report - Paley
7. MPEG-4 Verification Tests - Kim/Contin/Edler
8. MPEG-4 FCD study - Edler, Grill, Lee, Nishiguchi, Lee, Vaananen
9. MPEG-4 Reference Software Study - Purnhagen
10.MPEG-4 Error resilience - Dietz
11.MPEG-4 Conformance - Spille
12.MPEG-4 Profiles and levels - Brandenburg/Edler
13.TTSI/FBA timing and bitstream definition - Lee
14.MPEG-4 SA issues & MMA alignment - Ray
15.Subjective alignment of speech items - Ojala
16.Review of MPEG-4 Overview - Thom
57
58
Annex A-VI: Input/Output Documentation
Contributed documents
The following documents were contributed to the Audio Subgroup and were considered during
this meeting:
Number
3513
3515
3518
3529
Source
Pete Schirling
ITU-T SG 12 via the SC 29 Secretariat
SC 29 Secretariat
JTC 1 Secretariat
3562
3563
3565
NB of Japan via the SC 29 Secretariat
NB of Japan via the SC 29 Secretariat
David Meares
3566
David Meares
3578
3584
3589
3598
3601
3602
3605
3606
3609
Peter G. Schreiner III
Hiroyuki Fukuchi
David Thom, Heiko Purnhagen
Laura Contin
Giorgio Zoia
Giorgio Zoia
Jens Spille
Jens Spille
Structured Audio AHG, MIDI
Manufacturers Association
Eric Scheirer, Lee Ray
Eric Scheirer
Youngjik Lee, Jeorn Ostermann
Youngjik Lee, Jung-Chul Lee, HangSeop Lee
Mike Coleman, Eric Scheirer, Carsten
Herpel
Mike Coleman, Chuck Lueck, Mark
Paley, David Thom
Young-Kwon Lim, Youngjik Lee
The National Body of Japan
Takehiro Moriya, Akio Jin, Takeshi
Norimatsu, Mineo Tsushima,
Tomokazu Ishikawa
The National Body of Korea
Yuji Maeda, Masayuki Nishiguchi
Yuji Maeda, Masayuki Nishiguchi,
Akira Inoue
Toshiro Kawahara, Sanae Hotani,
Takashi Suzuki, Toshio Miki
Giorgio Zoia, Ulrich Horbach
3610
3611
3626
3627
3668
3669
3680
3684
3686
3692
3698
3700
3713
3716
3730
3741
3744
3745
3750
3754
3756
3758
3759
3761
3763
3766
3783
3795
3796
The National Body of Japan
Swedish National Body
Naoya Tanaka
Heiko Purnhagen, Bernd Edler
Naoya Tanaka
Akihiko Sugiyama
Toshiyuki Nomura, Masahiro Iwadare
Gael RICHARD, Ariane LEDORE,
Philip LOCKWOOD
Akira Inoue, Masayuki Nishiguchi
Bernhard Grill, Heiko Purnhagen
Ralf Funken, Werner Oomen, Frans de
Bont
Ralf Funken, Werner Oomen, Frans de
Bont
C. Sibade, S. Weisse, A. Ledore, G.
Richard
Martin Dietz, Laura Contin, JeanBernard Rault
Catherine Colomes, Caroline Jacobson,
Eric Scheirer, Laura Contin, JeanBernard Rault, Martin Dietz
Title
Document Register for 44th Meeting in Dublin, Ireland
Liaison Statement from ITU-T SG 12 on MPEG-4 Audio Test (SC 29 N 2501)
Summary of Voting on ISO/IEC 13818-4/FPDAM 1 SC 29 N 2521
Summary of Voting on ISO/IEC TR 13818-5/DAM 1: Information technology -Generic coding of moving pictures and associated audio information -- Part 5:
Software simulation, AMENDMENT 1: Advanced Audio Coding (AAC) SC 29 N
2557, JTC 1 N 5291
Late Comments on ISO/IEC 13818-7/DCOR 1 SC 29 N 2620
Late Comments on ISO/IEC TR 13818-5/DAM 1 SC 29 N 2621
Bibliography of WG11 Input Documents: m0551 to m3511, December 1995 to March
1998
Bibliography of WG11 Output Documents: N0965 to N2247, July 1995 to March
1998
Report of the Ad-Hoc Group on AAC Dynamic Range Control
Brief Report of AAC Conformance Testing (SSR profile)
Ad-Hoc group report on Audio Web Page activity
List of audio, video and audiovisual excerpts that have been released to MPEG
Proposed revisions to FCD 14496-3 Subpart 5
A method for complexity measurements in Structured Audio
Report of Ad-Hoc Group on MPEG-4 Audio Tools Complexity
Report of Ad Hoc Group on MPEG-4 Audio Conformance
Revised Structured Audio Sample Bank Format
Report of AHG on Structured Audio
A method different than Giorgio's for complexity measurements in SA
AHG Report on TTS/FBA Convergence
MPEG-4 Audio Markup TTS
Report of the Ad-hoc group on MPEG-4 Audio/Systems issues
Report of Ad-Hoc group on AAC technical report & conformance
On the MPEG-4 TTS application with FA
Comments on MPEG-4 Audio
Reports on the AAC-TwinVQ convergence work
A study on the FCD 14496-3 Audio and FCD 14496-5 Software
EP tool version 0.5 with parametric speech coder
Listening test results of CELP coder
Core Experiment of Common EP tool for MPEG-4 Audio error resilience
Proposal for new SAOL core opcodes for high quality equalizing and dynamic
processing
On the wording of the copyright disclaimer
Comments on the use of software in the normative parts of MPEG4
A proposal to handle PICOLA speed change tool in the Audio profiles
A Study of Parametric Audio FCD and HILN Scalability
Listening test results of optimized MPEG-4 CELP coders
Report of the Ad-Hoc group on MPEG-4 Audio CELP optimization
Listening test results of MPEG-4 Audio CELP
Comparative test results for speech coders (MPEG4 CELPs, G723.1, Scalable coder
based on G723.1)
Proposed Conformance Testing Procedures on Noise Component Generator for
Parametric Speech Coder(HVXC)
Report of the AHG on MPEG-4 Audio FCD and Reference Software FCD progression
Results of an informal listening test assessing the quality of MPEG-4 Wideband CELP
with an optimized VQ w.r.t. the MPEG-4 Audio VM
Results of an informal listening test assessing the quality of a modified MPEG-4
Narrowband CELP codec w.r.t. the MPEG-4 Audio VM
MPEG4 Audio demonstrator
Report of the Ad-Hoc Group on MPEG-4 narrowband audio broadcasting verification
tests
Report on the NADIB verification tests
58
59
Number
3797
3798
3820
3823
3825
3828
3830
3831
Source
Martin Dietz, Toshio Miki
Martin Dietz, Roland Bitto
Sang-Wook Kim, Bernd Edler
Joern Ostermann, Yao Wang
Sang-Wook Kim, Bernd Edler
Sang-Wook Kim,, Bernd Edler
S.-W. Kim (Samsung),, M. Lindqvist
(Ericsson),, M. Nishiguchi (Sony)
Sang-Wook Kim
3841
3847
3855
US NB via the SC 29 Secretariat
Y. Takamizawa, M. Iwadare
H. Fukuchi, M. Iwadare
Title
Ad-hoc group on MPEG-4 Audio error resilience for Version 2
Proposal for correction of AAC conformance test procedure
Report of the Ad-Hoc group on MPEG-4 Audio verification tests
Bookmarks for TTS-FBA Synchronization
Report of the Ad-Hoc Group on MPEG-4 Audio Verification tests
List of selected items for the MPEG-4 Audio verification test: Music on Internet
List of selected items for the MPEG-4 Audio Speech verification test
Perfect AM coding results check for verification test on MPEG-4 narrowband Audio
broadcasting
Late Comments on ISO/IEC 13818-7/DCOR 1 (SC 29 N 2637)
Source Codes for MPEG-2/AAC pulse coding
Bug Fix in MPEG-2/AAC TR
Output Documents
The following output documents were produced in whole or part by the Audio Subgroup. Those
shown in Italics were approved for public release.
number Title
Responses to National Body papers
2323
MPEG-4 Version 1 Overview (contributions to)
2324
MPEG-4 Version 2 Overview (contributions to)
2257
DoC on Conformance 13818-4/FPDAM 1
2258
Conformance 13818-4/FDAM 1 (covering 13818-7 AAC)
2261
DoC on Technical Report 13818-5/DAM 1
2262
Technical Report 13818-5/AMD 1 (covering both 13818-3 Second Edition and
13818-7 AAC)
2265
DoC on MPEG-2 AAC 13818-7 DCOR 1
2266
MPEG-2 AAC 13818-7 COR 1
2270
Workplan for MPEG-2 AAC 13818-7 Dynamic Range Control
2271
Study on ISO/IEC 14496-3 FDIS
2272
Study on DoC on MPEG-4 Audio Final Committee Draft 14496-3
2273
ISO/IEC 14496-4 WD 3 Conformance Testing of the MPEG-4
2274
Study on MPEG-4 Audio Reference Software FDIS 14496-5
2275
Study on DoC on MPEG-4 Audio Reference Software Final Committee Draft 144965
2276
MPEG-4 Audio verification test results: narrowband audio broadcasting
2277
Plan for MPEG-4 Audio verification tests: speech codecs
2278
Plan for MPEG-4 Audio verification tests: music on Internet
2279
Prescreening results on MPEG-4 Audio verification test excerpts - Music on Internet
2280
Information on MPEG-4 Audio systems issues
2281
Harmonisation of TTS and FBA
2282
SA complexity tool
2283
MPEG-4 Audio Version 2 WD
2284
MPEG-4 Audio error resilience workplan (update of the 44th meeting)
2285
Identification of source files for watermarking evaluations
2286
Markup TTS
2287
MPEG Audio FAQs version 8
2288
Proposals for the MPEG Audio web site content
2289
Bibliography of WG11 Input Documents m0551 to m3836, December 1995 to June
1998
2290
Bibliography of WG11 Output Documents N0965 to N2247, July 1995 to March
1998
2298
Workplan for AAC Conformance and Technical Report Software
2332
Report of AAC/Twin VQ convergence work
59
60
Annex 8
SNHC meeting report
Source: Peter Doenges (Evans & Sutherland), Chair
SNHC Meeting Objectives
The main SNHC objectives for the Dublin meeting were review of the completeness and quality of
Version 1 FCD work for Study of FCD, and initial development of conformance contributions to Part 4
based on the improving stability of profile/level work. The main objectives for Version 2 were to move
technologies forward in preparation for CD, to continue work on FBA calibration connected with Version
2 profiling, and to advance CGD work in the development of content metrics for the bitstream. Qualified
technologies were to be advanced to Visual WD (notably 3D model connectivity coding and body
animation) with related VM promotions if justified. Development of experiments for CGD was targeted
(along with identifying 3D platforms, data sets, etc. needed to conduct the experiments) to verify a model
for estimation of terminal loading during 3D rendering from content metrics in the bitstream.
Detail Dublin objectives are listed below:
Version 1
1. Audit of FCD comments & contribution to Study of FCD
– Review/action on meeting contributions about FCD
– Correct omissions, errors, editorial updates of Visual, Systems specs
2. Conformance
– Development of criteria for testing with full-envelop bitstreams, approach
to verification, link to profile/level data, augmenting data sets
3. Profiling
– Contribute changes driven by Requirements and FCD contributions
4. IM1 software status
– Any revision to work plan to ensure completion
5. Review & update SNHC software plan from Tokyo
– Reference software and plan brought up to date
6. Double-check Systems BIFS (incl. index face set 2D - problems with 2D Mesh)
– Nodes for FBA, 2D mesh, VDS, scene composition
7. Still Texture Coding
– Resolve any final issues to enable progressive, MIP texture
Version 2
1. Assessment of outstanding work items
a. 3D Model Coding
i. Decision - retention of 3D regular gridded mesh vs. efficiency?
ii. M1: 3D mesh connectivity - efficiency, generality, footprint
iii. M2: Geometry coding including progressive shape
iv. M3: Progressive connectivity coding (and links to M1, M2)
v. M4: Properties coding (normals, color, texture coordinates)
b. Body Animation
i. BA2: BAP Compression
ii. BA3: Hand BAP Interpretation
iii. BA6: BAP Quantization Step Sizes
iv. BA7: BDP Interpretation
60
61
2.
3.
4.
5.
6.
7.
8.
9.
c. Face Animation
i. FA1: Face Calibration (feature points, mesh texture & shape)
ii. FA2: FAP Coding with Facial Action Basis Functions vs. FIT?
iii. FA3: Error Resilience of FAP Bitstreams
VM 9.0 contribution with recommended changes from AHGs
Critical review of pre-Dublin CEs compared to interim AHG results
VM update per CEs if significant change for technology promotion
Verification of 1st bitstream exchanges, selection of WD technologies
If technology changes in VM, critical plan to finish WD on CD schedule
Quality/effectiveness of documentation/software for 2nd implementers
Profiling: FA calibration studies vs. Calibration, Predictable profiles
ISG CGD contributions and SNHC experiment design/contributors
a. Adaptive decoding for terminal resources vs. media complexity
b. Basic capability for scalable content with no backchannel
c. Server adaptation of content with backchannel terminal metrics
i. Key applications and requirements
ii. Impact on, supported by content developers
iii. Assistance to Systems for real solutions
iv. Level of server/terminal negotiation
v. Effect on profiling
Most of these objectives were achieved. However for Version 2, profiling discussions were tabled in
deference to Version 1 work, and no time was spent on backchannel work associated with CGD and
server adaptation of content. For Version 1, significant improvements to the FCD that involve lagging
editorial work with NB backing, and final conformance work with supporting test data, must still be
achieved by Atlantic City. Key individuals are committed to closure on these points. For Version 2, the
schedule imperatives associated with fulfilling required process steps to qualify technology fully for CD
now requires another interim AHG meeting for 3D Model Coding before Atlantic City. Promotion to
WD of remaining elements of 3D Model Coding is expected, and is needed to produce an integrated tool
set for static and progressive compression of connectivity, geometry, and properties.
SNHC Contributions & Related Review
The following SNHC-related contributions were reviewed during the meeting:
FCD for Version 1
3635
3672
3689
3690
Systems
Systems
Video
Video
3691
Video
3715
3723
3784
3807
3821
Video
AHG
Report
Video
General
Video
3824
Video
Comments on FCD 14496-1 (Systems)
Comments on Systems FCD
Comments on FCD 14496-2 (Visual)
Editorial comment on FCD 14496-2
ANNEX
Comments on BBM and FCD 14496-2
Visual
UK NB comments on FCD 14496-2 (visual)
Report of the ad hoc group on video VM
and visual WD/FCD editing
Study of the FCD Visual Texture Coding
Comments on FCDs
Implementation of Visual Texture Coding
in Microsoft FCD software and IM1
Editorial and minor technical changes of
Visual Texture Coding ("proposed study of
FCD")
61
The National Body of Japan
Zvi Lifshitz
The National Body of Japan
The National Body of Korea,
ksc29@kisi.or.kr, ahnc@etri.re.kr
The National Body of Korea,
ksc29@kisi.or.kr, ahnc@etri.re.kr
UK National Body
Touradj Ebrahimi, Caspar Horne,
Euee Jang
Jie Liang, Raj Talluri
D.Curet
Iraj Sodagar, Hung-Ju Lee, BingBing Chai, Paul Hatrack, Shipeng
Li, B.S. Srinivas
Iraj Sodagar, Hung-Ju Lee, Paul
Hatrack, Shipeng Li, Bing-Bing
Chai
62
2D Mesh for Version 1
3644
SNHC
Input for Study of MPEG-4 Visual FCD
P. van Beek
Face & Body Animation for Version 2
3590
SNHC
3592
SNHC
3661
SNHC
3755
SNHC
3770
3772
SNHC
(no)
SNHC
3773
SNHC
3777
SNHC
Donation to ISO of Hand Animation
Software
Hand Animation and BAPs Extraction:
Reports on Core Experiment 3
Model-Based Face Tracking and 3D Pose
Estimation
Report of ad hog group on Face and Body
Animation
Status of Body Animation Quantization
Core Experiment
Results of Body Animation Core
Experiments BAP2, BAP3, BAP6, BAP7
Report on Local Processing Scalability for
Body Animation
Proposal for Update to Body Animation
Specification
Francoise Preteux,, Marius Preda,
and Gerard Mozelle
Francoise Preteux,, Marius Preda,
and Gerard Mozelle
Francoise Preteux, and Marius
Malciu
Eric Petajan, Tolga Capin
Damian Lyons
Tolga K. Capin, Joaquim
Esmerado
Tolga K. Capin, Joaquim
Esmerado
Tolga K. Capin, Joaquim
Esmerado
3D Model Coding for Version 2
3530
SNHC
3591
SNHC
3652
SNHC
3688
SNHC
3724
3735
AHG
Report
SNHC
3751
SNHC
3752
SNHC
3753
SNHC
3768
SNHC
3769
SNHC
3793
SNHC
Mesh Connectivity Coding by Dual Graph
Approach
Geometry and Topology Compression of 3D
Meshes: Results of Core Experiment M1
and M2
Progressive Mesh Coding by Independent
Vertex Split
On the development of 3-D mesh coding
tools
Report of the ad hoc group on 3D model
coding
Results of core experiment M2: Geometry
coding using PRVQ
Geometry Compression of 3D Meshes using
Optimal Quantization for Prediction Errors
Adaptive Quantization Method for 3D Mesh
Representation using the Spherical
Coordinate System
Results of Core Experiment M2 on 3D
Model Coding
Experimental Results on Mesh Connectivity
Coding based on Looping Triangle Strip
(M1)
Experimental Results on Geometry
Compression for Mesh Coding using
Optimal Quantization for Prediction Errors
(M2)
Description of core experiments on 3D
model coding
62
Jiankun Li, C.-C. Jay Kuo, Homer
Chen
Francoise Preteux,, Mircea Curila,
Sorin Curila, Jose Paumard, and
Gerard Mozelle
Jiankun Li, C.-C. Jay Kuo, Homer
Chen
The National Body of Korea,
ksc29@kisi.or.kr, ahnc@etri.re.kr
Touradj Ebrahimi
Jin Soo Choi, Myoung Ho Lee,
Chieteuk Ahn
Yo-Sung Ho, Jeong-Hwan Ahn
Yo-Sung Ho, Jeong-Hwan Ahn
Jeong-Hwan Ahn, Yo-Sung Ho
Mun-Sub Song, Mahn-Jin Han,
Euee S. Jang, Y.S. Seo(SAIT),,
Hyungin Choi(SNU)
Mahn-Jin Han, Mun-Sub Song,
Euee S. Jang
Frank Bossen (editor)
63
3794
SNHC
3801
SNHC
3810
SNHC
3811
SNHC
Results of core experiments on 3D model
coding
Progressive 3D mesh coding with
subdivision surfaces
Report on Results of Core Experiment M1
on 3D Model Coding
Report on Results of Core Experiment M3
on 3D Model Coding
Frank Bossen
Francisco Moran
Gabriel Taubin, Claudio Silva,
Andre Gueziec, Bill Horn
Gabriel Taubin, Claudio Silva,
Andre Gueziec, Bill Horn
SNHC VM for Version 2
3809
3812
SNHC
SNHC
SNHC Verification Model 9.0
SNHC VM 9.0 Source Code for TS and PFS
Connectivity Encoding and Decoding
Gabriel Taubin
Gabriel Taubin, Claudio Silva,
Andre Gueziec, Bill Horn
Visual Still Texture Coding
3621
3803
Video
Video
3804
Video
3822
Video
3826
Video
3827
Video
3829
Video
Scalable Shape Coding for Still Texture
Mini experiment on scanning for low
complexity wavelet texture coding
Core experiment on error resilience for still
texture using a packet approach
Bitstream exchange result for visual texture
coding
Report of results on CE-E16: Error
Resilient Still Texture using a Packet
Approach
Verification of result on CE-F1: Tiling
function for visual texture
Report of the ad-hoc group on Visual
Texture Coding
Yoshihiro Ueda, Zhixiong Wu
Iole Moccagatta, Osama Alshaykh,
Homer Chen
Iole Moccagatta, Osama Alshaykh,
Homer Chen
Iraj Sodagar, Hung-Ju Lee, Paul
Hatrack, Shipeng Li, Bing-Bing
Chai, Bing-Bing Chai
Iraj Sodagar, Bing-Bing Chai, B.S.
Srinivas
Hung-Ju Lee, Iraj Sodagar
Iraj Sodagar, Iole Moccagatta
Visual WD for Version 2
3553
Video
MPEG-4 Version 2 Visual Working Draft
Rev. 3.1
Euee S. Jang, Visual CD Editors
Computational Graceful Degradation & Quality of Service
3567
ISG
Computational Graceful Degradation
Analysis in SNHC
3616
3679
ISG
ISG
Report of the ad-hoc group on decoder QoS
Report of the Ad-Hoc Group on
Computational Graceful Degradation
Gauthier Lafruit, Lode
Nachtergaele, Andy Scherpenberg,
Tom Huybrechts, Jan Bormans
Marco Mattavelli
Jan Bormans, Marco Mattavelli
Complexity Analysis
3551
ISG
3568
ISG
A complexity analysis tool: iprof (version
0.41)
Complexity Analysis of FCD still texture
coding
63
Peter Kuhn
Gauthier Lafruit, Mercedes Peon,
Bart Vanhoof, Jan Bormans
64
3631
ISG
Computation Complexity Profiling of the
IM-1 Player
3645
ISG
3786
ISG
Complexity analysis and guidelines for
profile definition of Still Texture Coding
Report on Core Experiment Results of
Encoder Complexity Reduction Based on
Intelligent Pre-Quantizaton
Mercedes Peon, Lode
Nachtergaele, Gauthier Lafruit,
Peter Vos, Jan Bormans
Gauthier Lafruit, Mercedes Peon,
Bart Vanhoof, Jan Bormans
Wei Wu, Homer Chen
Output Document Editors
Editors or coordinators responsible for SNHC elements of output documents were:
Study of FCD Contributions
Face Animation
2D Animated Mesh
View-Dependant Scalable Texture
Cross Review of Still Texture
Cross Review of Systems BIFS
SNHC Conformance Working Draft
SNHC/ISG CGD Experiment
SNHC to Visual WD for Version 2
SNHC Profiles/Levels Contributions
SNHC Software Work Plan
SNHC Verification Model 9.0
SNHC Core Experiments
Press Release
Eric Petajan
Murat Tekalp
Homer Chen
Iraj Sodagar
Claudio Lande, Julien Signes
Michael Frater (Thomas Sikora), Eric Petajan,
Murat Tekalp, Pete Doenges
Gauthier Lafruit, Marco Mattavelli, Jan Bormans,
Eric Petajan, Pete Doenges, Claudio Lande
Yuchiro Nakaya, Mr. Shin (Thomas Sikora),
Gabriel Taubin, Tolga Capin
Murat Tekalp
Jiankun Li
Gabriel Taubin
Frank Bossen
Pete Doenges
AHG Meetings and Reports
The following AHG meetings were held on Sunday before the WG11 meeting and reports discussed:
3755
SNHC
3724
SNHC
3829
Video
3679
ISG
Report of ad hog group on Face and Body
Animation
Report of the ad hoc group on 3D model
coding
Report of the Ad Hoc Group on Visual
Texture Coding
Report of the Ad-Hoc Group on
Computational Graceful Degradation
Eric Petajan, Tolga Capin
Touradj Ebrahimi
Iraj Sodagar, Iole Moccagatta
Jan Bormans, Marco Mattavelli
See those reports for details. An important development emerged from the meetings on 3D Model
Coding. While there has been tremendous work by various proponents and partners as 2 nd implementers
to bring the work to the maturity of bitstream exchanges, these were not consistently achieved across all
the M1-M4 experiments. Thus VM and WD promotions were not as aggressive as originally hoped. The
Korean NB requested a response to their concern on this, and another AHG meeting is planned in Korea.
Meeting Work and Results
Study of FCD for Version 1
64
65
Little of the NB comments on FCD applied to SNHC-related functionalities except for Still Texture
Coding. The responsible working group in Video continues to handle the DoC and Study inputs for Still
Texture Coding with cross-review by SNHC. Iraj Sodagar presented the intended actions for this work
along with the AHG report to the SNHC group. Reported inconsistencies in bitstream decoding for
different implementations of Still Texture and other problems reported at and after Tokyo are receiving
needed attention. The group expected pertinent items to be corrected in the Study of FCD and subsequent
NB follow-up for Atlantic City.
After Tokyo, a number of edits in the FCD were discovered missing after the publishing date in areas of
FA and 2D Mesh as previously driven by NB comments including references back into CD and Study of
CD. The reasons are important to understand (editor overloads, lack of incremental review before
publishing, lack of adequate proponent participation at the right times). The results are that FCD can not
transition to DIS with reliability without a thorough assessment of the FA and 2D Mesh areas of the FCD.
This is obviously not the state that the work should be in nor is it the intent of the process. The process
demands a very high level of quality in the text at this point. People involved have lost a bit of
confidence in the process, but have pledged to close editing gaps by rebuilding what should have been in
FCD from the known NB trail. NBs should take a careful look at this situation in NB meetings before
Atlantic City, collaborate with other interested NBs, and make NB contributions to Atlantic City
supported by the necessary unanimity of proponent organizations.
The 2D Mesh area was covered by an individual contribution (M3644) in Dublin that provided
corrections to the FCD in the necessary details reflecting previous NB requests. The FA area required
working time in the Dublin meeting to audit the FCD for missing parts and give priority to the process of
recovering the trail by which to incorporate needed changes driven by NB comments going back into
Tokyo. This situation was complicated by the necessity to edit the edits of the CD. Individuals in the FA
area have committed to "rebuild" a valid NB-driven version of FCD in the affected areas before Atlantic
City to gain NB approval and contributions to the meeting. They have also volunteered to join the main
Visual and Systems editors wherever necessary to ensure progressive verification and cross-checking of
DIS editing after Atlantic City.
Conformance Work for Version 1
An outline for the Conformance strategy and content of Part 4 was initially developed in the Dublin
meeting, along with a review of the existing state of Part 4. Then several discussions were held with
proponents (specifically FA and 2D Mesh) to characterize the methods of conformance, exercising
necessary modalities in the decoder, and augmenting current bitstreams to achieve adequate verification
of proper function and performance as driven by profile/level results. An initial version of the
Conformance additions to Part 4 with some embedding of current Part 4 language to help with
convergence of consistent results was issued as N2299. Key individuals for FA and 2DM will expand
this document after Dublin, and discuss its refinement as well as the development of data sets using
appropriate reflectors. No AHG was formed, but the mandate is very clear, and proponents must supply
an integrated contribution with NB support by Atlantic City.
Still Image Texture Coding in Version 1
In addition to the FCD work, several delegates discussed the need to verify wavelet texture coding in its
application to 3D. Specifically, wavelet texture coding should be subjected to an end-to-end (nonnormative) verification test (not a CE) relative to the resolution scalability and quality of still texture
when used in 3D rendering. The test would include conversion of a downloaded wavelet image pyramid
from MPEG-4 Part 5 decoding into MIP map texture for varied viewing of textured 3D models on a PC
graphics accelerator or workstation. OpenGL hardware with bilinear and trilinear filtering of MIP map
texture could be used with dynamic viewing to verify that wavelet texture supports the intended MPEG-4
functionality. E&S volunteered rendering on an OpenGL PC 3D graphics accelerator and Lucent Bell
Labs volunteered rendering an SGI OpenGL workstation to observe wavelet-based texture in 3D.
Textured 3D models would be run through the complete MPEG-4 still image texture pipeline. Texture
65
66
maps would be extracted from 3D models, the textures processed through the wavelet encoder, the
complete wavelet bitstream decoded while accumulating the supplied image resolution layers (11 peak),
results translated to MIP map texture, and the reintegrated texture models rendered in 3D. Demos would
be staged under viewing conditions of varied model orientation, distance, and perspective distortion to
show the effectiveness of resolution scalability. If possible, videos would be prepared for Atlantic City.
This effort will be pursued following the Dublin meeting. Sarnoff had anticipated such a demo with some
work now applied in this direction. Rockwell and AT&T Research may be able to help. IM1 now
includes the tools, and may be a platform for testing. Sarnoff confirmed that a schedule of tasks and
deadlines before Atlantic City and spreading of this collaborative work over partners should be detailed.
CGD for SNHC Functionalities in Version 2
The ISG group has done a productive job of laying the basis for using CGD to support SNHC/Systems
BIFS functionalities that depend on the display of models at useful rates and fidelities while driven by
MPEG-4 decoders producing 2D, 3D, or mixed media streams. MPEG-4 compliant decoders should
achieve adequate performance in decoding rates due to the profile/level specifications and associated
conformance definitions. However, there is presently no normative profiling of model or rendering
complexity for specific 2D/3D content whose terminal loading beyond the decoder can be difficult to
predict from the content. Overload of terminal rendering is possible with compliant decoding.
The goal of current CGD work is to provide bitstream parameterization of content complexity and
structure that could be used by the terminal to select scalable versions of the content related to the 2D/3D
geometry and rendering capacities of the terminal beyond the decoder. The correct model for estimating
geometry and rendering complexity will ultimately be hardware/software-specific and can depend on 3D
content organization, graphics architecture, viewpoint location/look angle and associated culling, scene
occlusion, the context of state in the graphics pipeline, bus and memory limitations, etc.
ISG has done previous work including some benchmarking and analysis of specific systems to
characterize basic content metrics that are likely to produce varied effects on video composting and 3D
rendering accelerators. M3567 for Dublin from ISG members provided a more substantial proposal with
functional analysis of model transformations and polygon/texel rendering into the pixels of an output
image, along with some approximations that predict rendering load for component pieces of a 2D/3D
media stream. This estimating is simplified compared to hardware-specific models, but a useful start.
During Dublin several joint working sessions and informal discussions were held between ISG and SNHC
about how to design experiments validating the utility of estimating metrics in M3567. These discussions
also dissected what kinds of 3D models and variations in viewing conditions should be used to help
validate specific performance estimators. Some time was also spent educating and clarifying specific
points about the context-dependent aspects of rendering that are not adequately accounted for now by the
ISG CGD model for SNHC. Specific vendors undoubtedly have and might supply more details on the
total performance prediction model for estimating rendering load. However, the agreed scope of the
current work is to identify hardware architectural abstractions that provide more promise for achieving a
normative methodology for hardware, software, and content developers to adapt MPEG-4 content in
relation to predicted loading, and to provide scalability controls for content in the bitstream.
The output document N2317 provides the results of this work. Without going into details here, several
organizations (EPFL, IBM, France Telecomm, E&S, etc.) have agreed to provide models with and
without texture for testing. Some organizations have agreed to supply platform assistance (e.g. E&S has
shipped a high-performance PC 3D accelerator to IMEC), and may provide more performance estimation
insights if this helps broaden the applicability of ISG results to a larger set of hardware and software
renderers. On-going discussions should be on the ISG reflector. Some members have agreed to post
other academic and industrial references on benchmarking and performance prediction to the reflector.
BIFS for SNHC Functionalities
Two joint meetings were held with Systems BIFS. One session discussed remaining issues on Version 1
system integrity. A separate session examined new functionalities in Version 2 to support SNHC
66
67
decoding and scene composition. The Version 1 discussion dealt with specific node and synchronization
issues. Version 2 discussions compared Advanced BIFS with SNHC directions including these points:
 Scripts & more sophisticated animation/interaction
 Customizing BAP streams by some extension mechanism
- Adding feature control points, clothing, jewelry
 Dealing with progressive & incremental 3D models
 Harmonizing aural environment modeling
- Material properties & room geometry
- Consistency with 3D Model Coding
These discussions were fruitful, and no basic problems or duplications were identified. The mechanisms
for gradually expanding model detail or for adding to the model in chunks for error resilience while
always having an instantaneous model ready for scene composition and rendering need further case study.
Face Animation
Some encouraging work in model-based face tracking and 3D pose estimation was reviewed. This tends
to strengthen the case for the developing availability of technology on the encoder side to instrument live
faces for interactive applications of face animation at very low bandwidth. Discussions continued on face
calibration for Version 2 and the FCD problems for Version 1 cited earlier. The FAP default values in
arithmetic coder limits needed to be fixed for Version 1. Facial Action Basis Functions, as a means
to new functionality with simultaneous high coding efficiency and low decoding lag (compared with the
current frame-based arithmetic coding or DCT coding of FAPs), was dropped for lack of adequate results
on-time. This decision removes from consideration any new technologies that might have challenged
backward compatibility with Version 1 or the principle of one function, one tool. The area of face
calibration still needs more work to enable closure on useful profiling results with Requirements in
Version 2 for Calibration and Predictable FA. Due to the many Version 1 priorities at the Dublin
meeting, no effort was joined with Requirements to move this further along. A meeting was held with
Requirements to assess the packaging of Simple FA in Version 1 profiling relative to Main Profile;
results should be reviewed in the output of Requirements from Dublin.
2D Mesh
The Study of FCD contribution (M3644) was made available to the Visual editors as a reflection of prior
NB support. A joint session with Requirements was held to clarify level points previously recommended.
A new CE (M6) was added to the 3D Model Coding work associated with a slight change in header
bitstream flag semantics of 2D Mesh that would access 3D model connectivity coding now in the Visual
WD for Version 2. This means that the same Version 2 tool set would provide a form of generalized 2D
topological coding in addition to the 2D regular and Delaunay mesh coding now covered by the header
for 2D mesh coding in Version 1. Thus no new technology is introduced, and applications that need
general 2D mesh topological coding for MPEG-4 Version 2 could achieve this by invoking the 3D mesh
connectivity tool now headed for CD. This would also provide stronger support for efficient coding of
2D model primitives now supported in the BIFS 2D nodes and profiling work. Due to the meeting steps
remaining in Version 2 work, we must achieve bitstream testing and exchange by the interim 3D Model
Coding AHG meeting before Atlantic City. Then the M6 initiative must gain the approval of the Video
and SNHC groups showing that adequate discipline has been followed to incorporate M6 results in the
CD when the currently envisioned detail (however minor) is not in the VM. This coupling of 2D mesh
and 3D mesh connectivity coding was rehearsed and agreed a year ago in Stockholm. The necessary
work before Dublin was not completed on the agreed VM/WD/CD schedule.
Body Animation in Version 2
Much of the work was concentrated on verifying that all conditions have been met for promoting body
animation to WD including bitstream exchange and on improving the quality of the text for this purpose.
INT generously donated the hand animation software reviewed in the last few meetings, and reported on
67
68
successful BAP extraction for hand animation. Some valuable results were reported on body animation
core experiments. Analysis and demonstrations of animated models illuminated a better understanding of
bitrate vs. quantization tradeoffs. Dynamic animations helped illustrate where BAP quantization levels
become unacceptable for useful body motion granularity, signing intelligibility, stable dependent motions
of body parts, etc. Specific hand signing was demonstrated for alphabet examples, and VRML
Consortium Humanoid Animation models were integrated with MPEG-4 body animation to observe the
composite behavior of this unification of models and BAP decoding.
The Dublin meeting work actively incorporated informal agreements made with the VRMLC H-Anim
working group in the joint meeting on June 88, 1998, to harmonize the work of the two groups. Body
animation faced one dilemma about normative specification referencing. The nomenclature used in
MPEG-4 and H-Anim specifications should be the same. However the H-Anim work will likely result in
an informative annex to the VRML specification without the force of normative standardization in an ISO
framework. Thus MPEG-4 body animation will not make normative reference to H-Anim, but will use
the same nomenclature to enhance the prospects for ready development of applications when H-Anim and
MPEG-4 are combined. If there is any copyright problem, an indexing system will have to be adopted.
3D Model Coding in Version 2
The baseline work on 3D Model Coding for the interim AHG meeting at IBM Research on May 18-19,
1998, and for the Dublin meeting has included:
 M1: 3D mesh connectivity - lossless compression
_ Topological Surgery with enhanced arithmetic coding
_ Dual Graph topology with adaptive context-based arithmetic coding
_ Loop topology coding with islands and bridges
 M2: Geometry coding including progressive shape
_ Predictive Residual Vector Quantization (with Lattice VQ)
_ Scalar Quantization (VRML-CBF geometry compression)
_ Successive Quantization (with embedded arithmetic coding)
 M3: Progressive connectivity coding
_ Progressive forest split compression
_ Progressive vertex split/edge collapse
 M4: Properties coding (normals, color, texture coordinates)
_ Compressed representation of properties attached to a model,
with all bindings defined in VRML (per vertex, per face, per corner)
The experimentation with 3D models has been extensive and the technologies analyzed increasingly
sophisticated as well as cutting-edge. As mentioned before, a considerable effort has been applied to 3D
model coding, and care has been taken to exercise the discipline of N2073 as well as requiring that results
to be produced by deadlines to meet the CD targets. The efforts at the meeting have included bitstream
exchanges achieved during the meeting. Extensive data on bitrate vs. geometric distortion have been
rerun to isolate factors for more valid comparisons in selecting technologies. In one CE review, even
interactive end-to-end model processing into views on a VRML browser was accomplished while
participants watched to verify visually (as well as with data plots) the geometric error dispersion of
encoding and decoding. In some cases 2nd implementations and bitstream exchange did not finish in time.
The process reviews and results are sufficiently complex, that a viewgraph summary of the status of each
area was developed and maintained during the meeting and will be posted on the snhc-obj reflector. At a
summary level, the relative movement of technologies into the WD or VM is shown below:
 Version 2 technologies to Visual/Systems WDs
_ 2D/3D Mesh Connectivity: Topological Surgery/IBM
Prior run in VRML community, much work & maturity
Excellent competing technologies from USC, Samsung
_ Body Animation: Fusion of FA adaptation & H-Anim
“Loose” specification linkage with shared nomenclature
68
69
 Version 2 SNHC Verification Model
_ 3DMC Connectivity: promoted out of VM
??WD
_ Body Animation: promoted out of VM
??WD
_ 3DMC Geometry: Successive Quantization
??VM
_ 3DMC Progressive: Forest Split
already in VM
_ 3DMC Properties: VQ ??SQ?
evaluating alternatives
(from CE)
This resulted in the continuance of M2-M4 for bitstream exchanges and in some cases for the
achievement of other required process steps. Partners were enlisted to enhance the verification of the
various competing technologies to strengthen the viability of the primary candidates for CD promotion.
The AHG meeting in Korea in late August will be pivotal in providing sufficient evidence that the
remainder of the 3D Model Coding tool set can and should be advanced to CD.
The Korean NB expressed due concern about the adequacy of resources to finish the process in a manner
that justifies standardization. After much open discussion of the status of the work and the further
volunteering of participation, the following response to the Korean NB was given:
"WG11 thanks the Korean National Body for its comments on the progress of SNHC and in particular the
3D Model Coding tools for Version 2 MPEG-4. In response, two additional 3D Model Coding Ad Hoc
Group meetings have been scheduled before the WG11 meeting in Atlantic City to ensure adequate
attention to this important priority. Moreover, necessary steps have been taken to enlist additional
resources to confirm the superiority of the technologies already selected for advancement to Working
Draft in Atlantic City. A request for additional test models will be issued, and the 3D Model Coding
Verification Model software will be made available for public evaluation, at this meeting."
The group also recommended to WG11 a call for data sets to expand the 3D models used in testing and to
publish the VM/WD software to the industry to encourage experimentation and feedback on the
robustness of the tools. A special header for the software (expected to be issued after the Korean AHG
meeting) was drafted toward the end of the WG11 meeting and approved. Owners of the M1-M4
software should review this header language for acceptability (N2397) before issuing the software.
Starting with the AHG meeting at IBM Research, Samsung has proposed a variant of strip-oriented 3D
mesh coding, in addition to the Dual Graph (DG) and Topological Surgery (TS) technologies entered
earlier, that performs well for looping or ring mesh topologies. Examination of this coding method
revealed that it is compatible with incremental transmission of the 3D model for a given level of detail.
This opened consideration of how M1 WD technology (TS) and others offered so far could be modified
to support error resilience. Error resilience would be supported by any coding method that preserves high
lossless coding efficiency for the base mesh, but also allows ready partitioning of the coding into freestanding chunks of the model while yielding only a small loss in coding efficiency. M5, Partitioning of
Data for 3D Model Coding, was devised and supported by partners to rapidly investigate this
functionality by building on the technologies already under consideration. A meeting with Requirements
was held to establish that this functionality is useful, and the MPEG-4 Requirements were updated.
2D/3D Mesh Unification, M6, was described earlier to access 3D connectivity coding to serve as a
general topological coding method for 2D meshes as well without new technology.
MPEG-4 Overview
Late in the Dublin meeting, an update of SNHC functional language and partitioning of tools into Version
1 and 2 matching the current status of work was supplied to Requirements for the MPEG-4 Overview.
The submission was too late to affect output documents of Dublin, but should be refined as soon as
Requirements has time to incorporate and critique the changes.
Output Documents

SNHC Conformance Plan
N2299
69
70








SNHC Reference Software & Work Plan
SNHC Verification Model 9.0
Core Experiments in Face Body Animation
Core Experiments in 3D Model Coding
SNHC Public Request for Domain-Specific
Data Sets for 3D Model Coding
SNHC Release of Verification Model Tools
in 3D Model Coding for Public Evaluation
SNHC FAQs
Header for Release of MPEG-4 3D Model
Coding VM Software
N2300
N2301
N2302
N2303
N2304
N2305
N2309
N2397
Core Experiments
The following Core Experiments were formulated for Atlantic City:
 3D Model Coding
N2303
_ M2
Mesh Geometry/Vertex Coding
Predictive Residual Vector Quantization (with Lattice VQ)
Scalar Quantization (IBM VRML-CBF geometry compression)
Successive Quantization (with embedded arithmetic coding)
_ M3
Progressive/Scalable 3D Mesh Coding
Progressive forest split compression
Progressive vertex split/edge collapse
_ M4
Attribute Coding and Tool Integration
Compressed representation of properties attached to a model,
with all bindings defined in VRML (per vertex, per face, per corner)
_ M5
Partitioning of Data for 3D Model Coding
Error resilience potential vs. efficiency loss
_ M6
2D/3D Mesh Unification
 Face Body Animation
N2302
_ FA1 Face Model Mesh Calibration
_ BA2 BAP Coding
_ BA6 BAP Quantization Step Size
_ BAT BAT Interpolation
Other Output Documents
The following output documents were generated:





SNHC Reference Software & Work Plan
N2300
– Version 1 and 2 covered
SNHC VM 9.0
N2301
– Body Animation, Topological Surgery removed, Successive Quantization added
– Pre-Atlantic City AHG meetings aim to recommend further technology promotion per N2073
SNHC Public Request for Domain-Specific
Data Sets for 3D Model Coding
N2304
SNHC Release of Verification Model Tools
in 3D Model Coding for Public Evaluation
N2305
SNHC FAQs
N2309
Ad Hoc Groups for Dublin
The following groups were established to coordinate core experiments and documents:
70
71
 3D Model Coding
N2306
_ Big workload, carefully designed priorities to move VM technologies to WD
_ Key work with much expanded partnering on 2nd implementations & verification - THANKS!
_ Heading toward very robust 3DMC tools
_ Crucial meetings for success
30-31 August 1998, Seoul Korea
11 October 1998, Atlantic City
 Face Body Animation
N2307
_ 11 October 1998, Atlantic City
 SNHC VM Editing
N2308
Participants
Many thanks to the following individuals who participated in the working groups and SNHC meetings:
Name
Chieteuk Ahn
Claudio Lande
Claudio Silva
Cliff Reader
Czesław Jędrzejek
Eric Petajan
Fabio Lavagetto
Fernando Pereira
Francisco Moran
Françoise Prêteux
Frank Bossen
Gabriel Taubin
Gauthier Lafruit
Gérard Mozelle
Homer Chen
Ibrahim Sezan
Igor Pandžić
Iraj Sodagar
Jan Bormans
Jiankun Li
Jin Soo Choi
Joern Ostermann
Kwang-Kee Lee
Marc Escher
Marco Mattavelli
Mun-Sup Song
Murat Tekalp
Peter K. Doenges
Radu Jasinschi
Roberto Pockaj
Tolga K. Capin
Touradj Ebrahimi
Victor Varsa
Yo-Sung Ho
Company
ETRI
CSELT
IBM Research
Samsung
Institute of Communication &
Information Technologies
Lucent - Bell Labs
DIST - Univ. of Genova
University of Lisbon
Universidad Politécnica de Madrid
SIM/INT National Institute of
Telecommunications
EPFL
IBM Research
IMEC
SIM/INT
Rockwell
Sharp Labs
MIRALab
Sarnoff Corp.
IMEC
Univ. of Southern California
ETRI
AT&T
Samsung
MIRALab
EPFL
Samsung AIT
Univ. of Rochester
Evans & Sutherland
Tektronix
Univ. of Genova
EPFL
EPFL
Nokia Research Center
K-JIST
71
Country
KR
IT
US
US
PL
E-mail
ahnc@etri.re.kr
Claudio.Lande@cselt.it
csilva@watson.ibm.com
cliff@reader.com
jedrzeje@itti.com.pl
US
IT
PT
ES
FR
edp@bell-labs.com
fabio@dist.dist.unige.it
fp@amalia.img.lx.it.pt
Francisco.Moran@gti.upm.es
Francoise.Preteux@int-evry.fr
CH
US
BE
FR
US
US
CH
US
BE
US
KR
US
KR
CH
CH
KR
US
US
US
IT
CH
CH
SE
KR
Frank.Bossen@epfl.ch
taubin@us.ibm.com
lafruit@imec.be
Gerard.Mozelle@int-evry.fr
homer@risc.rockwell.com
sezan@sharplabs.com
Igor.Pandzic@cui.unige.ch
iraj@sarnoff.com
bormans@imec.be
jiankunl@caphis.usc.edu
jschoi@video.etri.re.kr
osterman@research.att.com
kklee@swc.sec.samsung.co.kr
Marc.Escher@cui.unige.ch
mattavelli@epfl.ch
mssong@saitgw.sait.samsung.co.kr
tekalp@ee.rochester.edu
pdoenges@es.com
radu.s.jasinschi@tek.com
pok@dist.unige.it
capin@lig.di.epfl.ch
ebrahimi@desun1.epfl.ch
varsa@research.nokia.com
hoyo@kjist.ac.kr
72
Other Related Contributions
Profiles
3695
Require
ments
Require
ments
Require
ments
Require
ments
Video
3771
General
3607
3629
3642
3648
Report of AHG on Profiles and Levels
Rob Koenen
JNB Comment on Simple and Core
Combination Profiles
Level parameters for 2D mesh object
(combination) profiles
MPEG-4 Profiles/Levels Summary
The National Body of Japan
Singapore National Body Comments on
Visual Profiles
Definition of Visual Combination Profiles
in FCD of 14496-2
Singapore National Body
Im1 interim report
Mesh software for MPEG-4 systems
player implementation (im1)
IM1 Software Platform AHG Report
Decoder Development Kit for IM1
Version 1.2
MPEG-4 Player Core Code Release 1.3
Zvi Lifshitz et al.
P. van Beek
P. van Beek, M. Tekalp, I. Sezan
Olaf Barheine
German National Body
IM1
3544
3643
Systems
Systems
3671
3676
Systems
Systems
3678
Systems
P. K. Doenges
3 August 1998
72
Zvi Lifshitz
Zvi Lifshitz
Zvi Lifshitz
73
Appendix A
SNHC Contribution
Press Release
Dublin, 9 July 1998
Highlight
SNHC work has resulted in polishing details in the Final Committee Draft for MPEG-4 Version 1.
Demonstrations of actual SNHC tools in Systems mock-ups now show most SNHC capabilities in the
Version 1 FCD. Version 2 capabilities in Body Animation and 3D Model Coding are advancing briskly
through the process and have achieved Working Draft status. The entire SNHC tools suite combined with
joint results in Systems scene description will provide robust coding of mixed media graphics including
2D and 3D structures combined with A/V. Significant compression efficiency gains are being achieved
in fierce international competition.
Details
MPEG-4 Version 1 verification work in proof-of-concept demonstrations that combine Systems and
SNHC technology now shows 2D Animated Mesh as well as Face Animation in software-only form on
PC and workstation platforms running at useful rates. Compelling software contributions from around
the world are validating the real-time feasibility of the decoding and composition of MPEG-4 mixed
media. Work also proceeds on detailed Conformance definitions.
Version 2 initiatives have seen tremendous progress in Body Animation (including synergies with the
VRML Consortium H-Anim Working Group) and 3D Model Coding, elements of which have been
advanced to Working Draft status. 3D Model Coding is addressing the compression of model structure,
geometry, and properties as well as related methods to send models for incremental build-up of scenes in
terminals. These advancing capabilities will complement Version 1 SNHC decoder and scene description
features to provide a robust environment for compressing 3D streams. Single-shot 3D downloads or
progressive transmission to terminals, and the capability to animate remotely full human figures with
talking heads, will be supported.
WG11 is requesting public contributions of additional data sets to the testing of 3D Model Coding, and
making the release of Verification Model software to facilitate public evaluation. Careful study and
experiments are developing to characterize the connection between 3D content in MPEG-4 streams and
the often quite variable rendering of 3D scenes in terminals. This work aims to provide content
developers and terminal manufacturers the chance to fit terminals to complexity metrics in 3D streams to
ensure higher quality experiences of coded virtual worlds.
73
74
Annex 9
Test meeting report
Source: Laura Contin (CSELT), Chair
Introduction
At the 44th meeting of WG11, in Dublin, the results of two verification tests were presented and
discussed. The workplan for the other verification tests was updated.
MPEG-4 audio verification tests
Digital audio broadcasting
The Digital Audio Broadcasting test was planned and carried out in collaboration with the
European consortium NADIB (Narrow Band Digital Broadcasting).
The goal of this test was to evaluate the performance of digital systems (including MPEG-4, ITUT G.723.1, MPEG-2 LayerIII) against Perfect AM, under conditions representative of audio
broadcasting and focusing the attention on the comparison between scaleable and not scaleable
mode. In particular scaleable codecs working at a global bitrate of 24 kbit/s (6+18 kbit/s) were
compared against non-scaleable codecs either at the same bitrate or at 18 kbit/s, been this second
condition representative of the simulcast mode.
Two separate tests were carried out, including narrow-band (used only for the core layers of the
scalable codecs) and the wide-band signals respectively. In both of them only the monophonic
mode was used.
The tests were carried out in two laboratories with non-expert listeners. Data analysis confirmed
the reliability of the subjects and revealed a bias due to the test site, although rankings obtained at
the two laboratories were generally in agreement.
Test results were discussed with the Audio Subgroup and the main conclusions about the
performance of the codecs are:
 some codecs gave a very programme-dependent performance
 in the narrow-band test NB-CELP and G.723.1 performed equally well and better
than Twin-VQ.
 in the wide-band test AAC-24 was the best.
 MPEG-4 at 24 kbit/s offers a worthwhile improvement to AM broadcasting,
 scalability at 6+18kbit/s is better than basic coding at 18 kb/s but not as good as basic
coding at 24 kb/s, therefore scaleability is better than simulcast, but as expected
scaleable codecs perform worse than non-scaleable ones.
 WB-CELP(mode3) did not perform well for speech+music.
The reasons for some of these observations were discussed during the meeting and they are
explained in the final report (document N. 2276).
Speech
The testplan of the verification tests on MPEG-4 speech coding was fully defined at last MPEG
meeting and the preparation of the items to be used was completed just before the Dublin
meeting.
However it was realised that there was a considerable variation of level among different items
and this would have been a further source of variation that could have made much more difficult
the interpretation of the test results. Therefore it was agreed to adjust the ‘outliers’ and encode
74
75
them again.
In addition, test conditions, in particular the codecs to be used in wide-band test, were revised by
the Audio Subgroup. Details about the final decisions are given in document N.2277.
Test results will be made available at the beginning of September.
Internet radio
The test plan previously approved was completely revised and now it includes four sub-tests:

Audio coding at a bit rate below 10kbit/s.

Audio coding at bit rates around 16 Kbit/s

Saleable coding of mono material at 24 kbit/s

Scaleable coding of stereo material in a range of bitrate between 40 and 56 kbit/s
Details about the test plan are given in document N. 2278.
In addition during the meeting the source material collected for this test was pre-screened and 39
items out of 90 were selected (see document N.2279). The final selection of the test material will
be done on the encoded material and it is one of the tasks of the ad hoc group for audio
verification tests.
MPEG-4 video verification test
Error robustness
The goal of this test was to evaluate the performance of MPEG-4 error resilience tools, under
conditions representative of video communications over mobile networks.
Test conditions were produced by means of a simulation of the complete transmission chain,
including transmission errors. The combination of three different bit rates with two error
conditions was considered. In order to obtain more reliable results, a new test method that is
particularly suitable to evaluate time-varying video impairments was applied.
The test was carried out in three laboratories with non-expert viewers. Data analysis confirmed
the validity of the method, the reliability of the subjects and revealed a bias due to the test site,
although the trends of the results were very similar in the three laboratories.
Test results were discussed with the Video Subgroup and the main conclusions about the
performance of the codecs are:
1. Generally speaking the only condition that presented annoying transmission errors was at 128
kbit/s with critical errors (i.e. 1e-3 10ms burst errors). Video experts felt that further
evaluation is to be performed in an ad hoc group. If it is judged that significant improvement
can be obtained by more appropriate choices of encoder parameters, new test material will be
produced and the test repeated.
2. The quality of sequences encoded by MPEG-4 error resilience tools and affected by typical
transmission errors of mobile networks (i.e. 1e-4 10ms burst errors) is comparable to the
quality of sequences without errors,
3. At 32 kbit/s there is a considerable masking effect, thus transmission errors do not increase the
annoyance due to coding artefacts
Content-based coding
A third pre-screening of the material to be used in the lower bit rate test was conducted during the
Dublin meeting. Sequences were coded by using MPEG-1 and ‘MPEG-4 Frame-Based’, both
using rate control.
A number of problems related either to the implementation of MPEG-1 or to the particular rate
75
76
control used were discussed and new coding parameter settings were agreed. In particular, in
order to make fair comparisons between ‘MPEG-4 Frame-Based’and MPEG-1, it was decided
that the MPEG-4 rate control will be implemented in the MPEG-1 encoder and MPEG-1 (TM5)
adaptive quantisation weighting factor will be used in MPEG-4.
Moreover, during the pre-screening a new sequence named ‘Birthday’ was presented. This
sequence was produced by BBC, in reply to a call for critical segmented material issued at the
previous MPEG meeting. Although the sequence meets most of the requirements indicated in the
call, it was decided not to use it in the verification test because in that sequence the whole
information of each object is always available, even when two objects overlap. This would result
in a disadvantage for the object-based coding that in this kind of sequences wastes bandwidth to
encode hidden parts.
Finally, the test methods to be used in the two tests (i.e. high and low bitrates) were agreed.
Details about coding parameter settings and test methods are given in document N.2334
Scalability
In Dublin, a first pre-screening on the material to be used for the scalability verification test was
conducted.
The suitability of the sequences to be used in this test was discussed and it was suggested that
sequences are representative of potential applications. It was also realised that negative effects
may be introduced when the frame rate of only one of two foreground objects is improved.
Moreover, it was recognised that the rate control is an important element and it should be used in
the production of test conditions.
Therefore, in the ad hoc group for video verification tests the suitability of available MPEG
sequences will be investigated and a suitable rate control strategy will be developed.
Finally, taking into account the considerable amount of work to be done, it was decided to
remove the spatial scalability from the first round of this verification test.
The material for a second pre-screening will be prepared according to the considerations
explained above and it will be presented in Atlantic City.
Archival records of audio, video and audiovisual source material
In Dublin the Test Subgroup has started to organise the distribution of video and audiovisual
source material on CD-ROMs.
Document N. 2336 addresses the logistics for such a distribution.
Both Audio and Video Subgroup representatives expressed an interest for archiving all the source
material donated to MPEG. The establishment of these archives and the policy for the distribution
of the material within MPEG will be discussed at the next meeting in Atlantic City. The
distribution will start from the sequences for which the Convenor has received a written
permission to print them on CD-ROM.
List of output documents
Title
MPEG-4 Audio verification test results: narrowband audio
broadcasting
Plan for MPEG-4 Audio verification tests: speech codecs
Plan for MPEG-4 Audio verification tests: music on Internet
76
Number
2276
2277
2278
77
Prescreening results on MPEG-4 Audio verification test excerpts Music on Internet
MPEG-4 Video verification test results: error robustness
Revised test conditions for video verification test on content-based
coding
Revised test conditions for video verification test on scalability
Test plan for the second verification test on error resilience
Logistics for distribution of video and audio-visual test material on
CD-ROMs
MPEG Test FAQs
2279
2333
2334
2335
2368
2336
2337
Ad hoc groups
Ad hoc group
Doc. #
vAd-hoc group on MPEG-4 Audio Verification tests (Edler/SW Kim)
Ad-hoc group on MPEG-4 Video Verification tests
(Wollborn/Suzuki/Baroncini)
77
2296
2338
78
Annex 10
Implementation meeting report
Source: Marco Mattavelli (EPFL), Chair
Generalities
Five main topics have been the subject of the activity of the Implementation Studies Group (ISG)
during the Dublin meeting:
1) Video decoder complexity analysis for the definition of profiles and levels based on the QoS
activity,
2) Computational Graceful Degradation for SNHC video and Synthetic Audio,
3) Complexity analysis for Structured Audio Orchestra Language (SAOL),
4) Complexity evaluation of MPEG-4 components,
5) Various complexity issues: texture coding complexity, chroma keying shape coding, matching
pursuit, padding.
6) Definition of ISG Frequently Asked Questions.
1) Video decoder complexity analysis for the definition of profile and levels based on the
QoS activity
Ad-hoc activities have been reviewed. Contribution M3615 (“Some results on MB coding
complexity”) shows promising results that should be validated by other optimized decoders.
Anyhow, such results are in reasonable accordance with another encoder approach (a
programmable macroblock processor from the University of Munich) and seem a good basis to
derive meaningful video “levels” based on complexity.
A new definition of video complexity has been derived from these results. It is based on a linear
combination of macroblock coding modes weighted by a correspondent complexity coefficient
derived from the experiments. This new complexity definition has been approved by the ISG, has
been proposed for the setting of “Levels” in video, and has been reported in output document
N2318. Such definition according to the ISG discussions is certainly much more related to
decoding complexity than the existing definition. The adoption of the new definition is under
discussion in the video group and comments from NB are asked.
Results from other optimized decoders necessary to validate and improve the QoS results have
been requested, Bit-streams with critical test sequences can be made available and there is no
need of giving away source code, but no volunteers have been found for the work.
Further steps for accomplishing the QoS activity mandate are:
 to verify the applicability and to provide guidelines of the defined complexity metrics for
bounding the intrinsic complexity of video bit-streams
 to verify the applicability of the complexity metrics for classifying different decoders in terms
of conformance and QoS.
2) Computational Graceful Degradation for SNHC video and Synthetic Audio.
78
79
Review of results reported in contribution M3567 (Computational Graceful Degradation Analysis
in SNHC) has permitted to find the main complexity dependencies involved in the processes of 3D rendering. The algorithms algorithms considered covers the various filtering for mapping
points, and the MIP mapping (extraction of points from different resolution images for large
angles of vision for which the points are 3-linearly interpolated). A complete table of
dependencies has been defined. In conclusion 4 parameters seem to completely define SNHC
rendering complexity. They are:
 the number of triangles,
 the number of vertices,
 the number of edges,
 the number of visible pixels.
SNHC-CGD experiments to verify the complexity analysis have been defined and described in
output document N2317. Goals, conditions of experiments and a list of relevant bitstreams and
models for performing the profiling experiments are reported. Volunteers for the experiments and
assistance from the SNHC have been defined.
3) Complexity analysis for Structured Audio Orchestra Language (SAOL)
Ad-hoc groups activities and contributions have been reviewed. Contribution M3602 (A method
for measuring complexity in Structured Audio) explains as SAOL is a language for describing
algorithms for audio processing and synthesis and therefore there is no way to have a statistical
description or worst case complexity. A complexity evaluation approach independent from the
decoder platform is necessary. Following such approach, SA bitstreams are partitioned in: 1)
variable and tables, 2) Memory accesses, 3) Summing buses, 4) statements and expressions 5)
core opcodes. Core opcodes are further divided in 4 groups. According to this approach a vector
of generic and opcode operators can be extracted by each SA algorithm and can be used to
characterize SA complexity. The proposed dimension of the vector is 12.
A second method described in contribution M3611 (Another method for measuring complexity in
structured audio) is based instead on profiling a specific reference SA decoder. Only real-time
synthesis has been considered. The complexity estimation measure is based on only 5 types of
operations. The output is the total amount of operations, core mathematical operations are
proposed to be equivalent to 5 non-opcode mathematical operations. In conclusion the method
consider 7 parameters and does not include opcode optimization (it can be considered as a
measure of worst case SA decoding complexity if opcodes are used).
The ISG and SA subgroup agreed that the first method is better suited for the goal of platform
independent complexity analysis. The software tool designed for such measurements (provided
by the EPFL) will be available within two weeks after the end of Dublin meeting for experiments
and tests. Output document N2282 (Study of complexity of SAOL) describes the aims and
conditions of the experiments. The main results that are expected for the next meeting are the
measure of the variability of vector components for some typical algorithms and the evidence that
a separation between opcodes for audio effects (libraries) and synthesis libraries is meaningful or
not.
4) Complexity evaluation of MPEG-4 components.
The analysis of the overall MPEG-4 System complexity, issue that was not discussed in the
previous Tokyo meeting, has been started in the Dublin meeting.
Contribution M3631 (Computation Complexity Profiling of the IM-1 MPEG-4 Player) reports a
first preliminary analysis of the various MPEG-4 systems components. The results are based on
79
80
profiling the IM1 player 0.4.5 on a Pentium MMX233Mhz platform. Results on only two
sequences are reported. This interesting contribution presents the first complexity comparisons
between natural audio, natural video and synthetic video (a tool for facial animation). It also raise
the need of the availability of an IM1 “encoder” in order to be able to generate content for which
complexity measures can be extracted in a straightforward and reliable manner. Specific IM1
content is indeed necessary for the complexity evaluation of other SNHC tools, of synthetic
audio, of other systems nodes (AudioFX for instance) and to evaluate the performance and
complexity of the system synchronization model.
5) Various complexity issues: texture coding complexity, chroma keying shape coding,
matching pursuit, padding complexity.
A summary of the reflector mail exchanges about texture coding complexity has been presented
to the group. Three modes of wavelets have been analyzed. Their complexity is comparable and a
selection of them cannot be based on complexity considerations. Contributions M3645
(Complexity analysis and guidelines for profile definition of Still Texture Coding
Implementation) has been reviewed. An output document (N2316 Recommendations for still
texture coding (wavelets) implementations.) summarizing the results present in this meeting and
contributions of previous meetings, has been edited and approved by the group.
Chroma keying shape coding complexity has been discussed reviewing reflector mail exchanges.
Although an absolute complexity comparison of Chroma keying shape coding with the Simple
Profile decoding has been asked to the ISG group, no action has been taken since such request has
not been officially raised from the Requirement or Video Group.
Contribution M3572 (VLSI implementation of repetitive padding: cost and architecture) reports
the architecture of a “padding” co-processor. Considering also previous contributions the ISG has
proposed for the most processing demanding operation of MPEG-4 “composition” and
“padding” new architectures for VLSI implementations.
Matching pursuit complexity has been briefly evaluated on the basis of previous contributions.
No conclusion has been taken since no official request from the Requirement or Video group has
been raised.
6) ISG FAQ
A list of ISG FAQ has been prepared, volunteers preparing answers for each question and a
coordinator for the ISG FAQ has been decided.
- Update of existing FAQ and collection of new ones (Bormans)
- CGD related questions (Mattavelli)
- Complexity measurements questions (La Fruit)
- QoS related (Mattavelli)
80
81
Annex 11
Liaison meeting report
Source: Barry Haskell (AT&T Research), Chair
The Liaison group considered the following Dublin input documents
SC29/N2543 from VRML on External Authoring Interface (EAI)
SC29/N2552 from VRML on EAI
SC29/N2577 from FIAPF requesting Category A Liaison
SC29/N2611 from ITU-T SG16 Q11 on MPEG-4 Video
SC29/N2608 from CEN
M3514 from ITU-T SG12 on MPEG-4 Video verification
M3515 from ITU-T SG12 on MPEG-4 Audio verification
M3521 from SC29/WG1 on JPEG2000
M3523 from CEN/ISSS on Cooperation
M3525 from SMPTE on video channel assignments
M3526 from ITU-R on multi channel audio
M3527 from DAVIC call for proposals
M3528 from DAVIC call for proposals
M3534 from AES
M3586 from ITU-R TG8 on IMT-2000
M3516 from Intelsat liaison request
M3520 from VRML on ISO/IEC 14472-2 EAI
M3524 from European Patent Office requesting liaison
M3542 from VRML on Interoperability
M3543 from TC100 plans
M3585 from SMPTE
M3779 from USNB on VRML Liaisons
M3814 from CEN
M3550 from ITU-T Q11 & 15 on H263 & MPEG-4 video
M3837 from ITU-T Q11
M3838 from ITU-T SG16 Q11 on future MPEG work
Email from R. Koenen on DAVIC applications
Email from R. Koenen on W3C applications
ITU-T SG16/Q15-D-09 on MPEG-4 video compatibility
Email on IFPI liaison
The following output liaison documents were produced:
2342
2377
2378
2379
Liaison to ITU-T SG16 on publication scheduling
Closer working relationship with IETF on DMIF
Liaison to ECMA
Reply to liaison statement of ITU-T SG 12 on MPEG-4 audio verification
tests
2380
Reply to liaison statement of ITU-T SG 12 on MPEG-4 video verification
tests
81
82
2381
2382
2383
2384
Liaison to ITU-R JWP 10-11Q on MPEG-4 audio verification tests
Reply to liaison statement of ITU-R JWP 10-11Q on MPEG-4 video
verification tests
Liaison to ITU-T SG16 on MPEG-4 audio verification tests
Liaison to ITU-T SG 16 Q11 & Q15 on MPEG-4 Video over H.324
2385
2386
2387
Liaison to VRML and SC24
Liaison to EBU B/CASE on MPEG-4 audio verification tests
Liaison to ITU-R 10C on MPEG-4 audio verification tests
2388
2389
2390
2391
2392
2393
2394
2395
2396
Liaison to JPEG
Liaison to World Wide Web Consortium (W3C)
Liaison to DVB
Liaison to ATSC
Disposition of National Body Comments
Liaison to CEN
Liaison to DAVIC
Liaison to SMPTE
Liaison to DVB Technical Module TM
82