LMGT LOGO
Platform and terminal aspects
Simão F. Campos Neto
Vice-Chair, SG16 (Brazil); Chair WP 3/16 (Media Coding)
Lockheed Martin Global Telecommunications
IP-Networking and Mediacom 2004 Workshop
Session MM3/MM4: Convergence / Interactive Broadcast
1
Objective
• Present an overview of ITU-T perspective
on provisioning Multimedia Services (MM)
2
MM Applications Development
Users
Recommendations
for Applications &
Services (F,T series)
Interoperability
Factors:
•Users needs
•Market Trend
•System Design
•Architecture
•Interoperable
Numbering,
Charging Specs.
(E-series)
Integration or
Assembling of
Multimedia Parts
Common Multimedia
Parts, e.g.,
Coding (G,H,T-series),
Security (X-series),
Directory (X-series)
(Terminal Design; J,H-Series)
Media (CS, PS, Cable)
Wired/Wireless
(ITU and non-ITU)
3
MM Element Interdependence
Network Specific Recommendations
ISDN
B-ISDN
PSTN
Mobiles
Packets
F.MDS
F.700
Service Description Process
F.MRS
F.MCVS
F.MCS = F.702
Communication Capabilities :
MSEs
Comm.
Tasks
Generic
Multimedia
Services
Media
Comp.
F.MDS.1
F.MRS.1
F.MCV.1
F.MDS.2
F.MRS.2
F.MCV.2
F.MDS.3
F.MRS.3
F.MCV.3
F.MDS.4
F.MRS.4
F.MCV.4
F.MDS.5
F.MRS.5
F.MCV.5
F.MCS.4
F.MCS.5
H.324
H.324
H.323
Terminals or
End-points
H.247
N. A.
N. A.
H.332
Multipoint
H.245
H.245
H.245
In-band
Signalling
H.223
H.223
F.MCS.1
= F.731
F.MCS.2
= F.732
H.320
H.310
F.MCS.3
H.321
Technical Descriptions
Equipment/protocol perspective
Service Descriptions
User perspective
Network Independent Recommendations
G.729
G.728
G.723
G.722
H.263
H.262
H.261
H.243
H.231
G.711
H.242
T.120
H.230
H.245
T.130
H.221
H.222.0
H.222.1
Multiplex
H.225.0
H.248
Protocols
Audio Coding
Video Coding
Q.931
Q.2931
Q.23
Q.---
ISDN
B-ISDN
PSTN
Mobiles
Call Control
Packets
MSEs = middleware service elements
4
Services
5
MM Service Descriptions
Integration of media components from the user’s point-of-view
Service definition and requirements are available in the
F-series. F.700 contains the umbrella definitions:
• Several MM tasks:
–
–
–
–
–
–
Conferencing (multipoint, bi-directional, real-time)
Conversation (point-to-point, bi-directional, real-time)
Distribution (point-to-multipoint, unidirectional)
Sending (point-to-point distribution, Tx controlled, UD; info pushing)
Receiving (point-to-point distribution, Rx controlled, UD; info retrieval)
Collecting (multipoint-to-point distrib., UD, Rx controlled; info polling)
• Media components: audio, video, text, graphics, stillpictures, and data
• Quality level for media components: {-1, 0, 1, 2, 3, 4}
6
MM Service Descriptions (2)
F.70x: network-independent definitions
• F.702 (F.MCV)-Multimedia conference services
• F.703 (F.MCS)-MM conversational services
Network-specific definitions
• F.731- N-ISDN MM conference services
• F.732- B-ISDN MM conference services
7
Terminals
8
Multimedia terminals
Integration of media components from the equipment/protocol point-of-view
• H.320: Communications over N-ISDN
• H.310: Communications over B-ISDN
• H.323: Communications over packet networks
(mainly IP)
• H.324: Communications using circuit-switched
services (fixed and mobile, including
3GPP)
• H.246: Terminal Interworking
9
Multimedia terminals (2)
Example: Functional model for H.320 N-ISDN Terminal
Audio Coding (G.711)
Video Coding (H.261)
User
Interface
Data Coding (T.120)
MM Mux &
Sync
(H.221)
Network
Interface
System Control (H.242)
Call Control (Q.931)
10
Multimedia terminals (3)
Example: Functional model for H.323 Terminal
Audio Coding (e.g. G.711, G.729)
Video Coding (e.g. H.261, H.263)
User
Interface
User Data Coding (T.120)
MM Mux &
Sync
(H.225.0)
Network
Interface
System Control (H.245)
Call Control (H.225.0, Q.931)
11
Multimedia terminals (4)
Example: Functional model for H.324 Terminal
Audio Coding (e.g. G.723.1)
Video Coding (e.g. H.261, H.263)
User
Interface
Data Coding (T.120; V.14, LAPM)
MM Mux & Sync
(Fixed network: H.223;
Mobile: H.223 Annexes A-D)
Network
Interface
System Control (H.245,SRP/LAPM)
Call Control (National standards; V.250)
12
MM terminals (5): Interoperability
H.324
H.310
User data
User data
Audio/Video
Audio/Video
Call Control
(H.245)
Mobile
Fixed
H.223
H.223
Anx.A-D
H.225.0
RTP/
Non-QoS
Call Control
(H.245)
H.221
User data
Audio/Video
Audio/Video
QoS
User data
H.323
Mux
H.222.0
H.222.1
Call Control
(H.242/H.243)
Call Control
(H.245)
H.320
Scope
for H.246
13
Media components
14
Data
• T.120-T.140,T.17x provide definitions for
data exchange and control in MM
conferencing applications. For example:
– T.120 defines data protocols for multipoint
multimedia conferencing (Annex C describes a
light version of T.120). E.g. White-board
applications.
– T.140 adds text conversation (“chat” e.g. for
hearing-impaired people)
– T.17x: MHEG for information retrieval
15
Media Coding
Four aspects:
• Audio
• Video
• Still-image
• Other media coding
16
Media Coding: Audio
• Three “classic” quality tiers: audio, wideband
speech, and telephony speech.
• ITU-T focus on interactive communications,
hence mainly produced wideband and
telephony speech compression standards
(F.700’s A0 and A1 Quality Levels).
17
Media Coding: A2/A3 Audio
• A2 coding for broadcast applications J.41
(logarithmic PCM compression, 15kHz, 384kb/s) 1988
• A2&A3 Audio coding: ISO MPEG
– MPEG2/Audio (e.g. MP3)
– MPEG4/Audio
18
Media Coding: A1 Audio
A1: Wideband speech coders (50-7000Hz)
• J.42 11-bit logarithmic PCM compression
(192 kbit/s) 1988
• G.722 Split-band ADPCM Coding of 7 kHz speech
(64,56&48 kbit/s) 1988
• G.722.1 Transform coding (32&24 kbit/s) 1999
• G.16kWB Coding of 7 kHz speech at around 16 kbit/s
(planned mid 2001)
19
Media Coding: A0 Audio
A0: Telephony speech coders (300-3400 Hz)
•
•
•
•
•
•
•
•
G.711 PCM coding (64 kbit/s) late 60’s
G.726 ADPCM coding (32; 40, 24 & 16 kbit/s) 1988
G.727 Embedded ADPCM coding (40-16 kbit/s) 1990
G.728 LD-CELP coding (16; 40, 11.8 &9.6 kbit/s) 1992
G.723.1 Dual-rate coding (5.3 & 6.3 kbit/s) 1995
G.729 CS-ACELP coding (8; 12.8 & 6.4 kbit/s) 1996-98
G.4kbit/s Coding of speech at 4 kbit/s
G.VBR Variable bitrate speech coding
Ongoing
New
20
Media Coding: Video
• ITU standards:
–
–
–
–
H.261  Video Codec for N-ISDN
H.262 = MPEG2/Video (“Common text”)
H.263 and Annexes  IP, wireless, and N-ISDN
H.26L: successor to H.263
Ongoing
21
Media Coding: Still Image
• Still image (B/W & color) is used in facsimile
services, in Internet applications, digital
photography, etc.
• Standards work performed by a “Collaborative
ITU|ISO/IEC Team” working under ISO/IEC
SC29 rules and organization
• ITU has “common-text” for JPEG/JBIG (T.80
series); soon-to-be JPEG2000 (T.800 series)
22
Other media coding
Currently not performed in ITU-T:
• Character coding (ISO/IEC SC2 activity)
• Speech synthesis (text-to-speech)
• Speech recognition (new developments)
23
Conclusion
• Service definitions provide the user
perspective for MM communication
• Terminals & protocols integrate different
media components for specific applications
• Interoperability adaptations are necessary
• Existing terminals are network-specific,
however there is a trend towards more
flexible specifications.
24
Media Coding
Supplemental Slides
25
Telephony-band
Speech Coding Families
Parametric
(Vocoding)
Waveform
Coding
Channel
PCM
Hybrid
Coding
Formant
DPCM
Homomorphic
ADPCM
LPC
DM
APC
SBC
RELP
ATC
MPLPC
Sinusoidal
CELP
Harmonic
SELP
Phase
MBE
ADM
CSVD
26
Telephony-band
Speech Coding Families
Quality
APC
MPLPC
CELP
Hybrid Coding
ATC
RELP
DPCM
ADPCM
Log
PCM
Waveform Coding
MBE
LPC10e
Vocoding
1
2
4
8
16
32
64
Bit rate (kbit/s)
27
A2/A3 Non-ITU Standards
• MPEG2/Audio: audio coding > 64 kbit/s (1992)
• MPEG4/Audio: audio + speech coding at bit rates
between 64 and 2 kbit/s (1998)
28
A0-A1 Non-ITU Standards
• ETSI/3GPP:
–
–
–
–
–
13 kbit/s RPE-LTP (Full rate GSM, 1988)
6.5 kbit/s VSELP (Half-rate GSM, 1993)
12.2 kbit/s EFR (Enhanced full-rate GSM, 1996)
12.2 - 4.75 kbit/s AMR (Adaptive Multi Rate, 1999)
6.6 - 23.85 kbit/s AMR-WB (Wideband AMR, 2001)
• ARIB (Japan)
– Full-rate PDC (Personal Digital Communication) 6.7 kbit/s VSELP
– Half-rate PDC 3.45 kbit/s Pitch Synchronous Innovation CELP
29
A0-A1 Non-ITU Standards
(cont’d)
• US TIA (ANSI)
– CDMA
•
•
•
•
IS96 8,4,2 kbit/s QCELP (Qualcomm CELP, 1992)
IS127 8.55, 4, 0.8 kbit/s EVRC (Enhanced Var. Rate Codec, 1996)
IS733 13.3, 6.2, 2.7, 1 kbit/s VRC (Variable Rate Codec, 1998)
CDMA2000 9.6,4,2.4,0.8 kbit/s SMV (Selec.Mode Vocoder, ?2002)
– TDMA
• IS54 7.95 kbit/s VSELP (Vector-Sum Excitation Lin.Pred., 1990)
• IS641 7.4 kbit/s ACELP (Algebraic CELP, 1997)
– PCS1800 (GSM upbanded to 1800 MHz)
• IS136-410 12.2 kbit/s US1 (1999)
30
Still Image Coding Summary (1)
• Umbrella: T.80 [1992]
• JPEG: T.81 (Part I), lossy and loss-less [1992]; T.83
(Compliance testing) [1994]; T.85 (Extensions, defs & testing)
[1996]; T.85 Corr.1 [1999]; T.86 Registration of JPEG Profiles
[1998]; T.87 (Baseline) Lossless and near-lossless compression
of continuous-tone still images [1998]
• JBIG: T.82, loss-less [1993]; T.82 Corr.1 [1995]; T.85 JBIG for
fax terminals; T.85 Amd.1 [1996], 2 [1997]; T.85 Corr.1 [1997];
T.88 Lossy/lossless coding of bi-level images [2000]; T.89
Application profiles for Recommendation T.88 [2000]
31
Still Image Coding Summary (2)
Planned new common texts:
• T.800: Part 1, JPEG 2000 Image Coding System:
Core Coding System
• T.801: Part 2, JPEG 2000 Image Coding System:
Extensions
• T.802: Part 3, Motion JPEG 2000
• T.803: Part 4, Conformance Testing
• T.804: Part 5, Reference Software
• T.805: Part 6, Compound Image File Format
• T.806: Part 7, Technical Report: Guideline of
minimum support function of Part-1
32
ITU-T Video Coding
• H.261: Video Codec for A/V services at p x 64 kbit/s
– The first practical video coding standard (1990)
– Used today in (ISDN) video conferencing systems
– Bit rates commonly 40 kbit/s to 2 Mbit/s
• H.262: Same as MPEG-2/Video (ISO/IEC 13818-2)
–
–
–
–
Commonly used for entertainment-quality video applications
The first practical standard for interlaced video
Used in digital cable, digital broadcast, satellite, DVD, etc.
Bit rates commonly 4-20 Mbit/s
33
ITU-T Video Coding
(continued)
• H.263: Video Coding for Low Bit Rate Communication
– Significantly improved video coding compression
performance (especially at very low rates, but also at higher
rates as well)
– The first error and packet loss resilient video coding standard
– Used in Internet protocol, wireless, and ISDN video
conferencing terminals (H.323, H.324, 3GPP, etc.)
– “Baseline” core mode interoperable with MPEG-4/Video
– Rich set of features for many applications
– Very wide range of bit rates and possible applications
34
Non-ITU-T Video Coding
• MPEG-1/Video (ISO/IEC 11172-2)
– The first video coding standard using half-pel motion
compensation
– Typical bit rates 1-2 Mbits/s
• MPEG-4/Visual (ISO/IEC 14496-2)
– The first video coding standard defining arbitrary object shapes
– Many creative features for synthetic and synthetic-natural hybrid
content
– Contains essentially all features of all prior standard codec
designs
– Interoperable with ITU-T H.263 “baseline”
– Very wide range of bit rates and possible applications
35