Tema 0:
Transmisión de Datos Multimedia
Clases de aplicaciones multimedia
Redes basadas en IP y QoS
Computer Networking: A Top Down
Approach Featuring the Internet,
3rd edition.
Jim Kurose, Keith Ross
Addison-Wesley, July 2004.
Transmisión de Datos Multimedia –
http://www.grc.upv.es/docencia/tdm
– Master IC 2007/2008
Transmisión de Datos Multimedia - Master IC 2007/2008
2
What is multimedia?
 Definition of multimedia
 Hard to find a clear-cut definition
 In general, multimedia is an integration of text, graphics, still and
moving images, animation, sounds, and any other medium where every
type of information can be represented, stored, transmitted and
processed digitally
 Characteristics of multimedia
 Digital – key concept
 Integration of multiple media type, usually including video or/and audio
 May be interactive or non-interactive
Transmisión de Datos Multimedia - Master IC 2007/2008
Various Media Types
 Text, Graphics, image, video, animation, sound, etc.
 Classifications of various media types
 Captured vs. synthesized media
 Captured media (natural) : information captured from the real world
– Example: still image, video, audio
 Synthesized media (artificial) : information synthesize by the computer
– Example: text, graphics, animation
 Discrete vs. continuous media
 Discrete media: space-based, media involve the space dimension only
– Text, Image, Graphics
 Continuous media: time-based, media involves both the space and the time
dimension
– Video, Sound, Animation
3
Transmisión de Datos Multimedia - Master IC 2007/2008
Classification of Media Type
Sound
Video
Continuous
Image
Discrete
Captured
From real world
4
Animation
Continuous
Text
Graphics
Discrete
Synthesized
By computer
Transmisión de Datos Multimedia - Master IC 2007/2008
5
Text
 Plain text




Unformatted
Characters coded in binary form
ASCII code
All characters have the same style and font
 Rich text




Formatted
Contains format information besides codes for characters
No predominant standards
Characters of various size, shape and style, e.g. bold, colorful
Transmisión de Datos Multimedia - Master IC 2007/2008
Plain Text vs. Rich Text
An example of Plain text
6
Example of Rich text
Transmisión de Datos Multimedia - Master IC 2007/2008
Graphics
 Revisable document that retains structural information
 Consists of objects such as lines, curves, circles, etc
 Usually generated by graphic editor of computer programs
10
5
Example of
graphics (FIG file)
0
-5
-10
4
2
4
2
0
0
-2
-2
-4
7
-4
Transmisión de Datos Multimedia - Master IC 2007/2008
Images
 2D matrix consisting of pixels
 Pixel—smallest element of resolution of the image
 One pixel is represented by a number of bits
 Pixel depth– the number of bits available to code the pixel
 Have no structural information
 Two categories: scanned vs. synthesized still image
Digital still image
Camera
8
Computer
software
Synthesized
image
Capture and
A/D conversion
Scanned
image
Transmisión de Datos Multimedia - Master IC 2007/2008
9
Images (cont.)
 Examples of images
 Binary image – pixel depth 1
 Gray-scale – pixel depth 8
 Color image – pixel depth 24
Gray-scale
colorimage
image
Binary image
Transmisión de Datos Multimedia - Master IC 2007/2008
1
0
Video vs. Animation
 Both images and graphics can be displayed as a succession of view
which create an impression of movement
 Video – moving images or moving pictures




Captured or Synthesized
Consists of a series of bitmap images
Each image is called a frame
Frame rate: the speed to playback the video (frame per second)
 Animation – moving graphics
 Generated by computer program (animation authoring tools)
 Consists of a set of objects
 The movements of the objects are calculated and the view is updated
at playback
Transmisión de Datos Multimedia - Master IC 2007/2008
Sound
 1-D time-based signal
0. 2
0. 15
0. 1
0. 05
0
-0. 05
-0. 1
-0. 15
-0. 2
0
100
200
300
400
500
600
700
800
900
1000
 Speech vs. non-speech sound
 Speech – supports spoken language and has a semantic content
 Non-speech – does not convey semantics in general
 Natural vs. structured sound
 Natural sound – Recorded/generated sound wave represented as
digital signal
 Example: Audio in CD, WAV files
 Structured sound – Synthesize sound in a symbolic way
 Example: MIDI file
1
1
Transmisión de Datos Multimedia - Master IC 2007/2008
Networked Multimedia
 Local vs. networked multimedia
 Local: storage and presentation of multimedia information in
standalone computers
 Sample applications: DVD
 Networked: involve transmission and distribution of multimedia
information on the network
 Sample applications: videoconferencing, web video broadcasting,
multimedia Email, etc.
A scenario of multimedia networking
Video server
1
2
Internet
Image server
Transmisión de Datos Multimedia - Master IC 2007/2008
1
3
Consideration of Networked Multimedia
 Requirements of multimedia applications on the network
 Typically delay sensitive
 end-to-end delay
 delay jitter:
– Jitter is the variability of packet delays within the same packet stream
 Quality requirement




Satisfactory quality of media presentation
Synchronization requirement
Continuous requirement (no jerky video/audio)
Can tolerant some degree of information loss
Transmisión de Datos Multimedia - Master IC 2007/2008
Technologies of Multimedia Networking
 Challenges of multimedia networking
1. Conflict between media size and bandwidth limit of the network
2. Conflict between the user requirement of multimedia application and
the best-effort network
3. How to meet different requirements of different users?
 Media compression – reduce the data volume
Address the 1st challenge
 Image compression
 Video compression
 Audio compression
 Multimedia transmission technology
Address the 2nd and 3rd challenges
 Protocols for real-time transmission
 Rate / congestion control
 Error control
1
4
Transmisión de Datos Multimedia - Master IC 2007/2008
Multimedia Networking Systems
 Live media transmission system
 Capture, compress, and transmit the media on the fly (example?)
 Send stored media across the network
 Media is pre-compressed and stored at the server. This system delivers
the stored media to one or multiple receivers. (example?)
 Differences between the two systems
 For live media delivery:
 Real-time media capture, need hardware support
 Real-time compression– speed is important
 Compression procedure can be adjusted based on network conditions
 For stored media delivery
 Offline compression – better compression result is important
 Compression can not be adjusted during transmission
1
5
Transmisión de Datos Multimedia - Master IC 2007/2008
1
6
Classes of multimedia applications
 Streaming stored audio and video
 Streaming live audio and video
 Real-time interactive audio and video
Transmisión de Datos Multimedia - Master IC 2007/2008
Streaming Stored Multimedia:
What is it?
t>0
100%
1. video
recorded
2. video
sent
network
delay
3. video received,
played out at client
streaming: at this time, client
playing out early part of video,
while server still sending later
part of video
1
7
time
Transmisión de Datos Multimedia - Master IC 2007/2008
1
8
Streaming vs. Download of Stored Multimedia Content
 Download: Receive entire content
before playback begins
 High “start-up” delay as media file
can be large
 ~ 4GB for a 2 hour MPEG II movie
 Streaming: Play the media file while it is
being received
 Reasonable “start-up” delays
 Reception Rate >= playback rate.
Why?
Transmisión de Datos Multimedia - Master IC 2007/2008
Streaming Stored Multimedia: Interactivity
VCR-like functionality: client can pause,
rewind, FF, push slider bar
• 10 sec initial delay OK
• 1-2 sec until command effect OK
• RTSP often used (more later)
timing constraint for still-to-be transmitted
data: in time for playout
1
9
constant bit
rate video
transmission
variable
network
delay
client video
reception
constant bit
rate video
playout at client
buffered
video
Transmisión de Datos Multimedia - Master IC 2007/2008
Streaming Multimedia: Client Buffering
client playout
delay
 Client-side buffering, playout delay compensate for networkadded delay, delay jitter
2
0
time
Transmisión de Datos Multimedia - Master IC 2007/2008
Streaming Multimedia: Client Buffering
 Client-side buffering, playout delay compensate for network-added
delay, delay jitter
constant
drain
rate, d
variable fill
rate, x(t)
buffered
video
2
1
Transmisión de Datos Multimedia - Master IC 2007/2008
2
2
Interactive, Real-Time Multimedia
applications: IP telephony, video conference, distributed interactive
worlds
 end-end delay requirements:
 audio: < 150 msec good, < 400 msec OK
 includes application-level (packetization) and network delays
 higher delays noticeable, impair interactivity
 session initialization
 how does callee advertise its IP address, port number, encoding
algorithms?
Transmisión de Datos Multimedia - Master IC 2007/2008
Internet multimedia: simplest approach
 audio or video stored in file
 files transferred as HTTP object
 received in entirety at client
 then passed to player
audio, video not streamed:
 no, “pipelining,” long delays until playout!
2
3
Transmisión de Datos Multimedia - Master IC 2007/2008
Progressive Download




2
4
browser GETs metafile
browser launches player, passing metafile
player contacts server
server downloads audio/video to player
Transmisión de Datos Multimedia - Master IC 2007/2008
Streaming from a streaming server
 This architecture allows for non-HTTP protocol between server and media player
 Can also use UDP instead of TCP.
2
5
Transmisión de Datos Multimedia - Master IC 2007/2008
2
6
Multimedia Over Today’s Internet
 TCP/UDP/IP: “best-effort service”
 no guarantees on delay, loss
 But multimedia apps requires QoS and level of performance to be
effective!
 Today’s Internet multimedia applications use application-level
techniques to mitigate (as best possible) effects of delay, loss
Transmisión de Datos Multimedia - Master IC 2007/2008
2
7
Streaming Multimedia: UDP or TCP?
UDP
 server sends at rate appropriate for client (oblivious to network
congestion!)
 often send rate = encoding rate = constant rate
 then, fill rate = constant rate - packet loss
 short playout delay (2-5 seconds) to compensate for network delay
jitter
 error recover: time permitting
TCP
 send at maximum possible rate under TCP
 fill rate fluctuates due to TCP congestion control
 larger playout delay: smooth TCP delivery rate
 HTTP/TCP passes more easily through firewalls
Transmisión de Datos Multimedia - Master IC 2007/2008
Multimedia, Quality of Service: What is it?
Multimedia applications:
network audio and video
(“continuous media”)
QoS
network provides
application with level of
performance needed for
application to function.
2
8
Transmisión de Datos Multimedia - Master IC 2007/2008
2
9
Improving QOS in IP Networks
 Thus far: “making the best of best effort”
 Future: next generation Internet with QoS guarantees
 RSVP: signaling for resource reservations
 Differentiated Services: differential guarantees
 Integrated Services: firm guarantees
 simple model for sharing and congestion studies:
Transmisión de Datos Multimedia - Master IC 2007/2008
3
0
Principles for QOS Guarantees
 Example: 1Mbps IPphone, FTP share 1.5 Mbps link.
 bursts of FTP can congest router, cause audio loss
 want to give priority to audio over FTP
Principle 1
packet marking needed for router to distinguish
between different classes; and new router policy
to treat packets accordingly
Transmisión de Datos Multimedia - Master IC 2007/2008
Principles for QOS Guarantees (more)
 what if applications misbehave (audio sends higher than declared
rate)
 policing: force source adherence to bandwidth allocations
 marking and policing at network edge:
 similar to ATM UNI (User Network Interface)
Principle 2
provide protection (isolation) for one class from
others
3
1
Transmisión de Datos Multimedia - Master IC 2007/2008
Principles for QOS Guarantees (more)
 Allocating fixed (non-sharable) bandwidth to flow: inefficient use of
bandwidth if flows doesn’t use its allocation
Principle 3
While providing isolation, it is desirable to use
resources as efficiently as possible
3
2
Transmisión de Datos Multimedia - Master IC 2007/2008
3
3
Principles for QOS Guarantees (more)
 Basic fact of life: can not support traffic demands beyond link
capacity
Principle 4
Call Admission: flow declares its needs, network
may block call (e.g., busy signal) if it cannot meet
needs
3
4
Transmisión de Datos Multimedia - Master IC 2007/2008
Summary of QoS Principles