Year: 2023-2024
Fall Semester
Multimedia and Virtual
Reality
Dr. Mohamed Elaskily
Course Contents
➢ Introduction to Multimedia.
➢ Media Representation and Formats
• Digital Audio.
• Digital Image and Graphics.
• Digital Video.
➢ Multimedia Authoring.
➢ Image, Video, Audio Compression.
➢ Lossless Compression Algorithms.
➢ Lossy Compression Algorithms.
➢ Introduction to Virtual Reality (VR).
2
➢
Compression Examples.
Text Book
1. Ze Nian Li, Mark S Drew, and Jiangchuan Liu,
Fundamentals of Multimedia, Third edition,
2021.
2. Sreeparna
Banerjee,
Multimedia, 2019.
Elements
of
3. Stanislav Stanković, Virtual Reality and
Virtual Environments in 10 Lectures, 2016.
3
Lecture (1)
Introduction to Multimedia (Part 1)
4
Lecture Outlines
➢ About the Course.
➢ What is Multimedia?
➢ Multimedia System.
➢ Multimedia Revolution.
➢ Multimedia Applications.
5
About the Course
6
Grading
•
•
•
•
•
7
Attendance & Activities
Quiz (1)
Quiz (2)
Midterm Exam
Final Exam
10
10
10
20
50
What is Multimedia?
8
What is Multimedia?
Multimedia differ from era to era
Sounds
Radio, and
photographs
Alphabets
and drawing
Letters and
writing
Telephone, television,
and computers
News and
printings
Mobiles, digital audio
and video, 3D video
What is Multimedia?
Multimedia and Human Perception
• “How do humans perceive information”:
10
– We perceive information from what we see, what we hear, what
we touch and what we smell.
– Visual media:
• Text, graphics, images, video, etc.
– Auditory media:
• Music, sound and voice.
– We can input and output.
– Touch:
• Haptic sensors.
– Smell:
• Electronic noses. (sensors)
What is Multimedia?
• Derived from the word Multi and Media.
• Multi
– Many, Multiple, more than one.
• Media
– Different shapes used for information presentation
such as: text, graphic, images, audio (e.g. voice
and music), video, etc.
11
What is Multimedia?
• Applications that use multiple modalities of media,
including text, images,
drawings (graphics),
animation, video, sound
including speech to
perform interactivity.
GRAPHIC
TEXT
VIDEO
AUDIO
ANIMATION
What is Multimedia?
• Different areas used multimedia to contribute in
human culture such as:
•
•
•
•
•
•
•
•
13
Graphics,
Artificial intelligence,
Computer vision,
Data compression,
Visualization,
Human Computer Interaction (HCI),
Networking,
Database systems.
What is Multimedia?
What is Multimedia?
• Multimedia means that computer information can be
represented through audio, images, video, and animation
in addition to traditional media (text and graphics).
• Multimedia is the field concerned with the computercontrolled integration of text, graphics, drawings, and moving
images (Video), animation, audio, and any other
media
where every type of information can be represented, stored,
transmitted and processed digitally.
15
Multimedia Systems
16
Multimedia Systems
➢ Note that:
• Novelty of digital multimedia is that all media can be treated as data.
• All media can be represented digitally as a structured collection of bits:
– Manipulated, stored by programs and transmitted over networks, etc.
➢ Multimedia System: is a system capable of processing
multimedia data and applications.
➢ Multimedia
System:
is
characterized
by
the processing complexity, storage size, generation
methods, and manipulation of multimedia information.
17
Characteristics of Multimedia System
A Multimedia system has four basic characteristics:
❖ Multimedia systems must be computer controlled.
❖ The information they handle must be represented digitally.
❖ Multimedia systems are integrated.
❖ The interface to the final presentation of media is usually interactive.
18
Components of a Multimedia System
The Components (Hardware and Software) required for a
multimedia system:
❖ Capture devices: Camera, Microphone, Keyboards, graphics tablets,
3D input devices.
❖ Storage Devices: Hard disks, flash memory, CD-ROMs, DVD-ROM, etc.
❖ Communication Networks: Local Networks, Internet, special high
speed networks.
❖ Computer Systems: Multimedia Desktop machines, Workstations,
❖ Display Devices:CD-quality speakers, HDTV, SVGA, Hi-Res monitors,
Color printers etc.
Components of a Multimedia System
20
Components of a Multimedia System
Components of a Multimedia System
• The Components (Hardware and Software) required for a
multimedia system:
– Capture devices — Video Camera, Video Recorder, Audio
Microphone, Keyboards, mouse, graphics tablets, 3D
devices, tactile sensors, VR devices. Digitizing Hardware. input
– Storage Devices — Hard disks, CD-ROMs, DVD-ROM, etc.
– Communication Networks — Local Networks, Intranets,
Internet, Multimedia or other special high speed networks.
– Computer
Systems
—
Multimedia
Desktop
machines,
Workstations, MPEG/VIDEO/DSP Hardware.
– Display Devices — CD-quality speakers, HDTV, SVGA, High
Resolution monitors, Color printers ,etc.
22
Classification of Multimedia Systems
❖ Depending on the application, multimedia systems can be
classified in a variety of ways, such as interaction style, the number
of users, when the content is live, and so on.
▪ Static versus dynamic (interactive or not ?)
▪ Real time versus orchestrated. (Live or not ?)
▪ Linear versus nonlinear.
▪ Person-to-machine versus person-to-person
▪ Single user, peer-to-peer, peer-multi-peer, and broadcast.
Interactive Multimedia
• When a viewer of a multimedia presentation is allowed to control
what elements are delivered and when, it is interactive multimedia.
• HyperMedia: A combination of hypertext, graphics, audio, video,
(linked elements) and interactivity culminating in a complete, nonlinear computer-based experience.
24
Hypermedia vs. Hypertext
•
A hypertext system: read text
documents nonlinearly, by following
links that point to other parts of the
document, or to other documents.
(i.e. see the figure).
•
HyperMedia: not constrained to be
text-based, can include different
media, e.g. graphics, images and
especially the continuous media sound and video.
– The World Wide Web (WWW) - the
best example of a hypermedia
application.
Hypertext, non-linear structure
25
Hypermedia (Cont.)
• Multimedia Application: is an application which uses a
collection of multiple media sources e.g. text, graphics,
images, sound/audio, animation and/or video.
– Hypermedia can be considered as one of the multimedia
applications.
Multimedia
26
Hypermedia
Hypertext
Linearity vs. Non-Linearity
Linear Text
Hypertext/Hypermedia
29
Linearity vs. Non-Linearity
(Linear)
• A Multimedia Project is identified as Linear when:
– It is not interactive.
– Users have no control over the content that is being
showed to them.
• Examples:
– Film: fixed order of frames defines a single playback
sequence.
– Book: physical arrangement of text and pages implies
a linear reading order.
– A non-interactive lecture / demo show.
30
Linearity vs. Non-Linearity
(Non-Linear)
• A Multimedia Project is identified as Non-Linear when:
– It is interactive.
– Users have control over the content that is being showed to them.
– Users are given navigational control.
• Examples:
– Games.
– Courseware platforms.
– Hypermedia and hypertext: links between pages permit multiple
arbitrary reading orders.
– Flash: jumps between frames, controlled by interactivity, permits
branching and loops.
31
Multimedia Revolution
What is the main reasons of this revolution?
❖ Digitization of virtually any and every device.
❖ Digitization of libraries of information.
❖ Evolution of communication and data networks.
❖ New algorithms for compression which facilitates storing and transmissions.
❖ Better hardware performance.
❖ Smarter user interface paradigms to view/interact with multimedia information.
❖ Standardizations.
32
Multimedia Applications
❖ Hypermedia Courseware platforms
❖ Video Conferencing
❖ Video-on-demand
❖ Interactive TV
❖ Groupware
❖ Home Shopping
❖ Games
❖ Virtual Reality
❖ Digital video editing and production systems
❖ Video streaming
Dr. Mohamed Elaskily