International Telecommunication Union
JPEG 2000 Extensions
Frédéric Dufaux
Ecole Polytechnique Fédérale de Lausanne (EPFL)
Institut de Traitement des Signaux
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
ISO/IEC 15444 – JPEG 2000
ITU-T
o
o
o
o
o
o
o
o
o
o
o
o
dates
Part 1 - Core coding system
Part 2 - Extensions
Part 3 - Motion JPEG 2000
Part 4 - Conformance
Part 5 - Reference software
Part 6 - Compound image file format
Part 8 - JPSEC: Secure JPEG 2000
Part 9 - JPIP: Interactivity tools, APIs and protocols
Part 10 - JP3D: Extensions for 3D data
Part 11 - JPWL: Wireless
Part 12 - ISO Base Media File Format
Part 13 – An entry level JPEG 2000 encoder
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
2
Work Plan
CFP
ITU-T
WD
CD
FCD
FDIS
IS
JPSEC 02/03 02/10 04/04 04/11 05/07 05/11
JPIP
02/03 02/07 03/03 03/07 04/04 04/10
JP3D 02/03 02/10 05/07 05/11 06/03 06/07
JPWL 02/07 03/07 04/07 05/03 05/07 05/11
dates
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
3
JPSEC: Secure JPEG 2000
ITU-T
Services addressed:
o
Confidentiality
•
o
Integrity verification
•
•
o
dates
Restrict access to image data or parts of it
Secure scalable streaming and transcoding
•
o
Identity of the party which generated the content
Conditional access
•
o
Image data integrity: bit exact verification
Image content integrity: perceptual meaning verification
Source authentication
•
o
Encryption or ciphering to conceals original content
Streaming and transcoding without unprotecting the content
…
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
4
JPSEC Framework
ITU-T
Open and flexible framework
JPSEC protector
JPSEC
Protection
Tools
JPSEC
codestream
JPSEC
Syntax
Writer
JPSEC unprotector
JPSEC
Syntax
Parser
Proprietary
Tool ID
Security Services:
• Confidentiality
• Integrity Verification
• Source Authentication
• …
dates
JPSEC
Unprotection
Tools
JPSEC
Registration
Authority
Tool
Description
JPSEC Tools:
• Encryption (AES, DES, …)
• Digital Signature (RSA, …)
• Message Auth. Code
• Watermarking
• Proprietary Tools
• …
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
5
JPSEC Framework
ITU-T
Creation and consumption of JPSEC content
Case 1
Image
JPSEC
Encoder &
Protector
JPSEC
codestream
JPSEC
Unprotector
& Decoder
Image
Case 2
JPEG-2000
codestream
Image
JPSEC
codestream
JPEG-2000
codestream
JPEG-2000
Encoder
JPSEC
Protector
JPSEC
Unprotector
JPEG-2000
Decoder
JPEG-2000
or JPSEC
codestream
JPSEC
Protector 1
JPSEC
Unprotector 1
JPEG-2000
or JPSEC
codestream
Image
Case 3
JPSEC’
JPSEC’
JPSEC
Protector 2
JPSEC”
JPSEC*
JPSEC
Protector 3
dates
JPSEC
Unprotector 2
JPSEC”
JPSEC
Unprotector 3
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
6
JPSEC ROI-Scrambling
o
ITU-T
o
o
o
o
o
Add pseudo-random noise
Performed in the wavelet
domain
Based on ROI mechanisms in
JPEG 2000
Efficient for arbitrary-shape
regions
Adjust distortion from
fuzziness to noise
Application
•
dates
Video surveillance
preserving privacy
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
7
JPIP: Interactivity tools,
APIs and Protocols
ITU-T
o
o
Tools for supporting image and metadata
delivery in a networked environment
Exploit JPEG 2000 properties
•
•
•
dates
Random access
Codestream reordering
Incremental decoding
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
8
JPIP: Interactivity tools,
APIs and Protocols
ITU-T
Protocol overview
Client
Server
Display
Image
Multiple Client Requests
Metatdata
Metatdata
Server Capabilities
Client Capabilites
JPP- or JPT-streams
Data Limits
Multiple Server Responses
Cache Model*
Cache
HTTP, TCP, UDP
*Only if State is present
Protocol stack
JPIP
HTTP
TCP
UDP
IP
dates
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
9
JP3D: Extensions for 3D Data
ITU-T
o
o
o
Extension of JPEG 2000 parts 1 and 2
Compress samples along all three dimensions
Targets applications:
•
•
•
•
dates
Medical Imaging (MRI, CAT, PET scans)
Scientific Modeling and Simulation
Remote Sensing (hyperspectral imagery,
geophysical/astrophysical measurements)
…
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
10
JP3D: Extensions for 3D Data
ITU-T
o
Extends standard JPEG 2000 technology from
two to three dimensions
•
•
•
o
New technologies
•
•
•
dates
Wavelet transform
Quantization
Coefficient bit modeling
3D context probability models for entropy
coding
Variable resolution sampling grids
Coding of floating point data
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
11
JPWL: Wireless
ITU-T
o
Multimedia wireless applications are becoming ubiquitous
•
•
o
JPEG 2000 is well-suited for wireless applications
•
•
o
Sales of camera-equipped cell phones exceed those of
standalone digital cameras
Importance of efficient and robust wireless imaging solutions
High coding efficiency → good visual quality
Seamless scalability → quality of service and pricing strategies
JPEG 2000 Wireless (JPWL)
•
•
Efficient transmission over error-prone networks
Normative and information tools for error protection and
correction
•
•
•
•
•
dates
Forward Error Correcting (FEC) codes
Header protection
Unequal Error Protection (UEP)
Data partitioning and interleaving
Robust arithmetic coding
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
12
JPWL: Wireless
dates
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
…
…
Packet
…
Layer n
low importance
Packet
Layer 2
medium importance
Packet
…
Packet
Packet
Packet
Tile-part
Header
Main
Header
Layer 1
Headers
critical importance high importance
Packet
o
Headers are most important part of code stream
•
FEC for strong protection of Main and Tile-part headers
•
Add redundancy bits while keeping backward
compatibility
Progressive quality transmission
•
Layered code stream: each layer contributes to improve
quality
•
UEP: decreasing protection as layer importance decreases
Packet
o
Packet
ITU-T
13
JPWL Unequal Error Protection
JPEG 2000
ITU-T
384 kb/s, CIF, 15 f/s, 3 quality layers
BER=10-3 (WCDMA error patterns)
sequence
PSNR
JPEG 2000
PSNR
JPWL
City
24.98
26.65
Crew
28.09
30.43
Foreman
25.73
28.07
Harbor
21.19
22.60
Mobile
17.71
18.63
Soccer
27.35
29.80
average
24.18
26.03
JPWL
dates
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
14
Motion JPEG 2000 vs MPEG-4
ITU-T
dates
Motion
JPEG 2000
MPEG-4
Coding
Intra-frame
Wavelet
MC DCT
Artifacts
Blur
Ringing
Block
Ringing
Error
resilience
High
Low
Encoder
complexity
Low
High
Rate control
Accurate
Inaccurate
Coding
Delay
Low
High
Scalability
Efficient
Inefficient
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
15
Motion JPEG 2000 vs MPEG-4
ITU-T
dates
128 kb/s, QCIF, 6 f/s
BER=10-4 (WCDMA error patterns)
PSNR
Motion
JPEG2000
PSNR
MPEG-4
IPP..IPP
Balloons
27.41
26.44
New York
35.06
34.25
Mobile
22.87
24.67
Animals
33.63
33.36
Letters
26.90
25.34
Waterfall
29.62
31.29
Football
32.48
30.21
Suzie
38.25
36.82
Tempest
26.69
27.75
average
30.32
30.01
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
JPEG 2000
MPEG-4
16
The End !
ITU-T
o
dates
Questions?
ITU-T VICA Workshop
22-23 July 2005 - ITU Headquarter - Geneva
17