Joint Technical Symposium - 2010
High Definition in the Archive Domain
May 5, 2010
01
Introduction – HDTV some key points
A quick comparison HD/SD
Offer better and more attractive
programmes to the viewer. It is done
through:
A better picture resolution allowing a new
viewing distance (3H versus 6H)
A better sound quality : 5.1 versus mono or
stereo
A 16/9 aspect ratio wide screen versus 4/3
More scanning modes: Progressive or
interleaved versus interleaved.
SD
HD
Image
definition
720 pixels per line
576 Active lines
( from 200 000
to 400 000 pixels)
1280 or 1920
pixels per line
720 or 1080
active lines
( from 900 000
to 2 000 000 pixels)
Audio
Mono or Stereo
Sound 5.1
Digital Dolby
6 tracks
Aspect ratio
4/3 or 16/9
16/9
Interleaved ( i)
Interleaved
(i)
Scanning
50 or 60 Hz
Progressive (p)
Progressive
Segmented
Frame (PSF)
50 , 60 ,24 Hz
HD in the Archive Domain
| May 5, 2010
3
HDTV formats
International formats and standards are well defined and adopted but they are
numerous:
Formats are described by:
Number
of active pixels
per line
Number
of active lines
per frame
1920
1440
1280
Frame rates
Scanning
mode
Picture
aspect ratio
1080
60
interleaved
16/9
720
59,94
progressive
30
psf
29,97
25
24
23,98
HD in the Archive Domain
| May 5, 2010
4
HDTV formats and standards
Most popular formats are:
1920x1080i
1280x720p
at
50i,60i,25p,25 psf,30p,30 psf,50p and 60 p) and (24 p and 24 psf)
Going from one format to another requires cross conversion.
Calculation of
pixels
and lines
Frame rate
conversion
Interleave or
de-interleave
HD in the Archive Domain
| May 5, 2010
5
But there are as many practices as televisions….
There is a great variety of formats and compressions used in production
postproduction and broadcast.
The production standard for TV programs is not necessarily the same as the
broadcast standard
Though “labelled HD”, The “real quality” may vary in a wide range.
HD in the Archive Domain
| May 5, 2010
6
A wide range of shooting solutions and quality
HD shooting
Low end solutions
Broadcast solutions
High quality capture
HDV
MPEG2 25Mb/s
long GOP 6 or 12
Sony’s HDXDCAM
MPEG2 422 up to 50Mb/s
on 50GBoptical disk
HDCAM SR
up to 880Mb/s in high speed mode
on tape
AVCHD
H264 21Mb/s
long GOP
Panasonic’s DVCPRO HD
AVC intra up to 100Mb/s
on 64 GB P2 cards
Sony’s’ XDCAM EX
MPEG2 up to 35 Mb/s
on 32 GB SxS cards
Grass Valley Infinity
JPEG2000 up to 100 Mb/s
on Hard drive
HD in the Archive Domain
| May 5, 2010
7
Main used compression types
HD compressions
MPEG2
HD
DV
HD
DVC pro HD
H264
HD
MJPEG
JPEG2000
DNx
(AVID)
Pro res
(Apple)
HD in the Archive Domain
| May 5, 2010
8
Most used compression schemes
Shooting
MPEG2 HD
long GOP
MPEG2 HD
short GOP
DV HD
AVC long GOP
AVC intra
Post Production
Base band 1,5GB/s
MPEG2 HD :
up to 300Mb/s
DV HD up to 100Mb/s
Proprietary formats:
Pro Res (Apple)
DNx (Avid)
Others...
Play out
Broadcast
Archiving
MPEG2 HD
20 to 80Mb/s
MPEG2 HD
15 to 20Mb/s
H264
8 to 16Mb/s
?
HD in the Archive Domain
| May 5, 2010
9
02
The Challenges
The challenges
More and more televisions are producing and broadcasting HDTV.
The ratio of SD programmes versus HD programmes is decreasing rapidly
Archivists must face and manage 2 new challenges:
How to collect,
store and make
accessible these
new HD digital programmes?
and
How could SD archives
be re-used in
a HD environment?
HD in the Archive Domain
| May 5, 2010
11
Archiving HD
?
Standard definition video
(uncompressed)
High definition video
(uncompressed)
720 pixels 576 lines
1980 pixels 1080 lines
1- hour programme file size :
72 GB
1- hour programme file size :
from 374 GB to 673 GB*
according to frame rates
To archive HD, Compression
“could” be required.
?
?
?
?
HD in the Archive Domain
| May 5, 2010
12
Using SD in HD programs
Sometimes, archivists have already digitised their original analogue archives in
SD.
Questions …
How could these SD preservation masters be used and match the quality
requirements of HDTV?
When will we need to reuse original media?
What kind of process do we need,to try to match HD quality requirements?
HD in the Archive Domain
| May 5, 2010
13
Using SD in HD programs : video and film archives...
SD video
program
Up
conversion
SD
telecine
Film programs
16/S16/35 mm
HD
telecine
HD program
Up
conversion
?
HD program
HD in the Archive Domain
| May 5, 2010
14
Using SD in HD programs : About up conversion...
The quality of the HD output depends very much on the quality of up conversion.
The main functions that an up converter must achieve, are:
Calculation of missing pixels and lines
Frame rate conversion
Resizing
Interleaving or de-interleaving
Frame rate conversion (cross conversion) could also degrade the picture.
HD in the Archive Domain
| May 5, 2010
15
Using SD in HD programs : About resizing...
There are several possibilities to show 4/3 pictures
in 16/9 programs
4 :3
1 6 :9
S id e P a n e l
4 :3
1 6 :9
?
4 :3
T o p / B o tto m C ro p
1 6 :9
Zoom,and stretching
S tre tc h in g
HD in the Archive Domain
| May 5, 2010
16
03
Current practices
The questionnaire
In 2009 a short questionnaire about HDTV current practices has been sent to
FIAT/IFTA members.
This questionnaire has 4 chapters:
1-General information and current situation about HD of the company or television.
2-Technical information about formats and standards used in the company for :
>
>
>
>
shooting
production and post production
Mastering
broadcasting
3-HD programs archiving
> Volumes, media ,storage
> expected evolutions or plans in the company about HD archiving?
4-Use of SD archives in HD programs.
HD in the Archive Domain
| May 5, 2010
18
The questionnaire
12 companies have answered to the questionnaire:
>
>
>
>
>
>
>
>
>
>
>
>
Sound and Vision National Dutch Broadcast archives for Public Broadcast
ORF Austrian Broadcasting Corporation
SBS Korea
TFO French educational channel Toronto (Canada)
Televisio de Catalunya TVC (Spain)
CBS News
TSR Télévision Suisse Romande
SVT
CBC radio Canada
NBC news /NBC universal
NHK
CCTV
HD in the Archive Domain
| May 5, 2010
19
Production: from shooting to broadcasting
It seems that shooting full HD is predominant
Almost all televisions use all formats and
shooting solutions :
Most used media are HDCAM HDXDCAM and
DVCPro HD
For postproduction, most of the companies use
AVID DNx file format either 120 or 185.
For mastering HDCAM/HDCAM SR is preferred
MPEG2 broadcasting is still far ahead
compared to H264.
shooting
Format
1920x 1980
1280x 720p
1440x1080
other
6
2
1
3
HDCAM/HDCAM SR
HDXDCAM
DVCpro P2
DNX HD
D5
ohter
5
3
3
1
1
1
Production
HDCAM HDCAM SR
HDXDCAM
DnX HD
Pro res
DVCpro HD
2
3
4
1
2
Mastering
HDCAM/HDCAM SR
XDCAM HD
D10?
D5
DVCpro HD
5
3
1
1
2
Broadcasting
MPEG2
H264
HD in the Archive Domain
10
2
| May 5, 2010
20
Archiving
Most companies archive original format on the
shelves, but most of them intend to go file
MPEG2 HD seems to be the file format in use
(or most expected)
H264 HD seems too young to be considered as a
file format for archives
JPEG2000 that is standardised for digital
cinema, is not well known and considered in
televisions.
Current archiving
On the shelves
archiving as files
8
2
intend to archive as
files
Yes
not yet chosen
7
3
files
MPEG2 and XDCAM
DVCPro HD
JPEG2000
DNx
4
2
1 on film only
1
HD in the Archive Domain
| May 5, 2010
21
4/3 use policy
Generally televisions perform up conversion
indoor while independent archivists prefer to
let end users to achieve the transformation.
The use of pillar box presentation has the
preference of the televisions and archivists.
When the choice is made by the end user, any
kind of transform may happen….
up conversion
indoor
end user
9
2
resize
Pilar box
top bottom crop
stretch/zoom
choice by end user
6 no resize
3
0
3
HD in the Archive Domain
| May 5, 2010
22
04
Our projects …..
From our archives (SD) …..
We have now 450 000 hours of digitalized videos, mainly on the MPEG2 (8
Mb/s) format.
Fortunatly we went through a phase of dubbing on numeric Betacam, and we
store hundreds thousands of numeric tapes.
The goal is to transfert the tape on files :
To enable an easy use of archives
To enable an easy use of upscaling and restoration for video and film
(… with some new HD transfert for the 35 mm film)
But we want to forget the tape without regrets …
HD in the Archive Domain
| May 5, 2010
24
From our archives (SD) ….. A new format
We want a new format
With complete specifications and documentation
Without impact of Patents (preferably) We store the national heritage!
With a very hight quality
IntraFrame, 4:2:2, 10 bits, 8 audio channels etc
From 50 Mb/s to 100 Mb/s or more
This year we build a model to help us make the choice between :
Several competitors AVC-Intra, D10, DPX and … JPEG2000
For our SD archives and for the new incoming HD programs.
HD in the Archive Domain
| May 5, 2010
25
Model ...
DV, MPEG HD, H264, DNx
Clipping
SDI
HDCAM
HDCAM SR
SDI
Betacam
Numeric Beta
Encoding in
« NewFormat »
wrapping in MXF
Encoding in
« NewFormat »
wrapping in MXF
Files
Public TV
Transcoding
Upscaling
Restitution
SDI/HDSDI
STORAGE
xN
Tape Library
Scalar 10K
LTO 5
Clipping
Transcoding
Upscaling
Restitution
FTP
xN
HSM
Encoding or
Transcoding
in « NewFormat »
wrapping in MXF
On demand !
Transcoding
H264
Proxy
Serveur
NAS
SAN
HD in the Archive Domain
| May 5, 2010
26
Thank you for your attention
pgerrier@ina.fr
HD in the Archive Domain
| May 5, 2010
27