PERFORMANCE COMPARISON OF HEVC AND
H.264 DECODER
SPRING 2014
ADVISOR: Dr. K.R.Rao
VASAVEE VIJAYARAGHAVAN
1001037366
vasavee.vijayaraghavan@mavs.uta.edu
TABLE OF CONTENTS
Acronyms And Abbreviations
Goal of the Project
Overview Of HEVC
Overview of H.264
Profiles Used For Comparison
Video Resolutions Used For Comparison
References
ACRONYMS AND ABBREVIATIONS
AMVP: Advanced motion vector prediction
AVC: Advanced Video Coding
BD-PSNR: Bjontegaard metric calculation
CB: Coding Block
CIF: Common Intermediate Format
CU: Coding Unit
CTB: Coding Tree Block
CTU: Coding Tree Unit
DCT: Discrete Cosine Transforms
ACRONYMS AND
ABBREVIATIONS(contd..)
 DST: Discrete Sine Transform
 HEVC: High Efficiency Video Coding
 JCT-VC: Joint Collaborative Team on Video Coding
 MC: Motion Compensation
 ME: Motion Estimation
 MPEG: Moving Picture Experts Group
 MV: Motion Vector
 QP: Quantization Parameter
 QCIF: Quarter Common Intermediate Format
 PSNR: Peak Signal To Noise Ratio
 PU: Prediction Unit
ACRONYMS AND
ABBREVIATIONS(contd..)
 RD: Rate Distortion
 SAO: Sample Adaptive Offset
 SAD: Sum of Absolute Differences
 SATD: Sum of Absolute Transformed Differences (SATD)
 SHVC: Scalable HEVC
 SSIM: Structural Similarity
 SVC: Scalable Video Coding
 TU: Transform Unit
 URQ: Uniform Reconstruction Quantization
 VCEG: Video Coding Experts Group
OBJECTIVE
The goal of this project is to compare the
performance of the HEVC and H.264 decoders
in various profiles, using different sequences
and in different resolutions.
ABOUT HIGH EFFICIENCY
VIDEO CODING (HEVC) [43]
HEVC is the latest video coding standard
jointly presented by ITU-T Video Coding
Experts Group and the ISO/IEC Moving
Picture Experts Group.
The main advantage of HEVC is that it reduces
the bit rate by 50% compared to the existing
video coding standards at the same time giving
equal perceptual quality.
HEVC ENCODER BLOCK
DIAGRAM (with decoder elements
shaded in grey) [43]
MACRO BLOCKS IN HEVC [57]
ABOUT H.264
H.264 ENCODER AND DECODER
BLOCK DIAGRAM [23,24]
How does an H.264 codec work ?
An H.264 video encoder carries out
prediction, transform and encoding processes
to produce a compressed H.264 bitstream. An
H.264 video decoder carries out the
complementary processes of decoding,
inverse transform and reconstruction to
produce a decoded video sequence.
INTRA PREDICTION IN H.264 [23]
INTER PREDICTION IN H.264 [23]
PROFILES USED FOR COMPARISON
The profiles that will be used for comparison
in HEVC will be all-intra, main and main 10.
The profiles that will be used for H.264 will be
high and high 10.
VIDEO RESOLUTIONS USED FOR
COMPARISON
SOME ADDITIONAL INFORMATION
• HEVC decoders, that consume low power,
have been implemented on hand held devices
by few companies. [58]
• When the same HEVC decoder implemented
in HM, is made of low power decoder by
modifying few components, then it can be
used as low power decoder for handheld and
mobile devices. [59]
REFERENCES
[1] Joint Collaborative Team On Video Coding Information websitehttp://www.itu.int/en/ITU-T/studygroups/2013-2016/16/Pages/video/jctvc.aspx
[2] H.261: Video Codec for Audiovisual Services at px64 kbit/s,”
http://www.itu.int/rec/T-REC-H.261-199303-I/en”
[3] H.263: Video Coding for Low Bit Rate Communication, “http://www.itu.int/rec/TREC-H.263/en”
[4] Coding of Moving Pictures and Associated Audio for Digital Storage Media at up to
About 1.5 Mbit/shttp://www.digitalpreservation.gov/formats/fdd/fdd000035.shtml
[5] Coding of Audio-Visual Objects—Part 2:
http://www.digitalpreservation.gov/formats/fdd/fdd000155.shtml
[6] Generic Coding of Moving Pictures and Associated Audio Information— Part 2:
Video- http://www.itu.int/rec/T-REC-H.222.0, ITU-T Rec. H.262 and ISO/IEC 138182 (MPEG 2 Video), ITU-T and ISO/IEC JTC 1, Nov. 1994.
REFERENCES
[7] J. Ostermann et al, ” Video coding with H.264/AVC: tools, performance, and
complexity”, IEEE Transactions on CSVT, Vol. 14, no.1, pp. 7-28, Aug. 2004
[8] H. Samet, “The quadtree and related hierarchical data structures,” Comput. Survey,
vol. 16, no. 2, pp. 187–260, Jun. 1984.
[9] G. J. Sullivan et al, “Overview of the High Efficiency Video Coding (HEVC) Standard”,
IEEE Trans. Circuits and Systems for Video Technology, Vol. 22, No. 12, pp. 16491668, Dec. 2012.
[10] K. Shah, “Time Optimization of HEVC Encoder over X86 Processors using SIMD”,
Thesis proposal, http://wwwee.uta.edu/Dip/Courses/EE5359/Projects/Spring2013/Kushal_Shah/Kushal_Shah_
Proposal.pdf
[11] F. Pescador et al, “On an Implementation of HEVC Video Decoders with DSP
Technology”, IEEE ICCE, pp. 121-122, Las Vegas, NV, Jan 2013.
[12] CODE: Sequoia Website on HEVC
http://codesequoia.wordpress.com/2012/10/28/hevc-ctu-cu-ctb-cb-pb-and-tb/
REFERENCES
[13] O. L. Meur, “ Video Compression Beyond H.264”,
http://people.irisa.fr/Olivier.Le_Meur/teaching/HEVC_CAV_ESIR3_2
011_2012.pdf , November 7 2011.
[14] Multi-Frame Motion Compensated Prediction from Fraunhofer
website- http://www.hhi.fraunhofer.de/fields-ofcompetence/image-processing/research-groups/image-videocoding/h264mpeg4-avc/multi-frame-motion-compensatedprediction.html
[15] C. Fogg, “Suggested figures for the HEVC specification”, ITU-T /
ISO-IEC Document: JCTVC J0292r1, July 2012.
[16] H.Zhang et al, “Fast Intra-Prediction Mode Selection for H.264”:
http://mathcs.slu.edu/~fritts/pres/spie05_IVC_h264_fast_mode_se
l_pres.pdf
REFERENCES
[17] G. Bjontegaard, “Calculation of Average PSNR Differences
between RD Curves”, document VCEG-M33, ITU-T SG 16/Q 6,
Austin, TX, Apr. 2001.
[18] F. Bossen, “Common test conditions and software reference
configurations”, Technical report, JCT-VC, 2012.
[19] Multimedia Processing course website. http://wwwee.uta.edu/Dip/Courses/EE5359/
[20] Texas Instruments Product file.
http://downloadt.advantech.com/ProductFile/PIS/DSPC8681/Product%20-%20Datasheet/DSPC8681_DS20121018134716.pdf
[21] Video sequences- http://basakoztas.net
[22] Multimedia Communications with SVC, HEVC, and SHVChttp://r2d2n3po.tistory.com/50
REFERENCES
[23] H.264 White Paper by Iain Richardson:
http://www.vcodex.com/images/uploaded/469323879727520.pdf
[24] T. Wiegand et al, “Overview of the H.264/AVC Video Coding Standard”, IEEE
Transactions on Circuits and Systems for Video Technology, Vol. 13, No. 7, pp. 560576, Jul. 2003.
[25] H.264 tutorial by I.E.G. Richardson:
https://www.vcodex.com/h264.html
[26] J. R. Ohm et al, “Comparison of the Coding Efficiency of Video Coding Standards—
Including High Efficiency Video Coding (HEVC)”, IEEE Transactions on Circuits and
Systems for Video Technology, Vol. 22, No. 12, pp. 1669-1684, Dec. 2012.
[27] A. Puri et al, “Video coding using the H.264/MPEG-4 AVC compression standard”,
Signal Processing: Image Communication, vol. 19, pp. 793-849, Oct. 2004.
[28] Eurasip Journal- http://jes.eurasipjournals.com/content/2013/1/15
[29] Vcodex- http://www.vcodex.com/h265.html
[30] HEVC Fraunhofer site containing all the information on HEVC- http://hevc.info/
REFERENCES
[31] Access the website http://www-ee.uta.edu/Dip/Courses/EE5359/ and refer to the project by S.
Kulkarni on “Transcoding from H.264/AVC to High Efficiency Video Coding (HEVC)”, University of
Texas, Arlington, Spring 2013.
[32] Access to HM 13.0 Reference Software: http://hevc.hhi.fraunhofer.de/
[33] HEVC download link- https://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/branches/HM-9.2dev/doc/software-manual.pdf
[34] Visual studio download for students for free- www.dreamspark.com
[35] Tortoise SVN download- http://tortoisesvn.net/downloads.html
[36]MPL Websitehttp://www-ee.uta.edu/Dip/Courses/EE5359/index.html
[37] Video Sequence Download Link- http://media.xiph.org/video/derf/
[38] K .R .Rao and J .J .Hwang, “Techniques and standards for Image Audio and Video Coding” Prentice
Hall, 1996.
[39] R.C. Gonzalez and R.E.Woods, “Digital Image Processing” ,Pearson, Edition 3,2009
[40] Test Sequences: ftp://ftp.kw.bbc.co.uk/hevc/hm-11.0-anchors/bitstreams/
[41] T.Wiegand et al “Overview of the H.264/AVC Video Coding Standard,” IEEE Trans. CSVT, Vol. 13, pp.
560-576, July 2003.
REFERENCES
[42] M.A. Isnardi, ” Historical Overview of video compression in consumer
electronic devices”, IEEE ICCE, pp. 1-2, Las Vegas, NV, January2007.
[43] HEVC tutorial by I.E.G. Richardson: http://www.vcodex.com/h265.html
[44] K. Iguchi et al, “HEVC Encoder for Super Hi-Vision”, 2014 IEEE
International conference on Consumer Electronics (ICCE), pp. 61-62, 2014
[45] F. Pescador et al, “A DSP HEVC decoder implememtation based on Open
HEVC”, IEEE ICCE, pp. 65-66, 2014.
[46] G J. Sullivan et al,” Standardized Extensions of HEVC”, IEEE Journal of
Selected topics in Signal Processing, Vol.7, No.6, pp.1001-1016, December
2013.
[47] K.R. Rao, D.N. Kim and J.J. Hwang, “Video Coding Standards: AVS China,
H.264/MPEG-4 Part 10, HEVC, VP6, DIRAC and VC-1”, Springer, 2014.
REFERENCES
[48] F. Pescador et al, “ Complexity analysis of an HEVC Decoder based
on a Digital Signal Processor”, IEEE Transactions on Consumer
Electronics, Vol.59, No.2, pp. 391-399, May 2013.
[49] JCT-VC Video Subgroup, “HM9: High Efficiency Video Coding
(HEVC) Test Model 9 Encoder Description”, Shanghai, China,
October 2012.
[50] F. Bossen et al, “HEVC Complexity and Implementation Analysis”,
IEEE Transactions on CSVT, Vol.22, no. 12, pp. 1685 - 1696 , Dec.
2012.
[51] J.-R. Ohm et al , “Comparison of the Coding Efficiency of Video
Coding Standards—Including High Efficiency Video Coding (HEVC)”,
IEEE Transactions on Circuits and Systems for Video Technology, vol.
22, no. 12, pp. 1669-1684, December 2012.
REFERENCES
[52] N. Ahmed, T. Natarajan, and R.K.Rao, “Discrete Cosine
Transform”, IEEE Transactions on Computers, Vol.C-23,
pp.90-93, January 1974.
[53] S. Kwon, A. Tamhankar and K.R. Rao, ”Overview of H.264 /
MPEG-4 Part 10”, J. Visual Communication and Image
Representation, vol. 17, pp.186-216, April 2006.
[54] I. E. Richardson, “The H.264 Advanced Video
Compression Standard”, 2nd Edition, Wiley 2010.
[55] D. Marpe, T. Wiegand and G. J. Sullivan, “The
H.264/MPEG-4 AVC standard and its applications”, IEEE
Communications Magazine, vol. 44, pp. 134-143, Aug.
2006.
REFERENCES
[56] H.264/MPEG-4 AVC Reference Software Manual http://vc.cs.nthu.edu.tw/home/courses/CS553300/97/project/JM%
20Reference%20Software%20Manual%20(JVT-X072).pdf
[57] HM Software Manualhttps://hevc.hhi.fraunhofer.de/svn/svn_HEVCSoftware/branches/H
M-9.2-dev/doc/software-manual.pdf
[58] HEVC decoder for handheld devices implemented by Ace
Thought- http://www.acethought.com/index.php/products/hevcdecoder/
[59] Z. Ma and A. Segall, “Low Resolution Decoding For High-Efficiency
Video Coding”, IASTED SIP 2011, Dallas, TX, Dec. 2011.
[60] Link to access JCTVC Documents - http://www.itu.int/en/ITUT/studygroups/2013-2016/16/Pages/video/jctvc.aspx