Information Theory (EE 8371)
Fall 2000
August 25, 2000
Handout #2
J.D. Gibson, 331 Caruth Hall, gibson@seas.smu.edu
Reference Books
Author
Title
Description
Slepian
Key Papers in the Development
Of Information Theory
(IEEE Press)
A valuable collection
of original papers
for both historians and
researchers. Contains
Shannon’s papers.
Blahut
Principles and Practice
of Information Theory
Next most recent text.
McEliece
The Theory of Information
And Coding
Readable and to the
point. Empasizes
duality of channel
capacity and rate distortion.
Gallager
Information Theory and
Reliable Communication
A benchmark text and
an excellent research
reference.
Ash
Information Theory
Concise. Well written.
Csiszar,
Information Theory
An important research
reference from a unique
point of view. Develops
the method of types.
Abramson Information Theory
And Coding
Simple and intuitive
Good for the first part
of the course.
1
Author
Title
Berger
Rate Distortion Theory
Description
The mathematics of data
compression.
Berlekamp Algebraic Coding Theory
An important book in
coding theory and algebra.
Brillouin
Science and Information
The role of information theory
in physics. Maxwell’s Demon.
Fano
Transmission of Information
A precursor to Gallager
Forney
Information Theory
(Unpublished course notes)
A refreshing treatment.
Hamming
Coding and Information
Theory
Text based on
Abramson’s approach
Jelinek
Probabilistic Information
Theory
Some material not found
elsewhere.
Khinchin
Mathematical Foundations
of Information Theory
Translation of
Russian edition in 1957.
Kotel’nikov The Theory of Optimum
Noise Immunity
Russian translation of
one of the original
efforts in the area.
Reza
An Intoduction to
Information Theory
Intermediate level;
between Abramson
And Gallager
Shannon,
The Matimatical Theory
The book that started it all.
Weaver
of Communication
Still very intuitive and
interesting in Slepian’s
“Key Papers in the Development
of Information Theory.”
2
Author
Title
Description
Viterbi,
Omura
Principles of Digital
Communication and Coding
Wolfowitz Coding Theorems of
Information Theory
Thorough study of
information theory and
its relevance to
digital communication.
A mathematical treatment
of information theory. Concise.
Wozencraft, Principles of Communication
Jacobs
Engineering
A commonly used text
for communication theory
Yaglom,
Yaglom
Translation of the principal
Russian text on information
theory. Contains a chapter on
the entropy of language.
Information Theory
3