advertisement

Information Theory (EE 8371) Fall 2000 August 25, 2000 Handout #2 J.D. Gibson, 331 Caruth Hall, gibson@seas.smu.edu Reference Books Author Title Description Slepian Key Papers in the Development Of Information Theory (IEEE Press) A valuable collection of original papers for both historians and researchers. Contains Shannon’s papers. Blahut Principles and Practice of Information Theory Next most recent text. McEliece The Theory of Information And Coding Readable and to the point. Empasizes duality of channel capacity and rate distortion. Gallager Information Theory and Reliable Communication A benchmark text and an excellent research reference. Ash Information Theory Concise. Well written. Csiszar, Information Theory An important research reference from a unique point of view. Develops the method of types. Abramson Information Theory And Coding Simple and intuitive Good for the first part of the course. 1 Author Title Berger Rate Distortion Theory Description The mathematics of data compression. Berlekamp Algebraic Coding Theory An important book in coding theory and algebra. Brillouin Science and Information The role of information theory in physics. Maxwell’s Demon. Fano Transmission of Information A precursor to Gallager Forney Information Theory (Unpublished course notes) A refreshing treatment. Hamming Coding and Information Theory Text based on Abramson’s approach Jelinek Probabilistic Information Theory Some material not found elsewhere. Khinchin Mathematical Foundations of Information Theory Translation of Russian edition in 1957. Kotel’nikov The Theory of Optimum Noise Immunity Russian translation of one of the original efforts in the area. Reza An Intoduction to Information Theory Intermediate level; between Abramson And Gallager Shannon, The Matimatical Theory The book that started it all. Weaver of Communication Still very intuitive and interesting in Slepian’s “Key Papers in the Development of Information Theory.” 2 Author Title Description Viterbi, Omura Principles of Digital Communication and Coding Wolfowitz Coding Theorems of Information Theory Thorough study of information theory and its relevance to digital communication. A mathematical treatment of information theory. Concise. Wozencraft, Principles of Communication Jacobs Engineering A commonly used text for communication theory Yaglom, Yaglom Translation of the principal Russian text on information theory. Contains a chapter on the entropy of language. Information Theory 3