Information theory Math 797MR
Meeting : W 12:20--2:15 LGRT 1334 and F 12:20--1:10 LGRT 1334
Instructor : Luc Rey-Bellet
Office : 1423 J LGRT
Phone : 545-6020
E-Mail : firstname.lastname@example.org
Office Hours : by appointment.
Syllabus: In this class we will discuss the basics concepts of Information Theory as well as several applications to
Probability, Statistics, Coding theory, Physics and others. The students will be split in several groups and each group will
be responsible for several two hours presentations during the semester.
The students are expected to work independently and will prepare several two hour long presentations on special topics.
Elements of Information Theory, by Thomas M. Cover and Joy A. Thomas. Wiley, 2nd edition 2006. A classical text on information theory.
Information theory, Inference, and Learning Algorithms by David J>C. Mac Kay. Cambridge University Press 2003.
Lots of interesting applications. The book is available for download here
Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach
by Kenneth P. Burnham and David R. Anderson. Springer 2003. Available electronically at UMass library.
Information Criteria and Statistical Modeling
by Sadanori Konishi and Genshiro Kitagawa. Springer 2008. Available electronically at UMass library.
Quantum Information: An Introduction by Masahito Hayashi. Springer 2006. Available electronically at UMass library.