Information theory Math 797MR

Meeting : W 12:20--2:15    LGRT 1334 and F 12:20--1:10    LGRT 1334

Instructor : Luc Rey-Bellet

 Office :   1423 J LGRT
 Phone :  545-6020
 E-Mail :  luc@math.umass.edu
 Office Hours :   by appointment.

Syllabus: In this class we will discuss the basics concepts of Information Theory as well as several applications to Probability, Statistics, Coding theory, Physics and others. The students will be split in several groups and each group will be responsible for several two hours presentations during the semester. The students are expected to work independently and will prepare several two hour long presentations on special topics.

References:

• Elements of Information Theory, by Thomas M. Cover and Joy A. Thomas. Wiley, 2nd edition 2006. A classical text on information theory.
  
  
• Information theory, Inference, and Learning Algorithms by David J>C. Mac Kay. Cambridge University Press 2003. Lots of interesting applications. The book is available for download here
  
  
• Model Selection and Multimodel Inference: A Practical Information-Theoretic Approach by Kenneth P. Burnham and David R. Anderson. Springer 2003. Available electronically at UMass library.
  
  
• Information Criteria and Statistical Modeling by Sadanori Konishi and Genshiro Kitagawa. Springer 2008. Available electronically at UMass library.
  
  
• Quantum Information: An Introduction by Masahito Hayashi. Springer 2006. Available electronically at UMass library.