Bladefidz/information-theory

Fundamental of information theory in computer science perspective

information-theory

Fundamental of information theory in computer science perspective

Motivations

Information theory is seriously abstract concept. Here list of readings to motivate ourself before starting the adventure to information theory:

• Visual Information Theory
• Conditional Probability Visualization
• Conditional Probability Easy Explanation

Books

• Information Theory and Network Coding
• Elements of Information Theory
• Information Theory, Inference, and Learning Algorithms
• markov chain and stocastic stability

Learning Guides

• Learning Guide and Examples

Information Theory Notes at Coursera

Here is the course link. Below the weekly notes (please use nbviwer for better LaTex rendering) and assignments:

Information Measures - Part 1

• The Science of Information
• Independence and markov chain
• Shannon's Information Measures
• Continuity of Shannon Information Measures for Fixed Finite Alphabets
• Assignement 1