Lecture 1 (01/12/2026) (Syllabus, Lecture Slides)

• Syllabus
• Introduction
• Lecture video: here.

Lecture 2 (01/14/2026) (Lecture Notes, Lecture Review Slides)

• What is information?
• How do we measure information?
• Lecture video: here. Old video: here.

Lecture 3 (01/16/2026) (Lecture Notes, Lecture Review Slides)

• How do we measure information (entropy)?
• Lecture video: here.

Lecture 4 (01/21/2026) (Lecture Notes, Lecture Review Slides)

• Example of entropy, self information and properties of entropy
• Joint self information and joint entropy
• Conditional self information and conditional entropy
• Lecture video: here.

Lecture 5 (01/23/2026) (Lecture Notes, Lecture Review Slides)

• Chain rule
• Mutual information
• Lecture video: here.