Lecture video for Feb. 4

Lecture video for Feb. 4 (this is a playlist):



Topic covered: Universal coding for binary sources.

Lecture video for Feb. 2

Lecture video for Feb. 2 (this is a playlist):



Topics covered: Review of Shannon-Fano-Elias codes, Arithmetic codes, Introduction to universal codes.

Lecture video for Jan. 28

Lecture video for Jan. 28 (this is a playlist):



Topic covered: Shannon-Fano-Elias codes.

Lecture video for Jan. 26

Lecture video for Jan. 26 (this is a playlist):



Topics covered: Huffman codes (first example, Huffman procedure, dyadic example, Huffman codes as prefix codes, nondyadic example, nonbinary example).

Lecture video for Jan. 21

Lecture video for Jan. 21 (this is a playlist):



Topics covered: Average length and entropy (achievability, penalty, source extension), uniquely decodable codes and entropy, McMillan's theorem.

Lecture video for Jan. 19

Lecture video for Jan. 19 (this is a playlist):



Topics covered: Source codes: definitions and properties, Kraft inequality, Source coding optimization problem, Average length and entropy.

Lecture video for Jan. 14

Lecture video for Jan. 14 (this is a playlist):



Topics covered: Asymptotic Equipartition Property (Weak law of large numbers, Probability and entropy), Typical sets, Properties of typical sets, Source coding and typical sets.