Information Theory (INFE467)
Modeling of information sources and measure of information. Joint and conditional entropy. Source Coding: Huffman, Lempel Ziv coding and arithmetic coding. The Rate distortion theory. Modeling of communication channel and the Channel Capacity Theorem. Scalar and vector quantization and Transform coding. Coding of discrete information sources: Block codes, cyclic codes, convolutional codes. Combined modulation and coding, trellis coded modulation (TCM).