Unit 1
Source Coding: Information theory, Uncertainty and information, entropy, source coding theorem, Huffman coding, Lempel-Ziv algorithm, Arithmetic coding. Channel capacity and coding: Channel models, channel capacity, channel coding; Information capacity theorem, Shannon limit.