Back close

Course Detail

Course Name Information Theory and Coding
Course Code 19EAC303
Program B. Tech. in Electronics and Computer Engineering
Semester 5
Year Taught 2019


Module I

Introduction to Probability – Random Variables, Random variable, Sample space, Conditional probability, Joint probability. Modeling of Information Sources – Self Information, Entropy, Mutual Information. Source Coding Theory and algorithms – Kraft inequality, Huffman algorithm, Arithmetic coding, Lempel Ziv coding. Modeling of Communication channels – Binary symmetric channel, Binary Erasure channel, Channel coding theorem.

Module II

Error Correction Codes – Introduction to Galois fields, polynomial arithmetic, linear block codes for error correction – Generator matrix, Encoding, Parity Check matrix, Decoding – Standard array decoding and Syndrome decoding. Cyclic Codes – Generation of codes, encoding and syndrome decoding.

Module III

BCH Codes – Minimal polynomial encoding and decoding. Convolutional encoder – Introduction to Convolutional codes, distance properties – Trellis codes, Viterbi decoder. Numerical problems and MATLAB based problem solving on selected topics of the course.

Objectives and Outcomes

Course Objectives

  • To provide an insight into the concept of information in the context of communication theory and its significance in the design of communication receivers.
  • To explore in detail, the calculations of channel capacity to support error-free transmission and also, the most commonly used source coding and channel coding algorithms.
  • To encourage and train to design coding schemes for data compression and error correction, and they will also get an overall perspective of how this impacts the design of an optimum communication receiver.

Course Outcomes

  • CO1: Overview of Probability Theory, significance of “Information” with respect to Information Theory.
  • CO2: Derive equations for entropy, mutual information and channel capacity for all kinds of channels.
  • CO3: Implement the various types of source coding algorithms and analyse their performance.
  • CO4: Explain various methods of generating and detecting different types of error correcting codes
  • CO5: Understand the fundamentals of Field Theory and polynomial arithmetic
  • CO6: Design linear block codes and cyclic codes (encoding and decoding).
  • CO7: Implement and decode a sequence at the receiver using Trellis decoder and Viterbi decoder.
  • CO8: Perform mathematical analysis of problems in Information Theory and Coding, Implementation and verification using MATLAB simulation

CO – PO Mapping

PO1 PO2 PO3 PO4 PO5 PO6 PO7 PO8 PO9 PO10 PO11 PO12 PSO1 PSO2
CO1 3 2 3 1
CO2 3 3 1 3 1
CO3 3 3 2 3 3 1
CO4 3 3 1 3 1
CO5 3 1 3 1
CO6 3 2 1 3 2
CO7 3 2 1 3 2
CO8 3 3 1 2 3 1 3 2

Textbook / References

Textbook / References

  • Ranjan Bose, “Information Theory, Coding and Cryptography”, Tata McGraw Hill, 2nd edition.
  • P.S. Satyanarayana, “Concepts of Information Theory and Coding”, Dynaram Publication, 2005
  • Richard B. Wells, “Applied Coding and Information Theory for Engineers” Pearson Education, LPE 2004.
  • Shu Lin and Daniel Castello, “Error Control Coding – Fundamentals and Applications”, second edition 2004
  • Thomas M Cover, Joy Thomas, “Elements of Information Theory”, MGH 2006.

Evaluation Pattern

Assessment Internal External
Periodical 1 (P1) 15
Periodical 2 (P2) 15
*Continuous Assessment (CA) 20
End Semester 50
*CA – Can be Quizzes, Assignment, Projects, and Reports.

DISCLAIMER: The appearance of external links on this web site does not constitute endorsement by the School of Biotechnology/Amrita Vishwa Vidyapeetham or the information, products or services contained therein. For other than authorized activities, the Amrita Vishwa Vidyapeetham does not exercise any editorial control over the information you may find at these locations. These links are provided consistent with the stated purpose of this web site.

Admissions Apply Now