Information - Entropy - Properties of Entropy - Joint and Conditional Entropy - Mutual Information - Channel Models - Channel Capacity - Shannon's Theorem
Variable length codes - Prefix codes - Kraft's Inequality - Shannon-Fano coding - Huffman coding - Arithmetic coding - Run length coding - Lempel-Ziv coding
Error control codes - Types of errors - Error detection using parity checks - CRC codes - Error correction using Hamming codes - Minimum distance - Error detecting and error correcting capabilities
Vector spaces - Generator and Parity check matrices - Encoding and decoding of linear block codes - Syndrome decoding - Standard array - Cyclic codes - Properties - Generator polynomial - Encoding and decoding
Convolutional codes - State diagram - Trellis diagram - Encoding - Decoding using Viterbi algorithm - Applications in data transmission , satellite and mobile communication , and data storage systems
Reference Book:
R1 - Ranjan Bose , "Information Theory , Coding and Cryptography" , 3rd Edition , McGraw Hill Education , 2017 R2 - Peterson , W.W. and E.J. Weldon , "Error-Correcting Codes" , 2nd Edition , MIT Press , 2013 R3 - Richard B. Wells , "Applied Coding and Information Theory for Engineers" , Pearson Education , 2015 R4 - Richard B. Wells , "Applied Coding and Information Theory for Engineers" , Pearson Education , 2015 R5 - Lipschutz , S. and Marc Lipson , "Discrete Mathematics" , Schaum"s Outlines , Tata McGraw Hill , Revised 3rd Edition , 2017
Text Book:
T1 - Simon Haykin , "Communication Systems" , 4th Edition , John Wiley & Sons , 2011 T2 - A. R. K. Sastry , "Information Theory , Coding and Cryptography" , PHI Learning , New Delhi , 2012
