35264 - Information Theory (2nd cycle)

Academic Year 2013/2014

  • Docente: Marco Chiani
  • Credits: 6
  • SSD: ING-INF/03
  • Language: Italian
  • Teaching Mode: Traditional lectures
  • Campus: Cesena
  • Corso: Second cycle degree programme (LM) in Electronics and Telecommunications Engineering for Energy (cod. 8770)

Learning outcomes

Fundamentals of Information Theory: entropy, source compression, channel capacity, secure communication. Coding for audio and video. Applications: wireless systems, satellite communication systems, information storage.

Course contents

INFORMATION, UNCERTAINTY AND ENTROPY.
ENTROPY FOR DISCRETE MEMORYLESS SOURCES. SOURCE CODING.
MUTUAL INFORMATION AND CHANNEL CAPACITY. SHANNON'S THEOREM ON CHANNEL CODING. CAPACITY FOR GAUSSIAN ADDITIVE CHANNELS. THE HARTLEY-SHANNON FORMULA FOR THE BAND LIMITED ADDITIVE GAUSSIAN CHANNEL. SPECTRAL AND POWER EFFICIENCIES.

CHANNEL CODING. LINEAR BLOCK CODES. CYCLIC CODES. CONVOLUTIONAL CODES. CODING FOR CORRELATED CHANNELS: INTERLEAVING. PUNCTURED CODES. CONCATENATED CODES. ITERATIVE DECODING: TURBO CODES AND LDPC CODES. FUNDAMENTALS OF CRYPTOLOGY AND SECURITY.

APPLICATIONS. SATELLITE SYSTEMS. CODING FOR DATA STORAGE SYSTEMS. CODING IN WIRELESS CELLULAR SYSTEMS.

Readings/Bibliography

T.M. COVER, J.A. THOMAS, ELEMENTS OF INFORMATION THEORY, WILEY-INTERSCIENCE, NEW YORK.

J.G. PROAKIS, DIGITAL COMMUNICATIONS, McGRAW-HILL, NEW YORK.

M. CHIANI, ERROR CORRECTING CODES (LECTURE NOTES)

Teaching methods

Lectures.
Computer experiments and programming in Matlab or C.

Assessment methods

WRITTEN AND ORAL EXAMINATION.

Teaching tools

Personal computer

Office hours

See the website of Marco Chiani