35055 - Theory of Information and Codes

Academic Year 2009/2010

  • Docente: Marco Chiani
  • Credits: 6
  • SSD: ING-INF/03
  • Language: Italian
  • Teaching Mode: Traditional lectures
  • Campus: Cesena
  • Corso: Second cycle degree programme (LS) in Computer Engineering (cod. 0650)

Learning outcomes

PRINCIPLES OF INFORMATION THEORY AND CODING.

Course contents

PART I. INFORMATION, UNCERTAINTY AND ENTROPY. ENTROPY FOR DISCRETE MEMORYLESS SOURCES. SOURCE CODING. MUTUAL INFORMATION AND CHANNEL CAPACITY. SHANNON'S THEOREM ON CHANNEL CODING. CAPACITY FOR GAUSSIAN ADDITIVE CHANNELS. THE HARTLEY-SHANNON FORMULA FOR THE BAND LIMITED ADDITIVE GAUSSIAN CHANNEL. SPECTRAL AND POWER EFFICIENCIES. PART II. CHANNEL CODING. LINEAR BLOCK CODES. CYCLIC CODES. CONVOLUTIONAL CODES. CODING FOR CORRELATED CHANNELS: INTERLEAVING. PUNCTURED CODES. CONCATENATED CODES.
PART III. APPLICATIONS. THE DVB-S SYSTEM. CODING FOR COMPACT DISK SYSTEMS. CODING IN WIRELESS CELLULAR SYSTEMS.

Readings/Bibliography

T.M. COVER, J.A. THOMAS, ELEMENTS OF INFORMATION THEORY, WILEY-INTERSCIENCE, NEW YORK.

J.G. PROAKIS, DIGITAL COMMUNICATIONS, McGRAW-HILL, NEW YORK.

Teaching methods

Around 40 hours theory, the remaining on exercises and applications, for a total of no more than 60 hours.

Assessment methods

WRITTEN AND ORAL EXAMINATION.

Teaching tools

Personal computer

Office hours

See the website of Marco Chiani