スケジュール

2007年度開講

目的

      The primary goal of this course is to provide course takers with basic understanding of information theory. However, this course also aims to motivate the course takers so that they can smoothly migrate to Advanced Information Theory, of which course is planned for 2008. The course does not assume any prerequisite knowledge of the course takers, and will provide exact derivations of some key equations and theorems in Information Theory.

内容 (コース要約)

      This course will be started with an introductory explanation to how information theory is related to communication and information systems, which our information technology era flourishes with. Understanding of the general architecture of communications systems is also aimed at. The introductory part is then followed by one full time-slot dedication to mathematics that frequently appears in information theory, and using the mathematical background knowledge provided by the 3rd time slot, this course moves in to the core parts, which are Source Coding Techniques, Entropy and Mutual Information, Channel Capacity, and Limit Theories for Source and Channel Coding. At the final stages of the sections on each of the core topics, introductory explanations will be provided that how those items are further extended and what results are expected, which will be covered by the advanced course planned for 2008. To bridge the gap between theory and practice, fundamentals of practical channel coding techniques are also provided in this course.

1. Coverage of Information Theory
2. General Architecture of Communication Systems
3. Mathematical Tools for Information Theory
4. Source and Channel Models
5. Entropy, Relative Entropy, and Data Compression
6. Source Coding
7. Mutual Information
8. Channel Capacity
9. Limit Theories in Source Coding
10. Limit Theories in Channel Coding: Reliability Function
11. Introduction to Network Information Theory
12. Channel Coding Techniques in Practice: Block and Convolutional Codes
13. Channel Coding Techniques in Practice: Turbo and LDPC Codes
14. Information Theory with Feedback
15. Examination

教科書

To be determined

参考書

Thomas Cover and Joy Thomas, "Elements of Information Theory", Wiley, ISBN 0-471-24195-4

評価基準

Understanding of information theory fundamentals including exact derivations of some key equations and theorems.

評価方法

Reports, exercises, and final examination