Information TheoryScheduleScheduled for 2010 - 2011AimThe primary goal of this course is to provide course takers with basic understanding of information theory. However, this course also aims to motivate the course takers so that they can smoothly migrate to Advanced Information Theory, of which course is planned for 2008. The course does not assume any prerequisite knowledge of the course takers, and will provide exact derivations of some key equations and theorems in Information Theory.Contents (Course Summary)This course will be started with an introductory explanation to how information theory is related to communication and information systems, which our information technology era flourishes with. Understanding of the general architecture of communications systems is also aimed at. The introductory part is then followed by one full time-slot dedication to mathematics that frequently appears in information theory, and using the mathematical background knowledge provided by the 3rd time slot, this course moves in to the core parts, which are Source Coding Techniques, Entropy and Mutual Information, Channel Capacity, and Limit Theories for Source and Channel Coding. At the final stages of the sections on each of the core topics, introductory explanations will be provided that how those items are further extended and what results are expected, which will be covered by the advanced course planned for 2008. To bridge the gap between theory and practice, fundamentals of practical channel coding techniques are also provided in this course.
1. Coverage of Information Theory Text BookTo be determinedReference BookThomas Cover and Joy Thomas, "Elements of Information Theory", Wiley, ISBN 0-471-24195-4Evaluation CriterionUnderstanding of information theory fundamentals including exact derivations of some key equations and theorems.Evaluation MethodReports, exercises, and final examination |
