教學大綱與進度
課程基本資料:
學年期
課號
課程名稱
階段
學分
時數
修
教師
班級
人
撤
備註
105-2
225676
資訊理論
1
3.0
3
★
吳昭正
電機所
14
2
教學大綱與進度:
教師姓名
吳昭正
Email
ccwu@ntut.edu.tw
最後更新時間
2017-05-03 15:52:11
課程大綱
This course aims to study basic and advanced topics in information theory. The course focuses on the concept of information theory, including entropy, source coding, channel capacity, rate distortion theory, and differential entropy, ...etc. The calculation of channel capacity and rate distortion will be used as computer projects for real implementation. Advanced topics will further cover Gaussian channel and some coding theory.
課程進度
Week 1(2/23). Introduction Week 2(3/2). Review of Random Variables Week 3(3/9). Entropy/Relative Entropy/Mutual Information Week 4(3/16). Jensen’s and Fano's Inequality Week 5(3/23). Data compression (I) Week 6(3/30). Leave for Public Affairs Week 7(4/6). Data compression (II) Week 8(4/13). Data compression (III) Week 9(4/20). Midterm Week 10(4/27). Channel capacity (I) Week 11(5/4). Channel capacity (II) Week 12(5/11). Channel capacity (III) Week 13(5/18). Rate Distortion Theory (I) Week 14(5/25). Rate Distortion Theory (II) Week 15(6/1). Rate Distortion Theory (III) Week 16(6/8). Asymptotic equipartition property Week 17(6/15). Differential entropy Week 18(6/22). Final term
評量方式與標準
Midterm 30% Final term 30% Computer Project 40%
使用教材、參考書目或其他
【遵守智慧財產權觀念,請使用正版教科書,不得使用非法影印教科書】
使用外文原文書:是
Required text: 1. Elements of Information Theory, 2nd Edition, Thomas M. Cover and Joy A. Thomas, Wiley, 2006. Optional text: 1. The Mathematical Theory of Information, Jan Kahre, The Springer, 2002. 2. Information Theory, Inteference, and Learning Algorithms, David J. C. Mackay, Cambridge, 2003. 3. Information Theory: Coding Theorems for Discrete Memoryless Systems, 2md Edition, Imre Csiszar and Janos Korner, Cambridge, 2011
課程諮詢管道
備註