Course Syllabus

Course Information：

Year-Semester Course Number Course Name Phase Credits Hours Required/Elective Instructor Class Student NO. Withdraw Note

Spring Semester
Year 2026 353672 Speech Recognition and Human-Machine Interaction 1 3.0 3 ★ Horng-Jia Tsue 4EN4A
4EN4B 41 0 電子大四合開

Year-Semester	Course Number	Course Name	Phase	Credits	Hours	Required/Elective	Instructor	Class	Student NO.	Withdraw	Note
Spring Semester Year 2026	353672	Speech Recognition and Human-Machine Interaction	1	3.0	3	★	Horng-Jia Tsue	4EN4A 4EN4B	41	0	電子大四合開

Course Plan：

Instructor Horng-Jia Tsue　Office Hours

Email franktsuei@ntut.edu.tw

Last Updated 2025-12-10 13:46:08

Course Objective 本課程將引導學生了解語音辨識在人機互動應用上所牽涉的各種技術，包括語音訊號分析、音素/音節辨識、字詞辨識、連續語音辨識、語意辨識、語者辨識、語言辨識、語音合成等，其中也介紹動態時間伸縮與音高比對方法、隱藏式馬可夫模型、類神經網路與深度學習、語者與環境調適、語言模型等方法理論，配合「問題導向學習」之教學模式，進行分組討論、實作練習、企業參訪、與成果觀摩及報告，激發學生之創造與創新能力。 This course guides students to learn the techniques involved in the human-machine interaction based on speech recognition, including speech signal analysis, phoneme/syllable recognition, word recognition, continuous speech recognition, semantic recognition, speaker recognition, language recognition, speech synthesis. The theoretical fundamentals on dynamic time warping, hidden Markov model, neural network/deep learning, speaker and environment adaptation, language modeling, etc. are also introduced. In addition, the course is designed with the Problem-Based Learning (PBL) method, which includes group discussion and collaboration on working projects, corporate visit, and project presentation, etc., so that students' capabilities of creativity and innovation can be developed or enhanced.

Course Schedule 第1週導論第2-4週音訊號分析、音素/音節辨識第5-8週字詞辨識、連續語音辨識、語意辨識、語者辨識、語言辨識、語音合成第10-11週動態時間伸縮與音高比對方法、隱藏式馬可夫模型第12-14週類神經網路與深度學習第15-17週語者與環境調適、語言模型

Evaluation and grading policy Team work 40%, Final Exam 30%, Homework 30%

Materials All right reserved. Do not reproduce without permission.

Foreign-language textbooks:Yes
教科書: Language and Speech Recognition for Human-Computer Interaction, by Amitoj Singh,ISBN：9781799813897 教材會放在"北科i學園PLUS" 公告(如考試及作業繳交公告)會放在"北科i學園PLUS"公告欄

The access to curricular consultation 授課內容講義或注意事項均公布於北科i學園PLUS。若上課有疑問可透過E-mail 或FB Club Messenger討論相關事項。
相關之線上教學規劃將於Facebook Clubs同步發佈
加入FB Club Messenger與我聯絡

Expanding teaching and resources

The course corresponds to the SDGs SDG1：消除貧窮（No Poverty）
SDG4：優質教育（Quality Education）
SDG13：氣候行動（Climate Action）
SDG14：水下生命（Life below Water）
SDG17：夥伴關係（Partnerships for the Goals）

Does the course incorporate AI ● 鼓勵學生使用生成式AI工具（Encourage students to use generative AI tools）
● 簡單介紹AI的基本概念（Briefly introduce the basic concept of AI）

Note
相關之17、18週線上教學規劃己於Facebook Clubs同步發佈

Instructor	Horng-Jia Tsue　Office Hours
Email	franktsuei@ntut.edu.tw
Last Updated	2025-12-10 13:46:08
Course Objective	本課程將引導學生了解語音辨識在人機互動應用上所牽涉的各種技術，包括語音訊號分析、音素/音節辨識、字詞辨識、連續語音辨識、語意辨識、語者辨識、語言辨識、語音合成等，其中也介紹動態時間伸縮與音高比對方法、隱藏式馬可夫模型、類神經網路與深度學習、語者與環境調適、語言模型等方法理論，配合「問題導向學習」之教學模式，進行分組討論、實作練習、企業參訪、與成果觀摩及報告，激發學生之創造與創新能力。 This course guides students to learn the techniques involved in the human-machine interaction based on speech recognition, including speech signal analysis, phoneme/syllable recognition, word recognition, continuous speech recognition, semantic recognition, speaker recognition, language recognition, speech synthesis. The theoretical fundamentals on dynamic time warping, hidden Markov model, neural network/deep learning, speaker and environment adaptation, language modeling, etc. are also introduced. In addition, the course is designed with the Problem-Based Learning (PBL) method, which includes group discussion and collaboration on working projects, corporate visit, and project presentation, etc., so that students' capabilities of creativity and innovation can be developed or enhanced.
Course Schedule	第1週導論第2-4週音訊號分析、音素/音節辨識第5-8週字詞辨識、連續語音辨識、語意辨識、語者辨識、語言辨識、語音合成第10-11週動態時間伸縮與音高比對方法、隱藏式馬可夫模型第12-14週類神經網路與深度學習第15-17週語者與環境調適、語言模型
Evaluation and grading policy	Team work 40%, Final Exam 30%, Homework 30%
Materials	All right reserved. Do not reproduce without permission. Foreign-language textbooks:Yes 教科書: Language and Speech Recognition for Human-Computer Interaction, by Amitoj Singh,ISBN：9781799813897 教材會放在"北科i學園PLUS" 公告(如考試及作業繳交公告)會放在"北科i學園PLUS"公告欄
The access to curricular consultation	授課內容講義或注意事項均公布於北科i學園PLUS。若上課有疑問可透過E-mail 或FB Club Messenger討論相關事項。相關之線上教學規劃將於Facebook Clubs同步發佈加入FB Club Messenger與我聯絡
Expanding teaching and resources
The course corresponds to the SDGs	SDG1：消除貧窮（No Poverty） SDG4：優質教育（Quality Education） SDG13：氣候行動（Climate Action） SDG14：水下生命（Life below Water） SDG17：夥伴關係（Partnerships for the Goals）
Does the course incorporate AI	● 鼓勵學生使用生成式AI工具（Encourage students to use generative AI tools） ● 簡單介紹AI的基本概念（Briefly introduce the basic concept of AI）
Note	相關之17、18週線上教學規劃己於Facebook Clubs同步發佈