Course Syllabus

Course Information：

Year-Semester Course Number Course Name Phase Credits Hours Required/Elective Instructor Class Student NO. Withdraw Note

Spring Semester
Year 2025 346305 Computer Graphics and Augmented Reality 1 3.0 3 ★ Ching-RongJim Lin MSAI 9 0 　

Year-Semester	Course Number	Course Name	Phase	Credits	Hours	Required/Elective	Instructor	Class	Student NO.	Withdraw	Note
Spring Semester Year 2025	346305	Computer Graphics and Augmented Reality	1	3.0	3	★	Ching-RongJim Lin	MSAI	9	0

Course Plan：

Instructor Ching-RongJim Lin

Email jimcrlin8721@gmail.com

Last Updated 2025-05-24 09:42:03

Course Objective Artificial intelligence (AI) and augmented reality (AR) technologies have existed in recognizable forms for more than 70 years and have recently experienced rapid growth. AI is commonly used in AR applications, with one of the most typical examples being video games. AI has been applied to video games in numerous ways, including world-building, pathfinding, data mining, and player experience modeling. A particularly intriguing application is the use of AI, machine learning, and deep learning for content generation. Since video games are among the most popular applications of AR, AI technologies used in mainstream games are increasingly being integrated into AR experiences. In this course, students will learn how to develop video game applications using Unity 3D, a powerful cross-platform 3D engine that offers a user-friendly development environment. The course will introduce students to AI algorithms and tools commonly used in AR applications, such as ChatGPT, natural language processing (NLP), and object recognition. One of the most exciting aspects of Artificial Intelligence covered in this course is Reinforcement Learning. Students will explore this concept through the Unity ML-Agents project, one of the most accessible and engaging ways to begin working with Reinforcement Learning. Students will learn to train Unity game objects using ML-Agents and apply these techniques to create intelligent behaviors. Finally, the course will focus on how AI, machine learning, and deep learning can be used to generate content in AR. Students will gain hands-on experience creating environmental elements, music, and other components, enabling them to bring innovative and immersive AR experiences to life. 人工智慧（AI）和擴增實境（AR）技術已經以可識別的形式存在了70多年，並且最近經歷了快速成長。 AI在AR應用中被廣泛使用，其中最典型的例子之一就是電玩遊戲。人工智慧已經以多種方式應用於視訊遊戲，包括世界建構、尋路、資料探勘和玩家體驗建模。一個特別有趣的應用是使用人工智慧、機器學習和深度學習來產生內容。由於電玩遊戲是 AR 最受歡迎的應用程式之一，主流遊戲中使用的 AI 技術越來越多地融入 AR 體驗中。在本課程中，學生將學習如何使用 Unity 3D 開發視訊遊戲應用程序，Unity 3D 是一個功能強大的跨平台 3D 引擎，可提供用戶友好的開發環境。課程將向學生介紹AR應用中常用的AI演算法和工具，例如ChatGPT、自然語言處理（NLP）和物件辨識。本課程涵蓋的人工智慧最令人興奮的方面之一是強化學習。學生將透過 Unity ML-Agents 計畫來探索這個概念，這是開始使用強化學習最容易獲得且最吸引人的方式之一。學生將學習使用 ML-Agents 訓練 Unity 遊戲物件並應用這些技術來創建智慧行為。最後，課程將重點介紹如何使用人工智慧、機器學習和深度學習來產生 AR 中的內容。學生將獲得創建環境元素、音樂和其他組件的實踐經驗，使他們能夠將創新和沈浸式的 AR 體驗變為現實。

Course Schedule
(Week 1-16) Week Date Class Deadlines 1 2/21 Introduction to VR/AR/XR/Unity Project 1 Description release 2 2/28 Holiday 3 3/7 Lecture 1: The Unity VR Project Setup Project 1 Finish Project 2 Description release 4 3/14 Lecture 2: AR Development Project 2 Finish Project 3 Description release 5 3/21 Lecture 3: Computer Graphics Work on project 3 6 3/28 Lecture 4: AI in Unity Project 3 Finish Project 4 Description release 7 4/4 Holiday 8 4/11 Lecture 5: AI in VR/AR Project 4 Finish Mid-term Project Description release 9 4/18 Mid-term Work on mid-term project (on class) 10 4/25 Lecture 6: Unity AI: ML Agents (online class) Mid-term discussion and Demo Mid-term Project Present/Demo Project 5 Description release 11 5/2 Lecture 7: AI-powered AR/VR (online class) Final Project Description release 12 5/9 Lecture 8: Paper Presentation: NLP Project 5 Finish and Demo Final Project Proposal due 13 5/16 Lecture 9: Paper Presentation: Object Recognition Final Project Scene due 14 5/23 Lecture 10: Paper Presentation: AI Story Final Project Discussion 15 5/30 Lecture 11: Paper Presentation: AI Music Final Project Discussion 16 6/6 Final Summary and Discussion Final Project Discussion 17 6/13 Final Project Presentation (online class) 18 6/20 Final (online class)

Evaluation and grading policy • Individual Assignment/Project (40%) o (5%) Project #1: Unity Setup o (5%) Project #2: VR Room o (10%) Project #3: AR app o (10%) Project #4: Sentis+ WhisperAI o (10%) Project #5: Hummingbird • Mid-Term Project (15%): Hugging Face/Paper • Team/Final Project (35%): AR + LLM+ ML Agent o (5%) Project proposal o (5%) Project mid-term report o (5%) Project presentation o (20%) Project final report • In-Class Activity (10%)

Materials All right reserved. Do not reproduce without permission.

Foreign-language textbooks:Yes
Steven M. LaValle. Virtual Reality. To be published by Cambridge University Press. (available online: http://lavalle.pl/vr/ )

The access to curricular consultation Email to jimcrlin8721@gmail.com

Expanding teaching and resources

The course corresponds to the SDGs SDG4：優質教育（Quality Education）
SDG8：尊嚴就業與經濟發展（Decent Work and Economic Growth）
SDG9：產業創新與基礎設施（Industry, Innovation and Infrastructure）
SDG17：夥伴關係（Partnerships for the Goals）

Does the course incorporate AI ● 使用生成式AI作為教學過程的輔助工具（Use generative AI tools as an aid to the teaching process）
● 鼓勵學生使用生成式AI工具（Encourage students to use generative AI tools）
● 使用生成式AI進行課堂即時互動（Use generative AI for real-time classroom interaction）
● 簡單介紹AI的基本概念（Briefly introduce the basic concept of AI）
● 深入探討AI的原理與應用（Explore the principles and applications of AI in depth）

Note
Due to the teacher returning to the US, 4/25, 5/2, 6/13, and 6/20 are online classes.

Instructor	Ching-RongJim Lin
Email	jimcrlin8721@gmail.com
Last Updated	2025-05-24 09:42:03
Course Objective	Artificial intelligence (AI) and augmented reality (AR) technologies have existed in recognizable forms for more than 70 years and have recently experienced rapid growth. AI is commonly used in AR applications, with one of the most typical examples being video games. AI has been applied to video games in numerous ways, including world-building, pathfinding, data mining, and player experience modeling. A particularly intriguing application is the use of AI, machine learning, and deep learning for content generation. Since video games are among the most popular applications of AR, AI technologies used in mainstream games are increasingly being integrated into AR experiences. In this course, students will learn how to develop video game applications using Unity 3D, a powerful cross-platform 3D engine that offers a user-friendly development environment. The course will introduce students to AI algorithms and tools commonly used in AR applications, such as ChatGPT, natural language processing (NLP), and object recognition. One of the most exciting aspects of Artificial Intelligence covered in this course is Reinforcement Learning. Students will explore this concept through the Unity ML-Agents project, one of the most accessible and engaging ways to begin working with Reinforcement Learning. Students will learn to train Unity game objects using ML-Agents and apply these techniques to create intelligent behaviors. Finally, the course will focus on how AI, machine learning, and deep learning can be used to generate content in AR. Students will gain hands-on experience creating environmental elements, music, and other components, enabling them to bring innovative and immersive AR experiences to life. 人工智慧（AI）和擴增實境（AR）技術已經以可識別的形式存在了70多年，並且最近經歷了快速成長。 AI在AR應用中被廣泛使用，其中最典型的例子之一就是電玩遊戲。人工智慧已經以多種方式應用於視訊遊戲，包括世界建構、尋路、資料探勘和玩家體驗建模。一個特別有趣的應用是使用人工智慧、機器學習和深度學習來產生內容。由於電玩遊戲是 AR 最受歡迎的應用程式之一，主流遊戲中使用的 AI 技術越來越多地融入 AR 體驗中。在本課程中，學生將學習如何使用 Unity 3D 開發視訊遊戲應用程序，Unity 3D 是一個功能強大的跨平台 3D 引擎，可提供用戶友好的開發環境。課程將向學生介紹AR應用中常用的AI演算法和工具，例如ChatGPT、自然語言處理（NLP）和物件辨識。本課程涵蓋的人工智慧最令人興奮的方面之一是強化學習。學生將透過 Unity ML-Agents 計畫來探索這個概念，這是開始使用強化學習最容易獲得且最吸引人的方式之一。學生將學習使用 ML-Agents 訓練 Unity 遊戲物件並應用這些技術來創建智慧行為。最後，課程將重點介紹如何使用人工智慧、機器學習和深度學習來產生 AR 中的內容。學生將獲得創建環境元素、音樂和其他組件的實踐經驗，使他們能夠將創新和沈浸式的 AR 體驗變為現實。
Course Schedule (Week 1-16)	Week Date Class Deadlines 1 2/21 Introduction to VR/AR/XR/Unity Project 1 Description release 2 2/28 Holiday 3 3/7 Lecture 1: The Unity VR Project Setup Project 1 Finish Project 2 Description release 4 3/14 Lecture 2: AR Development Project 2 Finish Project 3 Description release 5 3/21 Lecture 3: Computer Graphics Work on project 3 6 3/28 Lecture 4: AI in Unity Project 3 Finish Project 4 Description release 7 4/4 Holiday 8 4/11 Lecture 5: AI in VR/AR Project 4 Finish Mid-term Project Description release 9 4/18 Mid-term Work on mid-term project (on class) 10 4/25 Lecture 6: Unity AI: ML Agents (online class) Mid-term discussion and Demo Mid-term Project Present/Demo Project 5 Description release 11 5/2 Lecture 7: AI-powered AR/VR (online class) Final Project Description release 12 5/9 Lecture 8: Paper Presentation: NLP Project 5 Finish and Demo Final Project Proposal due 13 5/16 Lecture 9: Paper Presentation: Object Recognition Final Project Scene due 14 5/23 Lecture 10: Paper Presentation: AI Story Final Project Discussion 15 5/30 Lecture 11: Paper Presentation: AI Music Final Project Discussion 16 6/6 Final Summary and Discussion Final Project Discussion 17 6/13 Final Project Presentation (online class) 18 6/20 Final (online class)
Evaluation and grading policy	• Individual Assignment/Project (40%) o (5%) Project #1: Unity Setup o (5%) Project #2: VR Room o (10%) Project #3: AR app o (10%) Project #4: Sentis+ WhisperAI o (10%) Project #5: Hummingbird • Mid-Term Project (15%): Hugging Face/Paper • Team/Final Project (35%): AR + LLM+ ML Agent o (5%) Project proposal o (5%) Project mid-term report o (5%) Project presentation o (20%) Project final report • In-Class Activity (10%)
Materials	All right reserved. Do not reproduce without permission. Foreign-language textbooks:Yes Steven M. LaValle. Virtual Reality. To be published by Cambridge University Press. (available online: http://lavalle.pl/vr/ )
The access to curricular consultation	Email to jimcrlin8721@gmail.com
Expanding teaching and resources
The course corresponds to the SDGs	SDG4：優質教育（Quality Education） SDG8：尊嚴就業與經濟發展（Decent Work and Economic Growth） SDG9：產業創新與基礎設施（Industry, Innovation and Infrastructure） SDG17：夥伴關係（Partnerships for the Goals）
Does the course incorporate AI	● 使用生成式AI作為教學過程的輔助工具（Use generative AI tools as an aid to the teaching process） ● 鼓勵學生使用生成式AI工具（Encourage students to use generative AI tools） ● 使用生成式AI進行課堂即時互動（Use generative AI for real-time classroom interaction） ● 簡單介紹AI的基本概念（Briefly introduce the basic concept of AI） ● 深入探討AI的原理與應用（Explore the principles and applications of AI in depth）
Note	Due to the teacher returning to the US, 4/25, 5/2, 6/13, and 6/20 are online classes.