Course Syllabus

Course Information：

Year-Semester	Course Number	Course Name	Phase	Credits	Hours	Required/Elective	Instructor	Class	Student NO.	Withdraw	Note
Spring Semester Year 2026	359936	Computer Graphics and Augmented Reality	1	3.0	3	★	Ching-RongJim Lin	MSAI	18	0

Course Plan：

Instructor	Ching-RongJim Lin
Email	jimcrlin8721@gmail.com
Last Updated	2025-12-17 22:17:07
Course Objective	人工智慧（AI）和擴增實境（AR）技術已經以可識別的形式存在了70多年，並且最近經歷了快速成長。 AI在AR應用中被廣泛使用，其中最典型的例子之一就是電玩遊戲。人工智慧已經以多種方式應用於視訊遊戲，包括世界建構、尋路、資料探勘和玩家體驗建模。一個特別有趣的應用是使用人工智慧、機器學習和深度學習來產生內容。由於電玩遊戲是 AR 最受歡迎的應用程式之一，主流遊戲中使用的 AI 技術越來越多地融入 AR 體驗中。 在本課程中，學生將學習如何使用 Unity 3D 開發視訊遊戲應用程序，Unity 3D 是一個功能強大的跨平台 3D 引擎，可提供用戶友好的開發環境。課程將向學生介紹AR應用中常用的AI演算法和工具，例如ChatGPT、自然語言處理（NLP）和物件辨識。本課程涵蓋的人工智慧最令人興奮的方面之一是強化學習。學生將透過 Unity ML-Agents 計畫來探索這個概念，這是開始使用強化學習最容易獲得且最吸引人的方式之一。學生將學習使用 ML-Agents 訓練 Unity 遊戲物件並應用這些技術來創建智慧行為。 最後，課程將重點介紹如何使用人工智慧、機器學習和深度學習來產生 AR 中的內容。學生將獲得創建環境元素、音樂和其他組件的實踐經驗，使他們能夠將創新和沈浸式的 AR 體驗變為現實。 Artificial intelligence (AI) and augmented reality (AR) technologies have existed in recognizable forms for more than 70 years and have recently experienced rapid growth. AI is commonly used in AR applications, with one of the most typical examples being video games. AI has been applied to video games in numerous ways, including world-building, pathfinding, data mining, and player experience modeling. A particularly intriguing application is the use of AI, machine learning, and deep learning for content generation. Since video games are among the most popular applications of AR, AI technologies used in mainstream games are increasingly being integrated into AR experiences. In this course, students will learn how to develop video game applications using Unity 3D, a powerful cross-platform 3D engine that offers a user-friendly development environment. The course will introduce students to AI algorithms and tools commonly used in AR applications, such as ChatGPT, natural language processing (NLP), and object recognition. One of the most exciting aspects of Artificial Intelligence covered in this course is Reinforcement Learning. Students will explore this concept through the Unity ML-Agents project, one of the most accessible and engaging ways to begin working with Reinforcement Learning. Students will learn to train Unity game objects using ML-Agents and apply these techniques to create intelligent behaviors. Finally, the course will focus on how AI, machine learning, and deep learning can be used to generate content in AR. Students will gain hands-on experience creating environmental elements, music, and other components, enabling them to bring innovative and immersive AR experiences to life.
Course Schedule	1 2/27 Holiday 2 3/6 Introduction to VR/AR/XR/Unity 3 3/13 Lecture 1: The Unity VR Project Setup 4 3/20 Lecture 2: Computer Graphics 5 3/27 Lecture 3: AR Development 6 4/3 Holiday 7 4/10 Lecture 4: AI in Unity 8 4/17 Lecture 5: AI in VR/AR 9 4/24 Mid-term 10 5/1 Holiday 11 5/8 Lecture 6: Unity AI: ML Agents Mid-term discussion and Demo 12 5/15 Lecture 7: AI-powered AR/VR 13 5/22 Lecture 8: Paper Presentation: NLP 14 5/29 Lecture 9: Paper Presentation: Object Recognition 15 6/5 Lecture 10: Paper Presentation: AI Story 16 6/12 Lecture 11: Paper Presentation: AI Music 17 6/19 Holiday 18 6/26 Final Project Presentation (online class)
Evaluation and grading policy	Credit Distribution • Individual Assignment/Project (40%) o (5%) Project #1: Unity Setup o (10%) Project #2: VR Room o (10%) Project #3: AR app o (10%) Project #4: Hummingbird • Mid-Term Project (20%): Hugging Face/Paper • Team/Final Project (35%): AR + LLM+ ML Agent o (5%) Project proposal o (5%) Project mid-term report o (5%) Project presentation o (20%) Project final report • In-Class Activity (10%)
Materials	All right reserved. Do not reproduce without permission. Foreign-language textbooks:Yes Steven M. LaValle. Virtual Reality. To be published by Cambridge University Press. (available online: http://lavalle.pl/vr/ )
The access to curricular consultation	Email Address jimcrlin8721@gmail.com Office Hours Friday 2:30PM – 3:30 PM Schedule Email Appointment
Expanding teaching and resources
The course corresponds to the SDGs	SDG4：優質教育（Quality Education） SDG8：尊嚴就業與經濟發展（Decent Work and Economic Growth） SDG9：產業創新與基礎設施（Industry, Innovation and Infrastructure） SDG11：永續城市與社區（Sustainable Cities and Communities） SDG12：負責任的消費與生產（Responsible Consumption and Production）
Does the course incorporate AI	● 使用生成式AI作為教學過程的輔助工具（Use generative AI tools as an aid to the teaching process） ● 鼓勵學生使用生成式AI工具（Encourage students to use generative AI tools） ● 使用生成式AI進行課堂即時互動（Use generative AI for real-time classroom interaction） ● 簡單介紹AI的基本概念（Briefly introduce the basic concept of AI） ● 深入探討AI的原理與應用（Explore the principles and applications of AI in depth）
Note	Student Learning Objectives/Outcomes • Ability to setup 3D virtual environments • Ability to play AR/VR in 3D virtual environments • Ability to evaluate 3D virtual environments • Ability to develop 3D virtual environments • Ability to render 3D virtual worlds into images • Ability to understand human visual system and visual perception • Ability to understand audio and haptics • Ability to utilize head tracking, eye tracking and pose tracking techniques • Ability to utilize locomotion, 3D selection and manipulation techniques • Ability to use AI in VR