Course Syllabus

Course Information：

Year-Semester	Course Number	Course Name	Phase	Credits	Hours	Required/Elective	Instructor	Class	Student NO.	Withdraw	Note
Spring Semester Year 2024	329481	Big Data Technology and Administration	1	3.0	3	★	Yi Chun Wang	GEECS MSAI	19	1	職電機所、創新AI、電資AI 合開

Course Plan：

Instructor	Yi Chun Wang
Email	bnwntut8@ntut.edu.tw
Last Updated	2024-05-23 11:15:08
Course Objective	由於雲端運算的快速發展，大量資料收集與儲存技術已成瓶頸，大數據技術與管理提供一套具延展性與容錯能力的分散儲存與計算架構, 能有效處理大量複雜數據資料的儲存與運算。 本課程除介紹現有的大數據生態與趨勢，並針對目前軟硬體架構的處理瓶頸，提供系統組態與部署、服務層級協定、監控與管理等系統性規劃的解決方案，並導入跨領域的工程管理科學知識。課程簡扼論述大數據技術與管理的重要，並在Hadoop生態系統中，以Cloudera Hadoop為應用範例，實作說明其重要性。 課程內容包括：大數據的概念、應用生態與趨勢、Hadoop硬體規格與基礎架構規劃、叢集組態與部署、叢集服務層級協定、叢集監控與管理、相關生態技術。
Course Schedule	(Syllabus, preliminary) Monday. 18:30-21:10 (ABC) Week# Subject to change per needs and circumstances 01 2/19 Syllabus & organization of all mission cases from the class 02 2/26 Big Data Application and Trend 03 3/04 Hadoop Cluster Deployment 04 3/11 Core Technologies for Big Data Management 05 3/18 Hadoop Distributed File System (HDFS) 06 3/25 MapReduce 07 4/01 YARN Applications 08 4/08 Planning Hadoop Cluster Hardware and Software 09 4/15 Mid-Term Exam or Reviews 10 4/22 Hadoop I/O 11 4/29 Hadoop High Available, Failover, Fensing and Federation 12 5/06 Hadoop Ecosystem Project Presentation and Q&A -1 13 5/13 Hadoop Ecosystem Project Presentation and Q&A -2 14 5/20 Hadoop Ecosystem Project Presentation and Q&A -3 15 5/27 Resource & Scheduler Management 16 6/03 Hadoop Security 17 6/10 Public Holiday (端午節) 18 6/17 Final-Exam
Evaluation and grading policy	1. Assignment including Team's Presentation, Comments and Q&A：50% 2. Exam(s) & Review: 50%
Materials	All right reserved. Do not reproduce without permission. Foreign-language textbooks:Yes 1. Hadoop: The Definitive Guide, Fourth Edition, April 2015, Published by O’Reilly Media, Inc., Editor: Tom White. 2. Hadoop Essentials, First Edition, April 2015, Published by O’Reilly Media, Inc., Editor: Shiva Achari. 3. Hadoop Operation, First Edition, September 2012, Published by O’Reilly Media, Inc., Editor: Eric Sammer. 4. 大數據大時代 - 新一代儲存技術及實作，作者: 查偉，發行所:佳魁資訊， 出版日期: 2017, 3月. 5. Yusuf Aytas, Designing Big Data Platform, How to Use, Deploy and Maintain Big Data Systems, Wiley, February 2021. 6. Jimmy Lin and Chris Dyer, Data-Intensive Text Processing with MapReduce, Morgan & Claypool Publishers, 2010. 7. Holden Karau, Andy Konwinski, Patrick Wendell, Matei Zaharia, Learning Spark: Lightning-Fast Big Data Analysis, O'Reilly Media, January 2015. Additional Reading References: 8. The Google File System; https://static.googleusercontent.com/media/research.google.com/zh-TW//archive/gfs-sosp2003.pdf 9. MapReduce: Simplified Data Processing on Large Clusters; https://static.googleusercontent.com/media/research.google.com/zh-TW//archive/mapreduce-osdi04.pdf 10. Big Data associated, To-Be-Advised in class
The access to curricular consultation	第17週 6/10 端午節 放假 第18週 6/17 維持期末考 ，已於 5/6 向進修部 書面申請教室 二教103(e) , 時段A,B,C 5/7 透過LINE 群組 通告 5/8 已至北科i學園，課程公告 5/6, 5/13, 5/20 已於課堂上告知修課學生 Join LINE Group:https://line.me/R/ti/g/fZMxprXyS7 Questions to email: bnwntut8@ntut.edu.tw
The course corresponds to the SDGs
Note	第17週 6/10 端午節 放假 第18週 6/17 維持期末考 ，已於 5/6 向進修部 書面申請教室 二教103(e) , 時段A,B,C 5/7 透過LINE 群組 通告 5/8 已至北科i學園，課程公告 5/6, 5/13，5/20 已於課堂上告知修課學生 If NTUT announces for remote class upon some specific issues, then it goes for Google Meet: https://meet.google.com/rkg-kbgv-odo LINE Group: https://line.me/R/ti/g/fZMxprXyS7 Questions to email: bnwntut8@ntut.edu.tw SDG#4: 教育品質 SDG#8: 就業與經濟成長 SDG#9: 工業、創新、基礎建設