查詢教學大綱與進度

教學大綱與進度

課程基本資料：

學年期課號課程名稱階段學分時數修教師班級人撤備註

109-1 280079 大數據技術與管理 1 3.0 3 ★ 王怡鈞 AI雙聯專班一 40 0 綜科318室，10/17，10/24，11/14，12/5，12/12，12/19

學年期	課號	課程名稱	階段	學分	時數	修	教師	班級	人	撤	備註
109-1	280079	大數據技術與管理	1	3.0	3	★	王怡鈞	AI雙聯專班一	40	0	綜科318室，10/17，10/24，11/14，12/5，12/12，12/19

教學大綱與進度：

教師姓名王怡鈞

Email bnwntut8@ntut.edu.tw

最後更新時間 2020-09-07 11:12:07

課程大綱 This is a science applied course that examines how the application of big data is made for our human to enhance technical and functional capabilities and how the big data processing efficiency can be facilitated and monitored to achieve well-defined objectives. As it is well known that an optimized result made by Artificial Intelligence (AI) could not be significantly achieved without big data feedings. Nowadays, there are diversity of data type (mostly of non-structured ones) spreading on the air and pipelines, furthermore we are generating much more data and faster than ever before, and the application of big data does impact our daily life. Although we can store and process the data, there are problems using existing techniques to accommodate our most interests. For example, both accessing the data from disk in distributed systems and getting data to the processors are of the typical bottlenecks. This course is designed to not only introduce students to Hadoop Big Data application and trend, but also its processing technology and ecosystems which are capable of eliminating the bottlenecks by its unique methods for storing and processing data per common application scenario. In addition, the course provides the platforms for students’ paper reading, group/squad discussion, co-work assignment, case studies and presentation. The course will introduce Apache Hadoop core technologies and administration with its major including: Big Data (BD) in demand and its application trend, Core technologies of Hadoop for BD management, Hadoop Administration and management tool, Hadoop cluster deployment,YARN applications plus MapReduce, Hadoop cluster hardware and software, Introduction of Hadoop ecosystem projects, HDFS configuration for high availability (HA), Hadoop security, Cluster resource scheduling and configuration, and Hadoop certification program, etc.. 由於雲端運算的快速發展，大量資料收集與儲存技術已成瓶頸，大數據技術與管理提供一套具延展性與容錯能力的分散儲存與計算架構, 能有效處理大量複雜數據資料的儲存與運算。本課程除介紹現有的大數據生態與趨勢，並針對目前軟硬體架構的處理瓶頸，提供系統組態與部署、服務層級協定、監控與管理等系統性規劃的解決方案，並導入跨領域的工程管理科學知識。課程簡扼論述大數據技術與管理的重要，並在Hadoop生態系統中，以Cloudera Hadoop為應用範例，實作說明其重要性。課程內容包括：大數據的概念、應用生態與趨勢、Hadoop硬體規格與基礎架構規劃、叢集組態與部署、叢集服務層級協定、叢集監控與管理、相關生態技術、及概略介紹Hadoop認證與準備。

課程進度 Day-1 Week#5 17/Oct  Introduction of the Syllabus, preliminary and performance calibration  Big Data in demand and its application trend  Core technologies of Hadoop for Big Data management Day-2 Week#6 24/Oct  Management tool to simplify Hadoop Administration  Hadoop cluster deployment  YARN applications including MapReduce Day-3 Week#9, 14/Nov  Hadoop cluster hardware and software  Deployment of Hadoop ecosystem projects Day-4 Week#12 5/Dec  HDFS configuration for high availability  Hadoop security Students’ teamwork and presentations Day-5 Week#13 12/Dec  Cluster resource scheduling and configuration  Cluster monitoring and management Students’ teamwork and presentations Day-6 Week#14 19/Dec  Industrial Big Data and Ecosystems development and case studies  Students’ teamwork and presentations Students' study and learning assessment

評量方式與標準 1. Group Assignments+Presentation+Question/Answer 50% 2. Study and Learning Assessment 30% 3. Participation 20%

使用教材、參考書目或其他 【遵守智慧財產權觀念，請使用正版教科書，不得使用非法影印教科書】

使用外文原文書：是
TEXTBOOK AND READINGS In-class handout and research papers downloaded from internet. Research Paper Readings – (Google’s issued papers) 1. The Google File System; https://static.googleusercontent.com/media/research.google.com/zh-TW//archive/gfs-sosp2003.pdf 2. MapReduce: Simplified Data Processing on Large Clusters; https://static.googleusercontent.com/media/research.google.com/zh-TW//archive/mapreduce-osdi04.pdf 3. Big Data associated, To-Be-Advised in class Additional Reading Reference 1. Hadoop: The Definitive Guide, Fourth Edition, April 2015, Published by O’Reilly Media, Inc., Editor: Tom White 2. Hadoop Essentials, First Edition, April 2015, Published by O’Reilly Media, Inc., Editor: Shiva Achari. 3. Hadoop Operation, First Edition, September 2012, Published by O’Reilly Media, Inc., Editor: Eric Sammer

課程諮詢管道

課程對應SDGs指標

備註

教師姓名	王怡鈞
Email	bnwntut8@ntut.edu.tw
最後更新時間	2020-09-07 11:12:07
課程大綱	This is a science applied course that examines how the application of big data is made for our human to enhance technical and functional capabilities and how the big data processing efficiency can be facilitated and monitored to achieve well-defined objectives. As it is well known that an optimized result made by Artificial Intelligence (AI) could not be significantly achieved without big data feedings. Nowadays, there are diversity of data type (mostly of non-structured ones) spreading on the air and pipelines, furthermore we are generating much more data and faster than ever before, and the application of big data does impact our daily life. Although we can store and process the data, there are problems using existing techniques to accommodate our most interests. For example, both accessing the data from disk in distributed systems and getting data to the processors are of the typical bottlenecks. This course is designed to not only introduce students to Hadoop Big Data application and trend, but also its processing technology and ecosystems which are capable of eliminating the bottlenecks by its unique methods for storing and processing data per common application scenario. In addition, the course provides the platforms for students’ paper reading, group/squad discussion, co-work assignment, case studies and presentation. The course will introduce Apache Hadoop core technologies and administration with its major including: Big Data (BD) in demand and its application trend, Core technologies of Hadoop for BD management, Hadoop Administration and management tool, Hadoop cluster deployment,YARN applications plus MapReduce, Hadoop cluster hardware and software, Introduction of Hadoop ecosystem projects, HDFS configuration for high availability (HA), Hadoop security, Cluster resource scheduling and configuration, and Hadoop certification program, etc.. 由於雲端運算的快速發展，大量資料收集與儲存技術已成瓶頸，大數據技術與管理提供一套具延展性與容錯能力的分散儲存與計算架構, 能有效處理大量複雜數據資料的儲存與運算。本課程除介紹現有的大數據生態與趨勢，並針對目前軟硬體架構的處理瓶頸，提供系統組態與部署、服務層級協定、監控與管理等系統性規劃的解決方案，並導入跨領域的工程管理科學知識。課程簡扼論述大數據技術與管理的重要，並在Hadoop生態系統中，以Cloudera Hadoop為應用範例，實作說明其重要性。課程內容包括：大數據的概念、應用生態與趨勢、Hadoop硬體規格與基礎架構規劃、叢集組態與部署、叢集服務層級協定、叢集監控與管理、相關生態技術、及概略介紹Hadoop認證與準備。
課程進度	Day-1 Week#5 17/Oct  Introduction of the Syllabus, preliminary and performance calibration  Big Data in demand and its application trend  Core technologies of Hadoop for Big Data management Day-2 Week#6 24/Oct  Management tool to simplify Hadoop Administration  Hadoop cluster deployment  YARN applications including MapReduce Day-3 Week#9, 14/Nov  Hadoop cluster hardware and software  Deployment of Hadoop ecosystem projects Day-4 Week#12 5/Dec  HDFS configuration for high availability  Hadoop security Students’ teamwork and presentations Day-5 Week#13 12/Dec  Cluster resource scheduling and configuration  Cluster monitoring and management Students’ teamwork and presentations Day-6 Week#14 19/Dec  Industrial Big Data and Ecosystems development and case studies  Students’ teamwork and presentations Students' study and learning assessment
評量方式與標準	1. Group Assignments+Presentation+Question/Answer 50% 2. Study and Learning Assessment 30% 3. Participation 20%
使用教材、參考書目或其他	【遵守智慧財產權觀念，請使用正版教科書，不得使用非法影印教科書】使用外文原文書：是 TEXTBOOK AND READINGS In-class handout and research papers downloaded from internet. Research Paper Readings – (Google’s issued papers) 1. The Google File System; https://static.googleusercontent.com/media/research.google.com/zh-TW//archive/gfs-sosp2003.pdf 2. MapReduce: Simplified Data Processing on Large Clusters; https://static.googleusercontent.com/media/research.google.com/zh-TW//archive/mapreduce-osdi04.pdf 3. Big Data associated, To-Be-Advised in class Additional Reading Reference 1. Hadoop: The Definitive Guide, Fourth Edition, April 2015, Published by O’Reilly Media, Inc., Editor: Tom White 2. Hadoop Essentials, First Edition, April 2015, Published by O’Reilly Media, Inc., Editor: Shiva Achari. 3. Hadoop Operation, First Edition, September 2012, Published by O’Reilly Media, Inc., Editor: Eric Sammer
課程諮詢管道
課程對應SDGs指標
備註