This repository provides course materials of the Natural Language Processing course at NTHU (instructor: Prof. Hung-Yu Kao).
| TA Hour | |
|---|---|
| Mon. | 15:30 ~ 16:30 |
| Wed. | 15:30 ~ 16:30 |
| Location | 台達館(Delta) 714 |
TA email: nthuikmlab@gmail.com
Slido：Slido
| Week | Topics | Slide | Video | HW |
|---|---|---|---|---|
| W1 | 課程簡介 Syllabus / Introduction to NLP | Syllabus W1 |
Video |
|
| W2 | 自然語言處理簡介 (1/2) Introduction to NLP (vector space, indexing, parts of speech, phrase structure) | |||
| W3 | 自然語言處理簡介 (2/2) Introduction to NLP (Language model) | |||
| W4 | 基礎文字資料機器學習 (1/2) Basic machine learning for text (Text Classification, NB, NN) | |||
| W5 | 基礎文字資料機器學習 (2/2) Basic machine learning for text (word embedding, text representation) | |||
| W6 | Python for text tutorial (1/2) | |||
| W7 | Python for text tutorial (2/2) | |||
| W8 | 文字生成式AI簡介(1/3) Introduction to GAI (text): Word Embeddings, Language Modeling (RNN), Sequence-to-sequence Models, and Attention Mechanisms, Sub-word Tokenization; Transformers | |||
| W9 | 文字生成式AI簡介(2/3) Introduction to GAI (text): ELMo, BERT, GPT, and T5 (BERT and its Family) | |||
| W10 | 文字生成式AI簡介(3/3) Introduction to GAI (text): Decoding Strategies and Evaluations for Natural Language Generation | |||
| W11 | 大語言模型簡介與訓練 (1/3): Large language model concept and training (GPT-3, InstructGPT, RLHF) | |||
| W12 | 大語言模型簡介與訓練 (2/3): Parameter Efficient Fine-Tuning (PEFT) | |||
| W13 | 大語言模型簡介與訓練 (3/3): Introduction and Review technique of Retrieval Augmented Generation (RAG) I | |||
| W14 | Exam | |||
| W15 | 大語言模型簡介與訓練 (3/3): Introduction and Review technique of Retrieval Augmented Generation (RAG) II | |||
| W16 | Reasoning / Agent | |||
| W17 | - | |||
| W18 | - |
- Italics: Tutorial