Slides

English slides, Mandarin delivery — 6 of 14 weeks ready

The slides are written in English to accompany the Mandarin lectures. Each deck is a reveal.js page — open it in a browser, nothing to install.

提示Keyboard shortcuts

B chalkboard layer for writing on a slide · ESC slide overview · F full screen · add ?print-pdf to the URL to print

Week Topic Slides
W1 A Systems View of Spoken Dialogue and the Latency Budget
語音對話系統的系統觀與延遲預算
▶ Open
W2 Speech Signals, Auditory Front-Ends, and the Physics of Representation
語音訊號、聽覺前端與表徵的物理基礎
▶ Open
W3 The Alignment Problem: From HMM to CTC
對齊問題:從 HMM 到 CTC
▶ Open
W4 Sequence Models and Streaming Architectures: Transformer, Conformer, RNN-T
序列模型與 streaming 架構:Transformer、Conformer、RNN-T
▶ Open
W5 Self-Supervised Representation Learning: Where Speech Foundation Models Come From
自監督表徵學習(SSL):語音基礎模型的來源
▶ Open
W6 Neural Audio Codecs and Discretization: Turning Speech into a Language
Neural Audio Codec 與離散化:語音成為「語言」的關鍵一步
▶ Open
W7 Speech Recognition: Three Paradigms, Streaming, and the LLM Turn
語音辨識:三種範式、streaming 與 LLM 化
Not yet available
W8 Speech Synthesis I: Generative Paradigms and Streaming TTS
語音合成 I:生成範式與 streaming 合成
Not yet available
W9 Speech Synthesis II: Controllability, Post-Training Alignment, Evaluation, and Misuse
語音合成 II:可控性、後訓練對齊、評估與濫用防範
Not yet available
W10 The Physical Layer of Full-Duplex: VAD, AEC, Enhancement, Separation, Speaker
全雙工的「物理層」:VAD、AEC、增強、分離與說話人
Not yet available
W11 Audio-Native Language Models: Building Half-Duplex Spoken Dialogue
Audio-Native 語言模型:半雙工語音對話的建成
Not yet available
W12 Full-Duplex I: Linguistic Foundations and Modeling of Turn-Taking
全雙工 I:Turn-Taking 的語言學基礎與建模
Not yet available
W13 Full-Duplex II: Architectures, Multi-Stream Modeling, and Data
全雙工 II:架構路線、多串流建模與資料問題
Not yet available
W14 Evaluation, Alignment, Deployment, and Open Problems
評估、對齊、落地與 Open Problems
Not yet available

The decks embed audio, so check that sound is on. Some clips are channel-separated (left = user, right = model); headphones or stereo speakers are recommended.

回到頂端