Spring, 2023
|
|
|
|
|
|
|
||
|
Lecture |
Date |
Lecture Topics |
Readings and Resources |
Homeworks |
| 0 | M 1/9 | Administrative matters |
Syllabus: HTML |
Review tutorials as listed in Useful Links above, as needed. You can ignore the tutorials on Latex and Pandas for the present. |
| 1 | W 1/11 |
What is AI? Slides: PDF |
Optional: Here is a long conversation that the Google engineer had with GPT-3 that convinced him it is sentient. He's wrong, but it is quite stunning! I wonder what Turing would have made of this. |
Video Walkthrough of HW 01: HTML HW 1 Solution: ZIP |
| 2 | M 1/16 | Introduction to Logic; Truth and Proof; Propositional Logic Slides: PDF Video Recording: HTML |
Ertel& Ch. 2.1 - 2.3 |
|
| 3 | W 1/18 | Theorem Proving in Propositional Logic Slides: PDF Video Recording: HTML Short Addendum to Lecture: HTML |
Ertel& Ch. 2.4 - 2.5 |
HW 2 Solution: ZIP |
| 4 | M 1/23 | First-Order Logic; Syntax and Semantics of FOL Slides: PDF Video Recording: HTML |
Ertel& Ch. 3.1 & 3.2 |
|
| 5 | W 1/25 | Resolution Theorem Proving in FOL; Unification Slides: PDF Video Recording: HTML |
Ertel& Ch. 3.3 - 3.5 |
|
| 6 | M 1/30 | Horn-Clause Logic; Programming in Prolog Slides: PDF Video Recording: HTML |
Ertel& Ch. 5.1 - 5.6 |
|
| 7 | W 2/1 | Problem solving with search: Uninformed Search Slides: PDF Video Recording: HTML |
Ertel& Ch. 6.1 - 6.2 |
|
| 8 | M 2/6 | Heuristic search Video Recording: HTML |
Ertel& Ch. 6.3 Beautiful tutorial on A* and heuristic search in general: HTML |
HW 3 (due 2/19): ZIP Video Walk-through for HW 03: HTML HW 3 Solution: ZIP |
| 9 | W 2/8 | A* search; Game-playing with adversarial search Slides: PDF Video Recording: HTML |
Ertel& Ch. 6.4 |
|
| 10 | M 2/13 | Alpha-Beta Pruning; Miscellaneous Refinements to Game-Tree Search
Slides: PDF Video Recording: HTML |
Ertel& Ch. 6.5 - 6.6 |
|
| 11 | W 2/15 | Review of Reasoning with Probabalities; Bayesian Reasoning; Maximum Likelihood Estimation
Slides: PDF Video Recording: HTML |
A good overview of probability, both frequentist and Baysian: PDF Equally good overview of maximum likelihood estimation: PDF Brilliant 3Blue1Brown tutorial on Bayesian Reasoning: HTML |
|
| 12 | M 2/20 | Stochastic Models, Markov Chains, and Hidden Markov Models Slides: PDF Video Recording: HTML |
Ertel& 7.4 |
|
| 13 | W 2/22 | Application: Tagging with Hidden Markov Models Slides: PDF Video Recording: HTML |
HW 4: ZIP (due T 3/14)
Video Walkthrough: HTML |
|
| 14 | M 2/27 | Introduction to Machine Learning; Unsupervised Learning: Clustering with K-Means Slides: PDF Video Recording: HTML |
|
|
| W 3/1 | Class cancelled |
|
||
| Week 3/6 - 3/10 | SPRING BREAK |
|||
| 15 | M 3/13 | K-Means concluded; Survey of Clustering Algorithms; Dimensionality Reduction with PCA Slides: PDF Video Recording: HTML |
Medium Article on Clustering Algorithms: HTML (behind a paywall) Same article in PDF form without animations (free): PDF |
|
| 16 | W 3/15 | Reinforcement Learning Introduction
Slides: PDF Video Recording: HTML |
Ertel Ch. 10 A decent introduction to RL on Medium: HTML Summary of current applications of RL: HTML |
|
| 17 | M 3/20 | Genetic Algorithms; The Prisoner's Dilemma Slides: PDF Video Recording: HTML |
Basic tutorial on Genetic Algorithms: HTML |
|
| W 3/22 | Lecture Cancelled | |||
| 18 | M 3/27 | Reinforcement Learning: Markov Decision Processes; Q-Learning
Slides: PDF Video Recording: HTML |
Gentle Introduction to Q-Learning: HTML |
|
| 19 | W 3/29 | Introduction to Artificial Neural Networks; Perceptrons; Feedforward Networks; Backpropagation
Slides: PDF Video Recording: HTML |
Stanford Tutorial on Deep Learning: HTML Outstanding tutorial and animation of how NN's work: Ch 1, Ch 2, Ch 3, Ch 4 Well-done article (with diagrams and an example) on backpropagation: HTML |
HW 5 (due Monday 4/17): ZIP
HW 5 Walkthough Video: HTML |
| 20 | M 4/3 | Training and evaluation workflow for text classification with FF Networks
Slides: PDF Video Recording: HTML |
Reading posted in Piazza Resources. |
|
| 21 | W 4/5 | Overfitting, Generalization, Convolutional networks for image classification Slides: PDF Video Recording: HTML |
Notebooks referrred to have been uploaded to Piazza Resources |
|
| 22 | M 4/10 | Sequence data: N-Gram models, Recurrent Networks Slides: PDF Video Recording: HTML |
Beautiful Tutorial on NNs for NLP:PDF |
|
| 23 | W 4/12 | Sequence to sequence models: RNNs, Encoder-Decoders, Attention Slides: PDF Video Recording: HTML |
Funny and perceptive presentation of ethical issues about generative models by comedian John Oliver: HTML |
Team Project (hard deadline: midnight 4/28) |
| 25 | M 4/17 | Patriots Day (Marathon Monday): |
||
| 26 | W 4/19 | Last Class: Transformers and LLMs Slides: PDF Video Recording: HTML |
||
| 4/21 - 28 | Final Exam Period |