inPace
All coursesكل الدورات

Maths for ML 4: regression, PCA, mixtures and SVMs

  • about 16 h of lessonsحوالي 16 ساعة من الدروس
  • 10 modulesوحدات · 28 lessonsدروس
  • Englishالإنجليزية

Part 4 of 4, following the free book Mathematics for Machine Learning (Deisenroth, Faisal, Ong). When models meet data (empirical risk, maximum likelihood, MAP, graphical models, model selection), then the four classic problems worked out from first principles: linear regression (and its Bayesian version), principal component analysis, Gaussian mixture models with EM, and support vector machines with kernels. Each lesson opens your own copy of the book (free from mml-book.com; inPace finds it), with notes, 3Blue1Brown videos, interactive explorers, worked exercises with instant feedback, and charts. Plan: 10 days.

byمن إعداد inPace checkedموثّق

Uses a book you download yourself, free:تستخدم كتابًا تحمّله بنفسك مجانًا: Mathematics for Machine Learning. mml-book.com inPace 1.20 or newer finds it on your device.يجده inPace 1.20 أو أحدث على جهازك.

mathmachine learninglinear algebramml book3blue1brownregressionpcagaussian mixture

On these roadmaps:ضمن هذه المسارات: Maths for machine learning, Machine learning, from the maths up

What's insideمحتوى الدورة

Each module ends with tasks. The next module opens when they're done.تنتهي كل وحدة بمهام، وتُفتح الوحدة التالية عند إنجازها.

  1. Day 1: Data, models and learning 4 lessonsدروس · 103 min د
    • Start here10 min د
    • Read: data, models and learning (8.1)slidesشرائح35 min د
    • Read: empirical risk minimization (8.2)slidesشرائح40 min د
    • Watch: But what is a neural network?YouTubeيوتيوب18 min د
    Practical taskمهمة عمليةExplain in your wordsاشرح بكلماتكQuizاختبار · 4 questionsأسئلة
  2. Day 2: Maximum likelihood and MAP 3 lessonsدروس · 85 min د
    • Read: parameter estimation (8.3)slidesشرائح40 min د
    • Read: probabilistic modeling and inference (8.4)slidesشرائح35 min د
    • Explore: MLE vs MAP with a coin10 min د
    Practical taskمهمة عمليةExplain in your wordsاشرح بكلماتكQuizاختبار · 4 questionsأسئلة
  3. Day 3: Graphical models and model selection 3 lessonsدروس · 90 min د
    • Read: directed graphical models (8.5)slidesشرائح30 min د
    • Read: model selection (8.6)slidesشرائح35 min د
    • Check yourself: chapter 825 min د
    Practical taskمهمة عمليةExplain in your wordsاشرح بكلماتكQuizاختبار · 4 questionsأسئلة
  4. Day 4: Linear regression, fitting the parameters 2 lessonsدروس · 90 min د
    • Read: problem formulation and parameter estimation (9.1–9.2)slidesشرائح70 min د
    • Explore: fit a curve20 min د
    Practical taskمهمة عمليةExplain in your wordsاشرح بكلماتكQuizاختبار · 4 questionsأسئلة
  5. Day 5: Bayesian linear regression, and least squares as projection 3 lessonsدروس · 105 min د
    • Read: Bayesian linear regression (9.3)slidesشرائح55 min د
    • Read: maximum likelihood as orthogonal projection (9.4) and further reading (9.5)slidesشرائح20 min د
    • Check yourself: chapter 930 min د
    Practical taskمهمة عمليةExplain in your wordsاشرح بكلماتكQuizاختبار · 4 questionsأسئلة
  6. Day 6: PCA, maximum variance and projection views 3 lessonsدروس · 95 min د
    • Read: PCA problem setting and maximum variance (10.1–10.2)slidesشرائح40 min د
    • Read: the projection perspective (10.3)slidesشرائح40 min د
    • Explore: choose a direction15 min د
    Practical taskمهمة عمليةExplain in your wordsاشرح بكلماتكQuizاختبار · 4 questionsأسئلة
  7. Day 7: PCA in practice, and as a latent variable model 3 lessonsدروس · 100 min د
    • Read: eigenvectors, low-rank approximations and high dimensions (10.4–10.5)slidesشرائح30 min د
    • Read: key steps in practice, and probabilistic PCA (10.6–10.8)slidesشرائح45 min د
    • Check yourself: chapter 1025 min د
    Practical taskمهمة عمليةExplain in your wordsاشرح بكلماتكQuizاختبار · 4 questionsأسئلة
  8. Day 8: Gaussian mixture models and EM 4 lessonsدروس · 135 min د
    • Read: GMMs and parameter learning by maximum likelihood (11.1–11.2)slidesشرائح55 min د
    • Read: the EM algorithm and the latent variable view (11.3–11.5)slidesشرائح40 min د
    • Explore: EM step by step20 min د
    • Check yourself: chapter 1120 min د
    Practical taskمهمة عمليةExplain in your wordsاشرح بكلماتكQuizاختبار · 4 questionsأسئلة
  9. Day 9: Support vector machines, margins and the primal 1 lessonsدروس · 70 min د
    • Read: separating hyperplanes and the primal SVM (12.1–12.2)slidesشرائح70 min د
    Practical taskمهمة عمليةExplain in your wordsاشرح بكلماتكQuizاختبار · 4 questionsأسئلة
  10. Day 10: The dual SVM and kernels 2 lessonsدروس · 85 min د
    • Read: the dual SVM, kernels and numerical solutions (12.3–12.6)slidesشرائح60 min د
    • Check yourself: chapter 1225 min د
    Practical taskمهمة عمليةExplain in your wordsاشرح بكلماتكQuizاختبار · 4 questionsأسئلة

Read a lesson firstاقرأ درسًا أولًا

Start here

This is part 4 of 4 of Mathematics for Machine Learning: the central machine learning problems (Part II, chapters 8 to 12). Everything from parts 1 to 3 comes together here: projections, eigenvectors, gradients, Gaussians, Bayes and convex optimization.

First, get the book (free)

This course follows Mathematics for Machine Learning by Marc Peter Deisenroth, A. Aldo Faisal and Cheng Soon Ong (Cambridge University Press, 2020). The authors give the PDF away for personal use, but it may not be shared, so it is not inside this course. Each lesson opens the right pages of your own copy.

  1. Download the PDF from mml-book.com (the link "PDF of the book").
  2. On this course's page, in the box "This course reads a book you get yourself", press Find it for me. inPace looks in your Downloads, Documents and Desktop folders (on a phone: Download, Documents, Books) and recognizes the book by its title and number of pages, whatever the file is called.
  3. If it's somewhere else, choose the folder or the file yourself.

If inPace warns that the page count is different, you have another printing: the lessons may open a page or two off. The course expects the 412-page PDF from mml-book.com.

Using an older inPace? Before 1.20, rename the file to mml-book.pdf and put it in this course's folder. Before 1.21, the optional task and explanation still count as required. Updating inPace fixes both.

Your plan

Days Module Book
1 Data, models and learning; empirical risk 8.1–8.2
2 Maximum likelihood and MAP 8.3–8.4
3 Graphical models and model selection 8.5–8.6
4 Linear regression: fitting parameters 9.1–9.2
5 Bayesian linear regression; least squares as projection 9.3–9.5
6 PCA: maximum variance and projection views 10.1–10.3
7 PCA in practice, and as a latent variable model 10.4–10.8
8 Gaussian mixture models and EM 11
9 Support vector machines: margins and the primal 12.1–12.2
10 The dual SVM and kernels 12.3–12.6

About 1 to 1.5 hours a day, for 10 days. Chapter 8 is more about ideas than formulas; chapters 9 to 12 are hands-on, and each has an explorer to play with.

How each module works

  • Read lessons open the book at the right pages, with notes under them: what matters most, what to skim, and the intuition behind the formulas. Read with a pencil. The book's examples are worth redoing by hand.
  • Watch lessons play a 3Blue1Brown video that shows the same idea moving. Watch it before or after the reading, whichever you like.
  • Explore lessons are small interactive pages: drag, slide and see the math change.
  • Check yourself pages give you exercises with instant feedback and worked answers. They don't count for anything.
  • Each module ends with a quiz you need 70% to pass to open the next module. There's also a task and a short explanation in your own words: they're optional, but doing them is the best way to make it stick.

Licenseالرخصة: CC-BY-SA-4.0 · Updatedآخر تحديث 2026-11-13

Book (not included): Mathematics for Machine Learning by Marc Peter Deisenroth, A. Aldo Faisal and Cheng Soon Ong, Cambridge University Press 2020, free to download for personal use at mml-book.com. Videos: 3Blue1Brown (Grant Sanderson) on YouTube. Notes, charts, interactive pages, tasks and questions: inPace.

Add to inPaceأضف إلى inPace