AI Roadmaps
← All roadmaps
BeginnerRoadmap 02 · 14 steps · 5h 10m of video

Machine Learning

Classic ML the way practitioners use it: regression, trees, boosting, evaluation, and scikit-learn.

Before this: Python & Math for AI.

  1. 7 min
    Step 1

    Bias and variance

    The trade-off behind every modeling decision.

    Machine Learning Fundamentals: Bias and Variance

    StatQuest with Josh Starmer

    microsoft/ML-For-Beginners★ 92.3k
  2. 27 min
    Step 2

    Linear regression

    The simplest model, and the one everything else gets compared to.

    Linear Regression, Clearly Explained!!!

    StatQuest with Josh Starmer

  3. 24 min
    Step 3

    Gradient descent

    How models actually learn, step by step.

    Gradient Descent, Step-by-Step

    StatQuest with Josh Starmer

  4. 9 min
    Step 4

    Logistic regression

    Your first classifier, and still a strong baseline.

    StatQuest: Logistic Regression

    StatQuest with Josh Starmer

  5. 6 min
    Step 5

    Cross-validation

    How to know if your model works on data it hasn't seen.

    Machine Learning Fundamentals: Cross Validation

    StatQuest with Josh Starmer

  6. 7 min
    Step 6

    The confusion matrix

    Accuracy lies. Precision and recall don't.

    Machine Learning Fundamentals: The Confusion Matrix

    StatQuest with Josh Starmer

  7. 16 min
    Step 7

    ROC and AUC

    Compare classifiers across every threshold at once.

    ROC and AUC, Clearly Explained!

    StatQuest with Josh Starmer

  8. 18 min
    Step 8

    Decision trees

    Readable models that split data into simple rules.

    Decision and Classification Trees, Clearly Explained!!!

    StatQuest with Josh Starmer

  9. 10 min
    Step 9

    Random forests

    Many trees beat one tree. Still a top choice for tabular data.

    StatQuest: Random Forests Part 1 - Building, Using and Evaluating

    StatQuest with Josh Starmer

  10. 16 min
    Step 10

    Gradient boosting

    The idea behind the models that win Kaggle tabular competitions.

    Gradient Boost Part 1 (of 4): Regression Main Ideas

    StatQuest with Josh Starmer

  11. 26 min
    Step 11

    XGBoost

    The library that made boosting fast and famous.

    XGBoost Part 1 (of 4): Regression

    StatQuest with Josh Starmer

  12. 8 min
    Step 12

    K-means clustering

    Find groups in data with no labels.

    StatQuest: K-means clustering

    StatQuest with Josh Starmer

  13. 6 min
    Step 13

    PCA

    Squash many features into a few you can actually look at.

    StatQuest: PCA main ideas in only 5 minutes!!!

    StatQuest with Josh Starmer

  14. 2h 09m
    Step 14

    Scikit-learn in practice

    Put it all together with the library everyone uses.

    Scikit-learn Crash Course - Machine Learning Library for Python

    freeCodeCamp.org

    ageron/handson-ml3★ 14.5k

Build it

Watching isn't learning. Pick one and put it on GitHub.

Where to go next