Skip to content
Back to How Models Learn
OU

Overfitting, Underfitting, and Generalization

Learn why strong training performance can still hide a weak model, and how train, validation, and test behavior reveal what is really happening.

25 minHow Models Learneasy100 XP

Listen to hear this room section by section.

Key Ideas

Work through these sections in order. Each one builds the mental model you need before the checkpoint questions will feel easy.

Underfitting usually means the model or training setup has not captured enough signal to perform well even on the training data. Overfitting is different: the model fits the training data too specifically and fails to carry that performance to fresh examples.

In practice, these regimes often show up as different train-versus-validation patterns. That comparison is more informative than either score on its own.

You've opened 1 of 3 sections. Once the ideas feel clear, move into the checkpoint block below.

Check Your Understanding

These checkpoints reinforce the lesson you just read. If one feels fuzzy, reopen the relevant section above before trying again.

3 checkpoints
1

Task 1

Spot the memorizer

Choose the situation that best represents overfitting.

Which description most clearly shows overfitting?

2

Task 2

Classify the behavior

Match each score pattern to the best diagnosis.

For each pattern, choose the best diagnosis.

Training score is low and validation score is also low.

Training score is excellent but validation drops sharply.

Training and validation are both strong and reasonably close.

3

Task 3

Explain what validation is for

Write a short explanation of how a validation set helps builders make better choices.

What is the purpose of a validation set during model development?

Ready To Move On?

Up next: Evaluation Debug Lab