Clicked Gallery

Overfitting vs. Underfitting: What's the Difference?

Highlighted from a real engineering doc. Explained by Clicked.

Used in a sentence

Engineering Notes · AI Systems

The model memorized the training set perfectly but failed on real test data, displaying classic signs of overfitting.

The reader highlighted one word in the docs. Clicked explained the technical term “overfitting” in simple terms:

Explained in three depths

Same facts, different vibe — Slang mode 😎

The Clicked way

●○○

Overview

Overfitting is a model learning its training data too specifically, noise included, so it aces training and stumbles on anything new. Underfitting is the opposite: a model too simple to learn the pattern at all, so it fails everywhere.
●○○

Overview

Overfitting: the model didn't learn the subject, it memorized the answer key — coffee stains included. Underfitting: it didn't even open the book. Both flunk real life; they just flunk it differently. 😎

A quick take — often all you need.

●●○

Detail

The tell is the gap between two numbers: the model's score on the data it trained on, and its score on held-back data it has never seen. Underfitting scores poorly on both, because the model never captured the pattern. Overfitting scores excellently on training data and clearly worse on held-back data, having memorized its study material instead of learning the subject. Overfitting comes from too much model complexity, too little data, or training too long; underfitting from a model too simple or fed weak inputs. The fixes mirror the causes: more data, regularization or a simpler model against overfitting; a richer model or better inputs against underfitting. One distinction to keep straight: these are the symptoms in the scores, while high bias and high variance are the diagnoses behind them.
●●○

Detail

How you catch it: compare two scores. Ninety-nine percent on the questions it studied and 60% on questions it's never seen — that gap is the confession that it memorized instead of learning. Mediocre on both instead? It never learned anything to begin with. The fixes are pure parenting: for the memorizer, more examples, an end to the all-night cramming, and less memorization capacity; for the slacker, a bigger brain, more study time, better material. And the golden rule of the whole field: never grade a model on questions it has already seen. 😎

Want more? One click digs deeper.

●●●

Analogy

Learning to drive only in your own driveway: every crack and bump memorized, every maneuver flawless, and then the highway is chaos, because you learned the driveway rather than driving. That's overfitting. Underfitting is having had one vague lesson — the car moves when the pedal is pressed — which fails in the driveway and on the highway alike.
Deepest level reached.
●●●

Analogy

The karaoke legend who learned exactly ONE song, phonetically: note-perfect every Friday night, but request anything else — or the same song in a different key — and it collapses into static. Meanwhile the underfitting guy just hums vaguely through everything. Neither of them can actually sing.
Deepest level reached.

Unfamiliar concept? A real-world example makes it click — fresh analogies on tap.

AI explanations may contain errors · Not professional advice

Formal definition — The same term, explained the usual way

Overfitting denotes a model that captures sample-specific noise in the training data, achieving low training error but degraded generalization; underfitting denotes insufficient capacity or training to capture the underlying signal, yielding elevated error on both training and held-out data. Detection relies on the divergence between training and validation performance. Mitigations include regularization, early stopping, data augmentation, and capacity reduction for overfitting, and increased model capacity, extended training, and improved feature representation for underfitting.

Want Clicked to explain terms like “overfitting” directly in your browser — including on PDFs?

Add to Chrome — Free

50 free Explanations · No credit card required