Model Collapse

MEDIUM fear General Audience
A theoretical problem where AI models get dumber over time because they are accidentally trained on AI-generated garbage.

In Plain English

Model collapse is like making a photocopy of a photocopy of a photocopy; eventually, the image becomes a blurry mess. As the internet fills up with AI-generated articles and images, future AI models will inevitably use that synthetic content as training data. If an AI learns from the mistakes and hallucinations of older AI, its quality degrades. To prevent this, companies are desperately seeking high-quality, human-written data.

Real-World Example

A future AI translating languages poorly because it learned from websites that were cheaply translated by older, flawed AI.

← Back to Full Glossary

The AI PulseWhat actually matters in AI, minus the hype — twice a week.
Free forever · unsubscribe anytime · all 14 newsletters
That email did not go through — please check it and try again.