Generative AI & language models
Pre-training
Definition
The first large training stage where a model learns broad patterns from a huge dataset.
Visual example
Culinary school = pre-training
The kitchen connection
Think of general culinary school.
The illustration connects the AI idea to something familiar. Follow the subject, the action, and the result to see how it works.
- 01 · Who or what
- Culinary school = pre-training
- 02 · What happens
- Studies a huge collection first
- 03 · The result
- Builds broad starting knowledge
Why it matters
It gives a model the broad language and world patterns it needs before specialization.