Plain-language explainer
Next-token prediction, explained
Is ChatGPT really just predicting the next word?
Yes, and that is not a small thing. The entire model is trained on one objective: given text, guess the next token. Do that near-perfectly across trillions of tokens and the guessing has to absorb grammar, facts, style, code idioms and chains of reasoning-shaped text, because they all improve the guess. Chat is the same trick pointed at a transcript: the model predicts what a helpful assistant would say next, one token at a time.
Do not just read it. Operate the mechanism yourself in a short interactive lesson.
See it work: Predict the next word →Free, no code, no signup.
What people get wrong
- It plans the whole answer before writing. It commits one token at a time; each choice constrains the next.
- Prediction means memorization. The model mostly generalizes patterns; reproducing long passages verbatim is the exception, not the mechanism.
- 'Just autocomplete' means it cannot be capable. The ceiling of the trick rises with scale, which is exactly what the last few years demonstrated.
Where you see it in real products
- The word-by-word streaming you watch in chat apps is the loop, live.
- Your phone keyboard's suggestions are a tiny cousin of the same idea.
- APIs price output per token because tokens are what the model produces, one at a time.
Related explainers
Part of See How AI Works, a free interactive course, where you learn how modern AI works by operating it, not watching videos.