Plain-language explainer
The context window, explained
What is a context window, and why does the AI forget things mid-conversation?
The context window is everything the model can see while writing its next word: your messages, its replies, instructions, documents, all measured in tokens up to a fixed limit. It is working memory, not storage. When a conversation outgrows the window, older content is dropped or summarized away, and the model answers as if it never existed. That is why it forgot your name from an hour ago. Nothing was stored, so nothing could be recalled.
Do not just read it. Operate the mechanism yourself in a short interactive lesson.
See it work: What's in the context window →Free, no code, no signup.
What people get wrong
- The AI remembers past conversations. Each request sees only what is inside the window right now, unless a product explicitly saves facts back in.
- A bigger window solves memory. Models tend to use content at the edges better than content buried in the middle, so more room is not automatically more recall.
- The window is measured in words or messages. It is measured in tokens, which is why a long pasted document eats so much of it.
Where you see it in real products
- Starting a new chat wipes everything: fresh window, blank slate.
- Model specs advertise 128k or 1M token windows as a headline feature.
- Memory features exist precisely because the window is finite: they re-inject saved facts each request.
Related explainers
Part of See How AI Works, a free interactive course, where you learn how modern AI works by operating it, not watching videos.