The model is frozen and stateless
Weights are fixed after training; no memory between calls; it confabulates.
1It got the date wrong, confidently. Tap the next word you think it scored highest.your turn
you ask
What's today's date?
frozen model · no memory · knowledge cutoff
Today is October 12th, 2023.
…stated with total confidence.
next-token prediction · it picks the highest scoretap one
→ continue← backR replay
What if we hand it the right documents?
5.2 RAG: retrieval as a callback to similarityBuilds on2.1Predict the next word
Common questions
What is "The model is frozen and stateless" about?
Weights are fixed after training; no memory between calls; it confabulates.
What problem does it solve?
Ask the model today's news or your private doc: it can't know.
What will I be able to do after this lesson?
You can explain why a frozen model hallucinates and has a knowledge cutoff.
What comes next?
What if we hand it the right documents?