A first guess: just the last word
Condition on the previous word(s); n-grams.
1One clue this time, the previous word. After “drinks ___”, what follows?your turn
drinks ___
Tap the word you think comes next.your turn
→ continue← backR replay
Is this prediction good? By how much?
2.3 Loss as a scoreboardBuilds on2.1Predict the next word
Common questions
What is "A first guess: just the last word" about?
Condition on the previous word(s); n-grams.
What problem does it solve?
How much context is enough?
What will I be able to do after this lesson?
You can explain how an n-gram works and why one word of memory isn't enough.
What comes next?
Is this prediction good? By how much?