Plain-language explainer
Word vector analogies, explained
Why does king minus man plus woman land near queen?
Because when words become vectors, relationships become directions. In a well-trained embedding space, the arrow from man to woman points roughly the same way as the arrow from king to queen: a 'gender direction' the model learned purely from how words co-occur in text. Add that arrow to king and you land near queen. The famous demo, from word2vec in 2013, was the first striking proof that meaning could be geometry, the idea every modern model is built on.
Do not just read it. Operate the mechanism yourself in a short interactive lesson.
See it work: Embeddings: meaning as coordinates →Free, no code, no signup.
What people get wrong
- It is just a party trick. The property behind it, relations as directions, is exactly why semantic search and recommendations work.
- Chat models answer analogies by doing this arithmetic. It is a property of the embedding space, not the procedure the model runs.
- The math is exact. Analogies are approximate and the showcased examples are the ones that land; plenty of others miss.
Where you see it in real products
- Search engines match 'cheap flights' to 'low-cost airfare' because both live in the same region of the space.
- 'Similar items' recommendations are nearest neighbors in an embedding space.
- Every ML course opens with this demo because it makes vectors mean something.
Related explainers
Part of See How AI Works, a free interactive course, where you learn how modern AI works by operating it, not watching videos.