“Despite appearances, an LLM does not actually output text”: The Guardian’s Joseph Lochlann Smith with a myth-busting deep dive. (Medium)
Summary
- LLMs predict likely continuations of conversations, not hold them.
- LLMs operate on tokens (≈ words) represented by vectors, not raw text.
- LLMs output probabilities for the next token, not arbitrary-length text.
