Simon Willison’s Weblog

5th September 2023 - Link Blog

A token-wise likelihood visualizer for GPT-2. Linus Lee built a superb visualization to help demonstrate how Large Language Models work, in the form of a video essay where each word is coloured to show how “surprising” it is to the model. It’s worth carefully reading the text in the video as each term is highlighted to get the full effect.

Posted 5th September 2023 at 3:39 am

Recent articles

Live blog: Code w/ Claude 2026 - 6th May 2026
Vibe coding and agentic engineering are getting closer than I'd like - 6th May 2026
LLM 0.32a0 is a major backwards-compatible refactor - 29th April 2026

This is a link post by Simon Willison, posted on 5th September 2023.

ai 2005 generative-ai 1777 llms 1742 gpt-2 13

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe