Simon Willison’s Weblog

Subscribe

Items tagged gpt3, projects in Jun, 2023

Filters: Year: 2023 × Month: Jun × gpt3 × projects × Sorted by date


Understanding GPT tokenizers

Large language models such as GPT-3/4, LLaMA and PaLM work in terms of tokens. They take text, convert it into tokens (integers), then predict which tokens should come next.

[... 1570 words]

Types

Years

Months

Tags