Simon Willison’s Weblog

Subscribe

Items tagged llms, washingtonpost in Apr, 2023

Filters: Year: 2023 × Month: Apr × llms × washingtonpost × Sorted by date


Inside the secret list of websites that make AI chatbots sound smart. Washington Post story digging into the C4 dataset—Colossal Clean Crawled Corpus, a filtered version of Common Crawl that’s often used for training large language models. They include a neat interactive tool for searching a domain to see if it’s included—TIL that simonwillison.net is the 106,649th ranked site in C4 by number of tokens, 189,767 total—0.0001% of the total token volume in C4. # 19th April 2023, 1:35 pm

Types

Years

Months

Tags