Simon Willison’s Weblog

"Last I heard Google's search index was sharded by document rather than by term.". Fascinating comment by jasonwatkinspdx on Hacker News.

Posted 8th October 2010 at 8:03 pm

Recent articles

Useful patterns for building HTML tools - 10th December 2025
Under the hood of Canada Spends with Brendan Samek - 9th December 2025
Highlights from my appearance on the Data Renegades podcast with CL Kao and Dori Wilson - 26th November 2025

google 391 search-engines 37 recovered 213

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe