Simon Willison’s Weblog

"Last I heard Google's search index was sharded by document rather than by term.". Fascinating comment by jasonwatkinspdx on Hacker News.

Posted 8th October 2010 at 8:03 pm

Recent articles

V&A East Storehouse and Operation Mincemeat in London - 27th August 2025
The Summer of Johann: prompt injections as far as the eye can see - 15th August 2025
Open weight LLMs exhibit inconsistent performance across providers - 15th August 2025

google 380 search-engines 37 recovered 213

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe