Simon Willison’s Weblog

23rd June 2020

Release datasette-block-robots 0.1 — Datasette plugin that blocks robots and crawlers using robots.txt

Posted 23rd June 2020 at 2:53 am

Recent articles

Notes on the xAI/Anthropic data center deal - 7th May 2026
Live blog: Code w/ Claude 2026 - 6th May 2026
Vibe coding and agentic engineering are getting closer than I'd like - 6th May 2026

This is a beat by Simon Willison, posted on 23rd June 2020.

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe