Simon Willison’s Weblog

Subscribe

5th September 2020

Release datasette-block-robots 0.2 — Datasette plugin that blocks robots and crawlers using robots.txt
Posted 5th September 2020 at 5:14 pm

Recent articles

This is a beat by Simon Willison, posted on 5th September 2020.

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe