Simon Willison’s Weblog

Crowbar. Headless Gecko/XULRunner which exposes a web service API for screen scraping using a real browser DOM—just pass it the URL of a page and the URL of a screen scraping JavaScript script (a bit like a Greasemonkey user script) and get back RDF/XML.

Posted 24th January 2009 at 11:52 pm

Recent articles

Vibe scraping and vibe coding a schedule app for Open Sauce 2025 entirely on my phone - 17th July 2025
Happy 20th birthday Django! Here's my talk on Django Origins from Django's 10th - 13th July 2025
Grok: searching X for "from:elonmusk (Israel OR Palestine OR Hamas OR Gaza)" - 11th July 2025

crowbar 1 dom 13 gecko 4 greasemonkey 54 mozilla 112 rdf 5 scraping 37 webservice 3 xml 103 xulrunner 3

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe