Simon Willison’s Weblog

RSS Duplicate Detection. “Detecting duplicate items in an RSS feed is something of a black art”. I hadn’t realised quite how involved such a basic function of an aggregator could be.

Posted 22nd January 2008 at 8:11 pm

Recent articles

The last six months in LLMs, illustrated by pelicans on bicycles - 6th June 2025
Tips on prompting ChatGPT for UK technology secretary Peter Kyle - 3rd June 2025
How often do LLMs snitch? Recreating Theo's SnitchBench with LLM - 31st May 2025

rss 40 syndication 9 atom 26 duplicates 1 aggregator 1 blackart 1 james-holderness 1

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe