Simon Willison’s Weblog

Gearman protocol. Notes compiled by Eric Day, principle author of the C server implementation.

# 13th January 2009, 4:44 pm / eric-day, gearman, protocol

New Gearman Server & Library in C, MySQL UDFs. Gearman, the job queue written for LiveJournal and now used by Digg and Yahoo!, has been rewritten in C. Looks like a good candidate for an easily configured lightweight message queue. Also includes hooks for writing MySQL functions that can interact with queues.

# 13th January 2009, 4:41 pm / digg, eric-day, gearman, livejournal, message-queues, mysql, queues, scaling, yahoo

Techniques for safely consuming external HTTP on demand? I asked this question on programming.reddit.com yesterday and got some really insightful answers, including Joe Stump from Digg describing how Digg Images uses Danga’s Gearman worker queue.

# 15th December 2007, 12:29 pm / askreddit, danga, digg, gearman, http, joe-stump, queue, reddit, scaling, workers