Simon Willison’s Weblog

Subscribe

August 2010

Aug. 1, 2010

My ability to decide how I feel about Wikileaks’ activities is totally annihilated by my ongoing realization that it cannot possibly be real. It’s a plot device in a near-future thriller novel. I mean, seriously, semi-stateless man with an unusual appearance uses an army of anonymous allies to expose governments’ secrets, and posts an insurance file in public with some kind of deadman switch in case he’s taken out by his enemies? That shit does not happen in real life. Julian Assange is a Neal Stephenson character who’s escaped in to the real world.

Tomorrowful on MetaFilter

# 12:30 am / metafilter, wikileaks, recovered, julian-assange, neal-stephenson

Aug. 9, 2010

Airships: a second age. Telegraph profile of Hybrid Air Vehicles, a company that is building a new generation of ultra-lightweight airships at Cardington in Bedford, initially aimed at lengthy surveillance missions over Afghanistan.

# 12:34 pm / airships, zeppelins, recovered

Writing your own traceroute in Python. How to implement traceroute in Python, using the low-level socket module.

# 12:58 pm / networking, python, socket, traceroute, recovered

Closure Compiler Service (via) A hosted version of the Google Closure Compiler (JavaScript minifier) running on App Engine. It has both a user interface and a REST API, which means you can use it as part of an automated build process without needing to set up a local copy of the software.

# 1:17 pm / apis, closure, google, javascript, minification, rest, recovered

Aug. 10, 2010

When all of human endeavor falls under the rubric of the “hack” the word ceases to mean anything. Hack your commute, take public transit! Hack your next dinner party with parlour games. Delightfully clever key hack keeps all your keys on the same ring. Hack Mexican food with a “burrito” sized tortilla! Hack your brain with REM sleep. Hack the sun with a straw hat. Hack hygiene with silver oxide “deodorant”. Hack girls with compliments. Hack your windowsill with a pot of wheatgrass, and hack the sky with the goddamn moon.

qwzybug on Hacker News

# 11:54 am / funny, hacker-news, hacks, recovered

Aug. 11, 2010

The Pac-Man Dossier. Exuberantly detailed. Everything from how collision detection works to the exact pathfinding and target selection algorithms used by the four different ghosts. There’s even a tutorial for playing the legendary 256th level, where an overflow bug corrupts one half of the screen.

# 11:20 am / games, pacman, recovered, game-design

Aug. 14, 2010

Journalism Warning Labels. These are absolutely fantastic. “I’ve been putting them on copies of the free papers that I find on the London Underground. You might want to as well.”

# 11:16 am / journalism, tom-scott, recovered

Aug. 15, 2010

Aug. 16, 2010

Writing Bulletproof Apps with API Errorpoints. This is a very good idea: Web APIs should offer special API endpoints for simulating each of the possible errors that might be returned by the production API.

# 7:12 pm / apis, errors, webapis, recovered

Aug. 17, 2010

Human pylons carry electricity across Iceland. An entry in the “Icelandic High-Voltage Electrical Pylon International Design Competition” proposes giant human-shaped electricity pylons. “The figures can be placed into different poses, with the suggestion that the landscapes could inform the position that the sculpture is placed into. For example, as a power line ascends a hill, the pylons could look as if they’re climbing. The figures could also stretch up to gain increased height over longer spans.”

# 1:38 pm / design, pylons, recovered

Yahoo! Developer Network: Important API Updates and Changes. Some important (and potentially worrying) news about Yahoo! APIs. The BOSS (Build your Own Search Service) API will no longer be free—not an enormous surprise, and hopefully the pricing will be sensible. Most of the other search APIs (including web, news and image search) are being turned off with no replacement, while term extraction and spelling suggestions will be YQL-only. Most worrying, changes to Geo, Maps and Local APIs will be announced in September, with some set to close. I really hope this doesn’t affect the GeoPlanet APIs.

# 6:14 pm / apis, boss, geoplanet, yahoo, yql, recovered

Pictos. Here’s something new: a for-sale font containing a set of beautiful royalty-free icons (like Wingdings, but good) designed to be embedded in web applications using @font-face. Small file sizes, scalable vectors without SVG. Not sure about the accessibility implications though.

# 8:54 pm / fonts, pictos, webfonts, recovered

Aug. 18, 2010

Surfin’ Safari: Announcing... MathML! MathML is now supported by the WebKit nightlies. Worth checking out for the typographical discussion that’s broken out in the comments.

# 1:49 pm / mathml, safari, typography, webkit, recovered

Aug. 20, 2010

A More Royal Royal Opera House. Beautiful piece of work updating the branding for the Royal Opera House, including a strikingly modern take on the original crest.

# 12:08 pm / branding, design, recovered

Polymaps. Absurdly classy: “a JavaScript library for image- and vector-tiled maps using SVG”. It can pull in image tiles from sources such as OpenStreetMap, then overlay SVG paths specified using GeoJSON. The demos make use of GeoJSON tiles for US states and counties hosted on AppEngine. The library is developed by Stamen and SimpleGeo, and released under a BSD license. SVG support in the browser is required.

# 6:46 pm / appengine, geojson, javascript, mapping, polymaps, simplegeo, svg, recovered, stamen-design, openstreetmap

Aug. 21, 2010

Undelete! How to undelete a file accidentally removed using rm on Linux, by grepping through the raw bytes on the hard drive searching for a unique string that was contained in the file. “grep -a -B 25 -A 100 ’some string in the file’ /dev/sda1 > results.txt”

# 10:56 am / linux, sysadmin, recovered

Aug. 22, 2010

A little deeper investigation showed that nothing I had posted on Buzz had gone public since August 6. Nothing. [...] No one noticed. Not even me. It makes me feel like everything I’ve posted over the past four years on Twitter, Jaiku, Friendfeed, Plurk, Pownce, and, yes, Google Buzz, has been an immense waste of time. I was shouting into a vast echo chamber where no one could hear me because they were too busy shouting themselves.

Leo Laporte

# 6:43 pm / google-buzz, social-media, twitter, recovered, leolaporte

Aug. 23, 2010

10K Apart Contest: Cheating by Compressing Your JavaScript and CSS to PNG Images. Fascinating hack: transform your JS and CSS in to coloured pixels, save the result as a PNG to benefit from PNG’s built in compression algorithms, then read the data back out of the PNG and convert it back to text using JavaScript and canvas—all to reduce the on-disk filesize when entering the 10K app competition. Alex’s GithubFinder entry is worth checking out too.

# 9:45 am / 10kapart, alex-le, compression, github, hacks, javascript, png, recovered

PNGStore—Embedding compressed CSS & JavaScript in PNGs. Cal did some further analysis on the CSS/JS to PNG compression trick (including producing some interesting images of jQuery compressed using different image packing techniques) and found it to be slightly less effective than regular GZipping.

# 9:47 am / calhenderson, gzip, png, recovered

Using Freebase Gridworks to Create Linked Data. A very handy tutorial from data.gov.uk’s Jeni Tennison.

# 8:11 pm / data, datagovuk, freebase, gridworks, jenitennison, recovered

Readme Driven Development (via) Tom Preston-Werner advocates for writing the readme before any other code. “Until you’ve written about your software, you have no idea what you’ll be coding.”

# 8:20 pm / tom-preston-werner, recovered

Aug. 24, 2010

What is the history of Django? I’ve been playing with Quora—it’s a really neat twist on the question-and-answer format, which makes great use of friends, followers and topics and has some very neat live update stuff going on (using Comet on top of Tornado). I just posted quite a long answer to a question about the history of Django.

# 5:31 pm / comet, django, history, qna, quora, tornado, recovered

What is the history of the Django web framework? Why has it been described as “developed in a newsroom”?

I was there!

[... 674 words]

What is the highest traffic website built on top of Django?

My best guess would be Disqus. Instagram are pretty enormous these days as well.

[... 31 words]

Aug. 25, 2010

What is the largest production deployment of CouchDB for online use?

The BBC have a pretty big CouchDB cluster, which they use mostly as a replicated key-value store. It’s used by their new identity platform which includes customisation features for iPlayer.

[... 47 words]

Which Solr app for Django is better: Haystack or django-solr-search (solango)?

I’d go with Haystack—while it supports multiple backends, I get the feeling Solr is the principle backend it was developed for. It’s extremely well documented in my opinion, and the SearchQuerySet API it gives you makes running low-level queries really easy if the higher level class-based view it provides don’t do quite what you want.

[... 109 words]

Which major companies are using Solr for search?

The Guardian newspaper uses Solr for its Open Platform Content API. http://www.guardian.co.uk/open-p...

[... 27 words]

Why do some people disable JavaScript in their browser?

For security reasons.

[... 159 words]

In what circumstances should one use “magic quotes” in PHP?

Absolutely never. Magic quotes was a badly designed feature, and PHP has been trying to escape its legacy for years. If you are constructing SQL strings using string concatenation you’re asking for trouble—use prepared statements or a library that interpolates and correctly escapes variables for you.

[... 65 words]

What is the best way to learn about setting up server software for Python based web apps?

I’m a big fan of Fabric for automated deployment scripts. Start by reading this tutorial: http://morethanseven.net/2009/07...

[... 40 words]

2010 » August

MTWTFSS
      1
2345678
9101112131415
16171819202122
23242526272829
3031