Simon Willison’s Weblog

Subscribe

Scalability: What is the best way to store and serve hundreds of GB of images for a heavy traffic website?

17th September 2012

My answer to Scalability: What is the best way to store and serve hundreds of GB of images for a heavy traffic website? on Quora

If you’re not going to use a service like S3, your best bet is to run something like MogileFS (which was designed by LiveJournal for handling images) and stick Varnish (a screamingly fast HTTP caching server) in front of it.

Posted 17th September 2012 at 6:10 pm · Follow me on Mastodon, Bluesky, Twitter or subscribe to my newsletter

More recent articles

This is Scalability: What is the best way to store and serve hundreds of GB of images for a heavy traffic website? by Simon Willison, posted on 17th September 2012.

Next: Did Mark Zuckerberg have any knowledge on building scalable social networks prior to starting work on Facebook?

Previous: What happens at Amazon once I make an order?

Monthly briefing

Sponsor me for $10/month and get a curated email digest of the month's most important LLM developments.

Pay me to send you less!

Sponsor & subscribe