Software, Digital Content, Geopolitics, Economics & More from of a Libertarian Serial Expat and Entrepreneur
The document explains all the steps over five years from one shared server to the current infrastructure, with users spread around database clusters, two proxy/load-balancing layers (at the IP and HTTP levels), and caching handled by memcached (also used by Slashdot, Wikipedia, Meetup – handles 100,000 queries/second at peaks with a 90-93% hit rate). It all started as a "college hobby project"!
Update (somewhat related): Adam Bosworth: Where have all the good databases gone.
05/30/07 update: A bunch of presentations on scaling websites: twitter, Flickr, Bloglines, Vox and more., Inside Myspace.com, What powers Curse Gaming.
08/24/07 update: High scalability blog.
I'm CEO of an online/mobile trade publishing firm in the marketing and defense verticals. We strive to make news and data digestible and useful in an environment that is noisier by the day.
This personal blog mixes my thoughts and interests on politics, business, publishing, software, and more. Over the years I have posted items that turned out spectacularly wrong, and a few posts that better stood the test of time.