Software, Digital Content, Geopolitics, Economics & More from of a Libertarian Serial Expat and Entrepreneur
The document explains all the steps over five years from one shared server to the current infrastructure, with users spread around database clusters, two proxy/load-balancing layers (at the IP and HTTP levels), and caching handled by memcached (also used by Slashdot, Wikipedia, Meetup – handles 100,000 queries/second at peaks with a 90-93% hit rate). It all started as a "college hobby project"!
Update (somewhat related): Adam Bosworth: Where have all the good databases gone.
05/30/07 update: A bunch of presentations on scaling websites: twitter, Flickr, Bloglines, Vox and more., Inside Myspace.com, What powers Curse Gaming.
08/24/07 update: High scalability blog.
I'm CEO of an online trade publishing firm in the marketing and defense verticals. We try to make news and data digestible and useful in an environment that is more noisy each day. This personal blog mixes my thoughts and interests on politics, business, software, and more, based on my business and personal experiences. Over the years I have posted items that turned out spectacularly wrong, and a few posts that stood the test of times better. Personal views only.