And almost no reads. The entire MySQL cluster is a 3 machine setup. 2 in active Master-Slave with auto-promote on the slave. the third was a simple slave for backup
Right. This way, they had 9 frontend PHP servers, each running a 60gb memcache slice. We could loose any 2 frontend servers and the cache system would still be active...
Now, of course there was warm-spare redundancy, but we tested for 150 million hits/day and never maxed out those 12 servers. The warm-spares are there just in case and are spin-upable in less than 30 seconds...
@edorian Well, partially populated caches. They had the source code and servers up, but weren't joined to anything. So they were not receiving live updates. If the need for them arose, a script would promote them into the active cluster, they would prime their caches and then start sending them traffic
A single good sysadmin is worth their weight in gold