Yeah, I had the same thought when the discussion came around last time. I actually took the source to the simulations (thanks for sharing, rapgenius!) and did some experiments on how random routing performs if it's routing to backends that can handle various #s of concurrent requests.
Here's the writeup: https://www.appneta.com/2013/02/21/the-taming-of-the-queue-m...
(Spoilers: turns out it gets a lot better very quickly.)