I wrote a cache layer in Go (with limits so it doesn't bloat too much) and I could get 22K req/s instead of the usual 4K.

However, the hit ratio is too low to work. It only protects me from the stampeding herd problem at best.