We used a deterministic aperture load balancing to solve this at twitter - https://blog.x.com/engineering/en_us/topics/infrastructure/2....
Cool to see some other approaches, although I believe they've complicated theirs a bit more than necessary.
Cool to see some other approaches, although I believe they've complicated theirs a bit more than necessary.
I heard about someone using PO2C for cache eviction recently. Maybe Oxide talking about their storage work? Seems obviously smart. No need to keep LRU or carefully track & decide, just use statistics to compare two random elements and drop the least used one.