> It's shockingly stable. So much so that resolving the root cause isn't considered a priority and so we've had this running for months.
I don't know why my senses tell me that this is wrong even if you can afford it
I don't know why my senses tell me that this is wrong even if you can afford it
The fix is also hiding other issues that show up. So it degrades over time and eventually you’re stuck trying to solve multiple problems at the same time.
As a Director of Engineering at my last startup, I had an "all hands on deck" policy as soon as any concurrency bug was spotted. You do NOT want to let those fester. They are nondeterministic, infrequent, and exponentially dangerous as more and more appear and are swept under the rug via "reset-to-known-good" mitigations.