That’s my experience too. It’s so infuriating!

The solution is to disable Wake Timers.