Think of it more like your brain is lying to you about your energy levels and that exercise is calling your brain's bluff. Writing off exercise without trying it is like the Israelites writing off looking at the brass serpent.
It's a mistake to assume that people who don't currently exercise are doing this.