I came to the same conclusion as you: in the same way that I don't notice a significant uptick in energy when I drink coffee, maybe I also don't get the withdrawal when I stop. Maybe some people are just weird like that?
Then I did the same thing in my early 40s, and the headaches started on the second day. It was pretty bad actually, and I understood what people meant when they talked about an actual, physical withdrawal period. So, now I think it's just metabolism (or some other characteristic that changes with age), rather than a blanket immunity to the effects.
I love coffee, some days I drink 3 cups, some days I forget to drink any at all.
When people "can't get things done" without their morning coffee, is it general haziness/fogginess or are they experiencing headaches?
So I guess there really must be individual differences.
I use a pre-workout from a very famous supplement brand which includes 175 mg of caffeine and I can definitely tell the difference. I can't tell how much of that is because of the caffeine, because it has more stuff like creatine and L-carnitine among other things, but I cant I feel like I last more doing this and I have more energy.