I gave up caffeine a few years ago. I get far fewer headaches, and I've noticed while soldering my hand is now rock solid, no trembling.
For me at least caffeine wasn't giving me any kind of boost, just fighting off the withdrawal symptoms.
I think that's a problem for most people, they think coffee is giving them a boost, but really it's just that they feel relatively better because without it they are suffering withdrawal symptoms.