It must depend on the person. I used to smoke and drink coffee and it was much easier for me to quit smoking. I just stopped one day (12 years ago) and never looked back.
In contrast quitting caffeine took me several tries and I had to very carefully taper over the course of months to eventually be able to do it.
I also quit alcohol and that was pretty easy too. I used to drink every day and then I stopped without much trouble.