When I later asked my psychiatrist about this he said that since SSRIs and amphetamines are though to complement each other (even if the science on the matter isn't really decided) the recommendation they get is to adjust the dose of SSRIs down. I'm sure the actual reason is more complex than that, maybe involving fears of serotonin syndrome, but my takeaway from it was that the effect is well known.
No idea about coffee in particular since I wasn't allowed to have any caffeine during that time.
The problem with dopaminergics is that they tend to be addictive, and build tolerance. Both Zoloft and Wellbutrin only inhibit a certain percentage of DAT in areas of the brain related to reward, so they aren't exactly abusable, while something like methylphenidate (which is a potent NET and DAT inhibitor) is.