Agreed. And he probably doesn't even have to. (Incidentally, swing by your local big box store at closing time and ask the guys in plumbing if they want to make $500 or $1000 by putting in a water heater tonight; that worked for me, anyway, even on a Friday night.)
I just paid $4,000 for a very experienced plumber and his apprentice to replace a tankless water heater that I could buy new on Ebay for $1,200. That extra $2,800 was pure profit for a job that took four or five hours, and I also had to wait a day before he could fit me in.