why not hire a COO that takes care of it? Don't do jobs that you are not happy with for long. For some short time that is acceptable, but not for long.
I don't count my customers as by bosses. And as long as you don't give yourself the trouble, they are not your bosses. However it is important to focus on them, try to think about them and know what they need before they even know it.