I'm in a similar situation and have no idea how to solve it.
I've been thinking of pulling together a mastermind of other programmers-turned-executive so we can talk about these problems together. I'm seriously peter principally-ing over here. ;)
Anybody interested?
Me:
Mid 30s Director of Technology Team of 10 + part timers. No College. Two failed saas products.