Districts in Manhattan have that problem, and are indeed dead after 9 to 5 hours.
It used to be FiDi was the same, but it's become pretty residential. Still, I know many restaurants there that only open M-F, especially on the eastern side where fewer tourists venture.
Everywhere else in Manhattan is sufficiently residential enough (or in the case of Midtown, touristy enough) to be lively on nights and weekends.