I'm not sure that would be very habitable. Unless they're far apart, the neutron star/black hole would be accreting matter from its companion and the accretion disk would be emitting large amounts of x-rays. In some cases, they can occasionally increase in luminosity by a factor of 10, emitting powerful bursts of x-rays.