Am I wrong in thinking that these babies are bred as a result of inter-group conflict and r_pe, rather than voluntarily? I never thought of it as likely to be due to "romance" between species.
If that is the case, it may also be that male homo sapiens weren't strong enough to subdue neanderthal females.