In older generations, men spent relatively little time with little kids. I don't know if it was social convention or lack of time. Either way, it seems that now a lot more dads are spending time with kids than 2 generations earlier.
I agree that it is hard, but I would not paint a bleak picture.