Is that a conclusion based on some research? Do you think they refuse to have children in protest?
If a woman has children she is expected to stay home and take care of them. It's the death of her career. So, to delay when to have children seems just a practical decision to being able to keep a job that she may find rewarding.
If part-time work had more prestige and men also took part of the responsibility and joy of rising children that motivation will disappear.
Housing in Japanese cities is still crazy high so there will still be problems to solve as couples delaying when they have children has many motivations.