"But what about people who can't cycle?" - Most people can cycle. Besides, what about people who can't drive cars? Why do we invest in extensive car infrastructure when some people can't drive cars, either?
"But what about the weather?" - Some people in my city don't like cycling on a rainy day, so they take a bus or drive that day. Tomorrow, when it's not raining, they'll cycle. This still results in less cars and more cyclists. Most of us don't live in perpetual rain or snow. Not to mention the fact that plenty of people don't seem to mind cycling in the rain or snow at all, so they utilize the cycling infrastructure year-round. "Sometimes the weather is bad" is not an excuse for avoiding bike infrastructure, in my opinion.
I agree on cities should be laid out in a way that encourages and enables cycling. I think building safe cycling infrastructure, such as dedicated paths for cyclists (separated from cars) is a good start.