We need to have zoning laws.
"You'll gradually get more density and less traffic this way over time, assuming that's what people want "
Once a city has been structured, it's nary impossible to 'unstructure'.
"The root of the problem is the impulse to be disgusted by your neighbor's choices, "
We live in a community and we have no choice but to have rules & laws - they just need to be done intelligently.
Cities like Frankfurt and Munich are very close to ideal. They have 'just right' urban density, good Trams, Subways and Trains - and it works extremely well. You can get where you need to quickly, there's not a lot of traffic - and ample choice for those who want to have a 'big house' vs. 'smaller home' vs. 'urban flat'.
North Americans really screwed up - and it has a lot to do with builders, bad zoning etc.
If people were actually 'given the choice' of semi-dense urban living + easy commute to slightly more dense suburbs - they would usually take it.
In North America - people 'have less choice' and 'less options' because one of the key ingredients: public transport (i.e. trams, trains and subways) requires some degree of collective organization, as well as some foresight with respect to urban planning.
It seems a little 'anti choice' to opt for a Euro-style city, but really, there is a lot of 'choice' and the effectiveness of basic public transport is so awesome for people that I can't imagine anybody would want to opt out.
For example, I don't think anyone in all of Europe would opt for 'less' transit services, they are usually great and used heavily - and you can still drive if you want.