I just walked out onto my 3rd floor balcony in Tokyo at 8:30pm and my watch says it is 38dB. I can hear some light car traffic in the distance. I live about a 20 minute walk to Shibuya crossing, so not exactly rural. I also live about 100m from Yamatedori which is a giant arterial road.
I used to live in NYC. Tokyo is a very quiet city. Not all parts for sure... you can have an apartment by a train crossing or they might build a highway outside your 6th floor window, but I would say that most of the parts where people live is pretty quiet.