Per Wikipedia, New York city's land area is 790km^2. Tokyo's is 2187km^2. Tokyo Metro's population density is 6,224/km^2 (I picked the higher of the possible numbers for this). New York City's density is 10,431/km^2.
There's really no argument you can make that New York should be cheaper than Tokyo based on density alone. Tokyo's big secret is sprawl.