Yes, but you can set a heavy project to say 4096 samples (which is then 96ms) when playback latency doesn't matter.

Sound travels about 2m in 6ms. Iirc, it's difficult for humans to perceive time differences smaller than 20ms, so humans perceive sounds from within a radius of 6m simultaneously.