Movement distracts our attention thru vision (as we need to put effort to ignore the moving objects) and sounds do the same thru hearing. I'd compare doing highly focused work in such conditions to balancing on one leg in a curious yoga position while random people walk by and push you without a warning.