According to NASA [1], asteroid needs to be larger than 25 meters to cause localized damage. It’d need to be larger than 1-2km to cause globally observable consequences.

[1] https://www.nasa.gov/solar-system/asteroids/asteroid-fast-fa...