The meteor isn’t the problem. It’s the delta-V of the meteor which is the problem.
Speed and size. But as speed generally is high (11-72 km/s) [1] then size matters more. Anything hitting you at km/s that survives the journey through the atmosphere is going to hurt I think. :)