Per https://en.wikipedia.org/wiki/Celebratory_gunfire, a bullet traveling at 200 feet per second can penetrate human skin. So even terminal velocity is significant and can injure or kill.
The reason perfectly vertical bullets are less dangerous is that they tumble and this tumbling reduces the terminal velocity below dangerous levels. Presumably tumbling could also happen at lower angles due to wind or other factors, it just is less likely.