Why not? As long as you can send and receive UDP traffic, there's no reason why you can't do http/3.
Caddy and HAProxy both support the protocol. nginx doesn't have it in the public stable version yet, though there are preview packages available for modern server platforms.