I've setup Minecraft/web servers which required no server for holepunching. Just plain old IPv4 with port forwarding.
I didn't see that you mentioned UPnP in the OP though, sorry. I'd assume downloading metadata from a signalling server if you don't need it for traversal is completely optional - most P2P networks have an initial list of peers to connect to to bootstrap new clients.