It takes just as much time for DNS to propagate as it does for me to deploy a config change. It literally doesn't matter at this stage.
You can even add to /etc/hosts and the computers using it as their DNS will resolve it. Depending on how much control you have, DNSMasq will also function as a DHCP server and TFTP server from which you can netboot other servers and do such nifty thing as automatic reinstalls. Useful if you have a separate, internal network and want to set internal IPs, too.
Even with a local DNS server, there has to be some overhead though.. OTOH, avoid premature optimization etc..