Windows Server (Standard and Datacenter editions) licenses include permissions to run unlimited windows containers on top of them. So you would only need to pay for the licenses of your hosts.
https://www.microsoft.com/en-us/licensing/product-licensing/...