Fargate is what, 3 cents an hour? And of course it can scale to zero, it uses standard autoscaling groups. It will scale however you want, heck use custom scaling logic with your control plane running in Lambda :)
https://docs.aws.amazon.com/autoscaling/application/userguid...