Quart is pretty much "async flask". So you would do it exactly the same as you do for a flask app. ie a recipe like this should work just fine https://www.digitalocean.com/community/tutorials/how-to-buil...
That said I've not done it myself (yet). It's literally something I'm doing this week.
Edit to add: Here's a template that looks promising actually https://github.com/cellerich/docker-quart