I highly recommend the CDK here. A setup very similar to yours is just a few lines of code which you can synth into cloudformation templates
I feel CDK has the mix between optional granularity & high-level constructs just right, while this plugin looks nice for a quick MVP standup i'd be surprised to see it in use for production workloads