You may want HyperDock[1] which enables that behaviour. There is also HyperSwitch[2] which switches windows, not apps. It's a beta, but still works great on Big Sur.
Hyperdock has been unstable for awhile, and judging by comments on social media and the silence of the dev, it's finally been abandoned. I'm currently trying [DockView](https://noteifyapp.com/dockview/) from the maker of ActiveDock.
Command + Backtick was a pretty big game changer to switch between windows. I understand the difference between that and Hyperswitch, but I’ve rarely been truly wanting for something much more than Cmd+`