I'm using HyperSwitch that has the same feature, only on alt-tab. But! It also replaces the cmd-backtick shortcut with a similar overlay for the current app's windows. I find that great, because the native Mac order of switching windows is bonkers, while HyperSwitch employs the last-used order.
The alt-tab feature in HS also has a flaw: if you switch to an app via the dock icon (or possibly by clicking on one of its windows), all windows of that app become ‘recently used’ in the alt-tab menu. I'm guessing this might be a behavior of MacOS, and that you might run into the same problem.