It's a bit weird to act as if macOS didn't have installers and uninstallers. For one thing, there's the App store. And then, probably most developers use something like homebrew.

What you describe works for a specific kind of app, the ones that can be easily sandboxed and don't have shared dependencies.