The main problem is Mac's windows management. I'm having good success with the new stage manager feature along with "reduced motion" enabled, and some hotkeys to activate apps. This gives me near-instant transitions, which I really love about many Linux window managers. (Like Sway.)
This with M1 is the smoothest UX I've ever had, even compared to my powerful Windows computer. While Linux and SwayWM did feel a bit more snappy, the other part of the UX was lacking enough that I spent too much time tweaking and not enough time getting shit done.