There is a way to capture Wayland https://github.com/obsproject/obs-studio/pull/1758
I'm hoping this eventually gets merged in. This would not only allow capturing Wayland, but also capturing games without affecting the performance too much (similarly to Shadowplay on Windows).