Requiring an app is a blocking issue.
Windows 11 adds snap layouts, for which there is currently no analog, but this will let you do the side-by-side thing from earlier versions of Windows as long as you can tolerate the fullscreened windows becoming their own Space. (I actually find this preferable myself, but YMMV.)