I can't even get sourcekit-lsp running without errors.

"failed to create SwiftPMWorkspace: could not find executable for 'xcrun'"

Until such time as there is a working installer that is as simple as "download XCode from the app store", I don't really consider that to be an alternative. I certainly can't recommend it to anyone on my team.