Yes. And you can. Obj-C and Swift both have the ability to interop with anything that can speak C.
But if all you want to do is not use Obj-C then Swift us the 100% supported official path.
No need to hack your own wrapper.
It means they'll end up fighting the platform, and that will lead to worse outcomes by many metrics.
While I don't disagree with your sentiment, that is not a reasonable expectation for anyone intending to develop for Apple platforms. Apple has made it quite crystal clear for a long time now that Swift, and only Swift, is the One True Way going forward.
Why? That would constrain Apple’s API design to only that expressible in the common subset of languages developers might realistically want to use.