I'm also surprised that XLA.jl doesn't seem to have had continued development:
https://github.com/FluxML/XLA.jl
When in doubt, piggybacking on (or at least interoperating with) what the large technology companies are investing in is probably savvy, sort of what the OP did.