Has anyone used it? What's the quality and latency like?
On one hand, I love the idea of moving this kind of processing back to local machines after two decades of centralization. But there were reasons the stuff got centralized in the first place. Are we already in a world where high quality translation has been commoditized so much that the models no longer have any intellectual property value, and can provide a good UX even on lower end machines?