Futo keyboard on Android has a transformer LM option that uses local ML for text prediction, I've found it to work very well. As far as I'm aware it's completely on device.