Hacker News Reader

Google mentioned at I/O that speech recognition will soon (this summer?) be performed locally on Android devices, with no voice data being sent to Google, because they have been able to reduce the size of the model dramatically. Is that related to federated learning?

Paper: https://arxiv.org/abs/1811.06621

View on HN

No, federated learning is about training on the device not running prediction on the device. Training a speech model on the device would be hard, because there is no labeled data. We don't know what the user said.

I can imagine the world relying more and more on unsupervised pre-training approaches, such as BERT and GPT-2. Then we’ll just need a few labeled data to generalize.

Reply on news.ycombinator.com