Already happening! This came up a few days ago: Tensorflow implemented with webgl: https://news.ycombinator.com/item?id=14894653