This is very useful, thanks!
And to answer your question on background and aims: I'm a machine learning engineer focusing on probabilistic graphical models (i.e. not deep learning) and would like to better understand how dedicated compute could (or could not) improve computational efficiency.