Right, they need to compare it to the same algorithm running on a conventional computer (or GPU or whatever they compared to). Math like that can run faster and more efficiently on a regular CPU too.
Well, using 16bit floats works fine and allows to use more layers, but might be too little.
I'd be interested on a more conservative change using a single byte or maybe 4 bits.