I think to do this at scale and properly we'd need a replacement for backprop