Kind of weird that (gpu) training works but inference doesn't ...