I'm sorry, but why would you run a model like ALBERT on a CPU in the first place?
It's pretty common to run inference on CPUs. There are lots of operational and cost reasons why this makes sense in at least some cases.
It's pretty common to run inference on CPUs. There are lots of operational and cost reasons why this makes sense in at least some cases.