The paper is not very clear about what they mean with inferencing. It seems they just mean calculating a prediction for new data using a trained machine learning model. Readers outside the field, like me, are likely to confuse inferencing with inferring (using logic), but that is out of scope, here.

Edit: find the real explanation here: https://blogs.nvidia.com/blog/2016/08/22/difference-deep-lea...