> inference latency... that's roughly 5 hours,

The 17 hours in the article is to derive the 'encrypted' model. Training takes significantly longer than prediction.