Also this opens the possibility of running these models on Node.js serverless functions no?

That certainly also has to open up possibilities for on-demand predictions?