It bears some similarities with with Nvidia's tensorRT that is closed source.