The OS is an abstraction layer that sepparate the kernal operation from the user operation.
For example, Before we had this seperation, a user application could have revoked the entire cpu to itself.
I think that what you ought to be asking is a cpu that is optimized for ML. This is WIP. There are a few startups that are on this issue.