Absolutely awesome amount of content in these two pages. This was not expected. It is appreciated. I can’t wait to use the server model on a Mac to spin up my own cloud optimized for the Apple stack.
Edit: I see they're committing to publishing the OS images running on their inference servers (https://security.apple.com/blog/private-cloud-compute/). Would be cool if that allowed people to run their own.
Oh my god that would be absolutely amazing!
Most likely integrated with an Apple TV or a similar thing. Enough local LLM processing power to handle a family's data all in-house.