The question is about "SteamOS" however, not the kernel. That means that the userland might be open source as well (like android). Actually it's a must if they want people to actually port their OS to a wide range of hardware.
That being said Steam (the app) will obviously remain closed source.