It's not a system prompt, it's a tool used during the training process to guide RL. You can read about it in their constitutional AI paper.