The more I looked into it it's not just the control language itself we need but a way of querying the model that is completely orthogonal to human language. But I think that would be impossible because as the newer models grow they would soon understand the control language re-blurring the line between the control language and output language. "Speaking" in a new way will not be outside it's ability to pattern match.

When your fundamental compute block is language itself (and not a subset) you bounce into the limits of our understanding of language and cognition.

It's a new Tower of Babel we are building by pouring all of humanities records into a mold and hoping a tower to heaven pops out the other side.