If you take this idea of communication restrictions to the limit, you could imagine the guessers identifying N sets of cards by a single word each as they discuss their guess. The clue giver listens, then uses the clue that identifies the correct set of N cards.
You really just need an algorithm to generate unique sets of 8 or 9 from the whole board, and identifies those sets by a word.