Apart from making the game no fun at all, that's just establishing a language before the game to use during. It's still a language (or a form of explicit communication) and as such is as forbidden as ASL.
I think the game is fun, but for only a few rounds. A game needs to have competition between players imho.