Think about how much easier the whole thing would be if there was one button (one!) that switched between "entry" and "command" modes when you're holding it.
Alternatively, it could be some kind of sound that's not common to English. In fact, your could make up a whole command structure based on sound "gestures". It would sound funny, but the ease of use would trump those awkward verbal commands. The sounds could mimic natural sounds for mnemonic ease.