How would that work? "pick which button to press"?

but the decisions are stateless... or you plan on passing the last N frames?