They could do something like, for every play I vote for that wins, the results of that play add to the weight of my vote. So, for a sack, interception, etc, I lose weight, but I gain weight for every play with positive yardage.
Obviously that's a bit naïve, but you get the idea.
However weights are assigned, they could carry over from game to game and lead to the best play callers in the crowd having the most sway. It would also solve the problem of non-fans trying to sabotage the game.