Why does everyone need a die? Just number each player from 1 to 5 and use a 5 sided die (or 234*5 = 120 faces if you want to cover 2 to 5 players)?