By reading historical accounts of what colors different things were.
If you give people black-and-white film to watch, people are guess the colors that are there based on what they are familiar with anyway, so this has a chance to be more historically accurate than that.