> interesting colors actually commanded a premium over silver or black cars
Because someone paid more for that in the first place.
Every dealer is going to have a white, black, and silver/grey at 'stock' cost. After that the price goes up.
People by a car in a color because they like that color and are willing to pay more for it. People buy a car in a neutral because they want a car and don't care about the color.