Classically and in vacuum I think your intuition is right.
However in this case, I think this is happening in bulk materials not in vacuum, and there are other interactions on the atomic scale so light propagating through the lattice has weird affects.