If we're talking about spelling, the biggest source of English's orthographic oddness is the Great Vowel Shift:

https://en.wikipedia.org/wiki/Great_Vowel_Shift