And, importantly, they would not even have realized that they were saying it wrong, because they would have been unable to hear the difference.
As a modern example: I have an acquaintance from Tonga. At some point she got very frustrated with the people around her who didn't understand what she meant by the "rittel bin". She finally pointed at the trash can.
"Oh, the litter bin!"
"That's what I said, the rittel bin!"
In Tongan, l and r are the same phoneme, and native speakers cannot distinguish them without practice.