In my experience, accidentally memorizing what you are reading doesn't really get in the way of what most people think of as sight reading. Internalizing structures and patterns is 99% of what it means ti "learn to read."