This shows up time and again in media where there are magical creatures that only interact with children. Everything from adults losing the ability to see them (Totoro has two separate classes of invisible creatures), to happenstance (Arrietty is accidentally seen by the boy, because she makes a bad assumption).
I understood something glitchy was going on with my perception.
So it is funny to get an explanation.
Time as we experience it is an illusion bordering on insanity, actually everything we perceive seems to be such a freaking illusion it's mind boggling the whole thing works at all.
Nowadays I know why - the seconds hand would vibrate a bit after every movement, and if my eyes "saw" it going backward for a fraction of a second after focusing on it, the brain would complete that to "yep, it just went back a second".