I'm genuinely not sure this is a Windows problem. They might get infected on pretty much any OS if they navigate anywhere without precautions (as most parents do, including mine).

I'd like to see if a something like DeepFreeze could help here (there are probably alternatives here, DeepFreeze just came first in my mind).