* For very little kids, the best camera is the Nikon S30 series (last I looked, they were up to the S33). It's cheap, waterproof, and tough. Kids can take it places, and you don't need to worry (and they don't need to worry either).
* For older kids, crazy as it sounds, the best camera is something that does full manual well. Kids can learn aperture, shutter speed, focus, zoom, and ISO. An older DSLR can be had for around $100-$200.
* One step up for there -- once kids care about photo quality -- is a compact mirrorless. I'm a big fan of the Olympus OM-D series (and older, used models are fine), but it doesn't matter too much. Sony is the big fish in the pond here, and you can't go wrong. Mirrorless is nice since it mounts easily to microscopes, telescopes, and other scopes.
If that's too big, the Sony RX100 series is surprisingly excellent. Pick your price too, since you can buy a I or a VII, with successively higher prices.
* Connected to a computer, a USB CS-mount camera is nice for learning computer vision programming. ELP makes decent ones. You can pick high frame rate, or high resolution, or USB3, or buy one of each. M-mount is fine too, and a bit cheaper.
PiCAM is fine too, as you were considering, but it will be a lot more work to do a project. Better for older kids.
This camera automates/gives what shouldn't be automated (filters), doesn't give controls over what's meaningful (ISO, white balance, shutter speed, aperture), won't give great photo quality, and doesn't look overly sturdy.