I agree it might be unprofessional but I would totally love to work with a team that doesn't find this annoying.
My desk has a number of puzzles and they have a ton of fun playing with it. Sometimes they draw on the whiteboard or write a quote.
A++, would definitely recommend bringing kids a couple of times a year.
Of course it helps to work in a company producing things that might be actually interesting to kids in the first place. If all you're doing web-blah, ymmv..
Bonus points if you ever leave the webcam on while changing a diaper or breast feeding. :-D
No, I am not kidding or making up any of the above, though it wasn't all the same kid, nor all the same day (or even the same workplace), and admittedly I have no phobias or allergies.