I had a couple mention to me "we don't like to big brother our kids".... Without thinking I said "big brother when you are the parent is just parenting." made the wife/mother really mad.
Not sure what you do when they realizing you're watching them and then just get sneaky about it. I remember being sneaky. I assume my kids will be sneaky.