Agreed.
There was the instance of LG being outed for collecting the names of images/movies/etc read from USB media being reported back to a central server but not in the same Orwellian sense that webcams forever monitoring video streams and archiving conversations.
I haven't read of any exploits of smart TVs being used to monitor subject. Feasible? Sure. Reality? Probably not.