This is exactly what I've done with several TVs over the past 5 years.

Skip the internet setup, plug in a chromecast, and never utilize any of the built in "features" of the TV. It's worked great for me so far.