Yeah, I abandoned Android on my TV for this exact reason and now I use the TV as a dumb screen for an external streaming box (also running Android TV, but one that's less locked down and allows me to install my own launcher and control the UI).
I wish dumb TVs with good panels were easier to buy.