Make sure your TV and device enable CEC. (Allows your device to turn the TV on and off, select the input, and control the volume.) I know the NVidea Shield can do this, and the Chromecast can do this.

Then hide the remote from your TV and only use the remote from your device.

It's a little slow, but for me, it's nice that I can turn on my Switch from the controller and it turns the TV on; or that I can put a disk in my Bluray player and it turns the TV on.