I have two remotes: One to turn the TV on and off or change the volume, and another, much smaller one to control my Android box running KODI. I just re-used the Amazon fire TV stick remote. Works great! 7 buttons.
Simple and usable is still possible, but you have to do your homework.