I have multiple models of both the Fire TV/Stick and the Chromecast, and I agree.
I really, really want someone to release a Chromecast-like device that isn't Amazon or Google, though.
The latest Chromecast with Google TV barely works without granting Google access to a whole bunch of your private data. For example, you need to enable Web & App Activity across your entire Google account to use normal Chromecast features.
I will pay good money for a device that uses the castv2 protocol and doesn't siphon my data to Google's servers just so I can watch videos on my TV.