That echoes my experience. Is Firefox not available for Android TV yet? I don't really use a browser on the TV, so I haven't even tried installing one (not sure if it already comes installed with Chrome).
I know you said "no sideloading", but downloading and installing the Firefox APK right from Mozilla's website should be simple, no?