The problem is that one essential app being unavailable can outweigh the other 95% of the phone working perfectly
I feel the same way about ISP modems (not routers). As long as I get an Ethernet port and the modem isn't doing anything untoward, I don't see any problem with letting the ISP's network termination equipment exist inside my house. Some people think there should be a right to hand off the connection as DSL or fiber and buy your own modem, and I think you should be allowed to do that at your own risk, but I don't think the ISP should have to support it. Particularly with PON fiber or CATV, it's actually a bit dangerous to let the customer use random modems as it's a shared medium with half your street and you wouldn't want to jam them.