Yes. But environmental and anti-obsolence considerations might lead us to require good documentation of hardware. Then those who care would have what they need to write their own drivers. (Well, those who care and have the chops.)
That might make sense for all those android tablets with 0 years of software updates, but doesn't really work for macs because they get updates for around 7 years (a few years longer if you include security updates). How many 7 year old macbooks are there that's still in use, and of those, how many are getting trashed because the user absolutely needs the the latest updates?