Sure, if most drivers were open source like on desktop linux we could tweak them to work with newer and newer Android versions, but what happens when AOSP gets a computationally expensive update (i.e. embedded ML voice recognition or realistic TTS)? then you would have to create custom versions of AOSP that only have the stuff a particular phone model can handle and this would create and unbareable ecosystem of poorly maintained distributions