Or do phone + simcard swapping and use a higher level system for communication. So the mobile network as a whole becomes a communication channel where the mobile number itself is irrelevant. It’s only used as a mean to get on the network.
Havent give this too much thought yet but it could work.