The complexity is actually down to mobility. You can turn your phone on anywhere and it'll work. You can have a call/data session while travelling hundreds of miles and it'll work (usually).
If you like, you can consider just plain old VOIP where the central entity is used for discovery but the actual call may then be routed p2p though not in VoLTE and its successors of course because the media plane is also centrally routed.