And you already don't have to use all 128 bits in v6. You're forced to use about 48 of them, but the rest is your choice. You can just... not use some of them. It's fine.
You're kinda forced to use 128 bits in v6 if you're an end user, cause that's the lowest common denominator. SLAAC is default, DHCP6 is widely unsupported. Most ISPs also only give out a /64 per spec minimum.
The spec minimum is more like /56, so maybe you're forced to use slightly more than 48, but not all 128 bits.
They considered 64 bit addresses at first but they didn't want to ever risk running out again so they doubled it again.
Try to remember it's not just about the sheer number of addresses - you also want to allocate them in big blocks so that few people ever need to expand their blocks, and they can split their big block into more blocks that are still big.
Oh wait that's the standard recommendation so it's already exactly how you said