It's not on by default but there has been a packed ref format for git for some time that can be opted into for repos with lots of refs. It's one of the things being considered for the new default in the 3.0 defaults review.

https://git-scm.com/docs/git-pack-refs