1. Above-the-Line credits (cast, director, producer, other key roles) are contractually negotiated, and a mistake here has definite consequences. That isn't usually the case for all the remaining credits. But people still care that the ordering makes sense and flows well. Chronology, prestige, authorship, and org chart level are all axes you could order on -- but that's already too many ways to reconcile.
2. One of the challenges with standardizing credits order is that roles come and go all the time. I mentioned this in the post, but 18 months ago there was no "COVID Compliance Officer" in end credits. Now it's in nearly all feature films, and we know where it goes. HN might also find it interesting that roles like "Data Center Engineering" and "Deployment Services" have started showing up just in the last few years.