Actually, seeking the bias numbers can be quite illuminating.
We were an infra-focused team building up a scalable data handling / computation platform in preparation to apply ML at a non-trivial scale. When we finally hired some people with deep stats knowledge 10 or 12 years ago, there was a lot of great learning for everyone about how each of our areas of expertise helped the others. I wish we'd found the right stats people earlier to help us understand things like this more deeply, more quickly.
In fact, this is often where decisions on what metrics to have in the first place come from. Ask why. You can go far without deep stats knowledge!