The whole point of references is that given the opportunity to put your best foot forward, can you find people to vouch for you. It may fall short, but so will calling a tenuous relationship.
I did quite well at my previous job (my boss has been a reference twice, in addition to my employee who took over my position when I left), but had a another specific manager been asked, I would have received an awful review, unrelated to my job, but because he hated my boss and therefore hated me and my team. We rarely worked together, and he has little idea of my accomplishments, but it wouldn’t be crazy to ask a director at my previous company for that backdoor reference.
Basically my issue is that I don’t believe that backdoor references are in any way more effective than regular references, but are tremendously unethical, and could lead to false negatives.