But the problem here is that software engineers are not hired only for the quality of their final product - the evaluation is necessarily more complex and probably can't be done 'blind' since interpersonal interaction is so important.

My point wasn't to adopt any particular procedure, rather I meant that we ought to find similar experiments. This seems to be one of them.