But that also seems somewhat troubling... especially because I'd normally inexperienced or first time job seekers using the site. Would that be like the blind leading the blind in a sense? There is a lot to learn to turn into a good interviewer.
Even if you don't test someone's ability, having them declare if they are interested in conducting interviews or being mock interviewed would likely get a good separation and better experience for all.