One possible way out of this (which may have been tried and rejected already for all I know) could be to take up the approach of legal journals, which are usually edited by students rather than professors. There are downsides to this as well - a fetishization of formatting and a busywork demand for citations on even the most prosaic claims, not to mention a tendency to proliferation, but there's an endless supply of eager reviewers who are highly motivated to do good work to burnish their academic and subsequent practice credentials. Being an editor of the Harvard Law Review can get you into all sorts of high-powered jobs, for example - though so, depressingly, can putting your name on a ghost-writer's monument to your commercial vanity, so that shouldn't be the only reason to do it :-/
I agree with the necessity for automation, and maybe some sort of tokenization so that people can save time by being able to rely on trusted certifications. Remember when Creative Commons seemed like an idea whose time had come and a lot of art work was appearing with standardized icons that quickly summarized the scope of the legal rights being asserted over the work's copyright? After a great start that model seems to have run out of steam, perhaps because copyright as a political has been sidelined by more fundamental concerns - at any rate, I had anticipated seeing the CC 'branding' much more widely by now than I do. But similar shorthand cor certifications of statistical rigor or procedural validity might help to make scientific publications more reliable, as well as accessible to lay readers.