At the very least, people will be more likely to decline to be a referee for a paper they're less of an expert on or don't have time for if they knew the report would be public.
If it wasn’t anonymous and the reviewers were vetted with respect to the field they were commenting on, it might work