Interesting. While I am unclear if Jev can indeed be a standalone reviewer because it cannot generate conversational text or free-form comments. Maybe something like this - https://github.com/devagrawal09/jev-review

This sparked an idea for me to use Jev in my recently launched Panel Review tool that reviews the agent's riskiest decisions using a multiple models that argue and come to a consensus. see more - https://truverif.ai/panel-review. In order to determine risk, we use a text based classifier which I think could be replaced by Jev. Will still have to evaluate the privacy and cost considerations.