Hacker News Reader

What kind of damage is done by constraining token generation to valid JSON?

Yeah, from my experience if you prompt something like:

respond in JSON in the following format: {"spam_score": X, "summary": "..."}

and _then_ you constrain the output to json, the quality of the output isn't affected.