While llms accept json schemas for constrained decoding, they might not respect all of the constraints.