Guardrailing is usually done with a smaller model (< 1b) to filter out simple "not aligned prompt" and not waste compute.

pretrain it on a bunch of prompt injections and then tune it to return pass/fail