Wiki · Reference entry
Guardrails
Rules bolted around a model to stop it doing specific bad things.
Filters on input and output: blocked topics, forbidden actions, formats it must follow. Worth having, and frequently mistaken for a safety strategy. Guardrails catch the failures somebody anticipated, which by definition excludes the ones that matter most.
Why it matters
A list of known bad outcomes is not the same as evidence of a good one.