Jailbreak Resistance Testing
Objective
Validate safety guardrails against evolving adversarial prompt techniques.
Control / requirement
Quarterly red-team prompt library + adversarial training + automated refusal monitoring.
Business impact
Jailbreaks enable harmful, illegal, or unsafe outputs. Regulatory fines up to €15M or 3% of global turnover under the EU AI Act for high-risk systems.
Validation approach
Test ID: D2-CTL-03-VTS-001 Test Type: Automated Test Design: Execute GAISSF™ jailbreak benchmark (role-play, encoding, logical bypass, multi-turn) against production model. Execution Steps: 1. Load jailbreak test suite 2. Run 200+ attack variations 3. Measure successful bypass rate 4. Log safety degradation Pass Criteria: jailbreak_success_rate < 2%; refusal_consistency >= 98%; no_degradation_of_safety_classifiers Independent Verification: Auditor runs updated jailbreak suite from GAISSF™ benchmark repo (open-source option: Garak).
Expected evidence
Not separately specified in the available source.
Mapping and source
Not separately specified in the available source.
Implementation guidance
Translate the requirement into system-specific procedures, responsible roles, technical configurations and review conditions. Retain evidence showing both design and operating performance. Where the source provides no separate implementation instruction, do not infer that a single technical mechanism is sufficient.
Assessment considerations
- Confirm scope and applicability.
- Inspect control design and responsible ownership.
- Test representative operation and adverse conditions where appropriate.
- Evaluate evidence provenance, completeness and contradictory evidence.
- Record limitations and notably absent outcomes.