Simulation, Testing & Validation
Evidence across simulation, scenario testing, field validation and operating limits.
Domain controls
The following identifiers, titles, objectives and implementation expectations reproduce the canonical public PAI-SF™ v1.0 Control Catalogue. Evidence requirements, assurance expectations, dependencies, exclusions and conformance relevance remain available in the full catalogue.
Objective: Ensure safety-critical behaviors undergo HITL testing before deployment and after significant changes. Requirement: HITL testing includes actual deployment hardware; covers safety-critical behaviors from hazard analysis, boundary conditions, and sim-to-real-transfer- challenging scenarios; repeated after significant changes.
Objective: Test the system against deliberately adversarial physical inputs, not only random/environmental variation. Requirement: Controlled red-team physical tests using known techniques from the threat catalog.
Objective: Quantify, rather than assume, how well simulated validation predicts real-world behavior. Requirement: Systematic comparison of simulated vs. real test outcomes for a sample of scenarios, tracked over time.