Compliance Harnesses test the agent’s behavioral conduct: what it says and does when a user interacts with it. Many framework obligations fall on the operator instead (documentation, logging, incident reporting, human oversight processes). A Compliance Harness gives you evidence for the agent-side obligations; it does not certify your organization against the framework.
Available Frameworks
Choosing Frameworks
Pick the frameworks that apply to where your agent operates and who it serves:European Union
EU AI Act for agents placed on the EU market or used by people in the EU.
Canada
PIPEDA for agents that handle personal information. OSFI E-23 for agents used by federally regulated financial institutions.
Asia-Pacific
Singapore PDPA for agents that process personal data in Singapore. Taiwan AI Basic Act for agents deployed in Taiwan.
Voluntary Standards
ISO/IEC 42001 and NIST AI RMF for organizations that align their AI governance with an international or United States standard.
Running a Compliance Evaluation
- Console
- MCP
1
Open Verify
Click Verify in the sidebar to open Diamond Evaluations.
2
Select an Agent
In the Select Agent panel, choose the agent to evaluate. Only agents with status Active appear.
3
Open the Compliance Tab
In the Test Configuration panel, click the Compliance tab. It lists one card per framework, each with a short description.
4
Choose Frameworks
Turn on the toggle for each framework you want to test. Use Select all to run every framework at once, or Deselect all to start over.
5
Set the Sample Size
Sample size randomly samples that many prompts from each selected Harness so the run finishes faster. Check Use all prompts to run every Probe in each Harness.
6
Run the Evaluation
Click Run Evaluation. Progress appears in the Evaluation Results table.
To start a Compliance evaluation from code, with the Python SDK or the REST API, see Run Compliance Harnesses in the Developer Guide’s Run Evaluations page.
Reading the Results
When the evaluation completes, open it from the Evaluation Results table. Because the run contains only Compliance Harnesses, Vijil produces a Compliance Trust Report rather than a Baseline report. It shows a score for each framework you selected, with findings that point to the framework requirements your agent did not meet. The score uses the same 0 to 1 scale and 0.70 pass threshold as the Trust Score, but it measures a different test suite. Do not compare a Compliance score with a Baseline Trust Score or average the two. See Understanding Results for how to read findings and drill into individual Probes.Next Steps
Trust Score Harness
Measure Reliability, Security, and Safety
Build Custom Harnesses
Test against your own policies and personas
Upload Policies
Turn your internal policies into testable rules
Configure Guardrails
Enforce requirements at runtime with Dome