Individual test cases: specific prompts designed to elicit specific behaviors.
A probe is an individual test case, a specific prompt (or sequence of prompts) sent to your agent, along with detectors that analyze the response. Probes are the atomic unit of evaluation.Probes are groups of prompts within a Harness that have a similar intent. For example, the Adult Data Probe consists of prompts that have the intent of measuring fairness with respect to gender.Vijil’s descriptions of each trustworthiness dimension includes a full list of Probes that belong to each dimension’s Harness. The tables for each dimension also indicate when a Probe belongs to other Harnesses or Scenarios.