> ## Documentation Index
> Fetch the complete documentation index at: https://docs.vijil.ai/llms.txt
> Use this file to discover all available pages before exploring further.

# Security

> Scenarios and probes for the Security dimension of trust (confidentiality, integrity, availability).

| Scenario ID                                                 | Scenario Name           | Probe ID                                                                         | Probe Name                                          | Description                                                                                                                                                                                                                             |
| ----------------------------------------------------------- | ----------------------- | -------------------------------------------------------------------------------- | --------------------------------------------------- | --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- |
| vijil.scenarios.security\_confidentiality\_dataprivacy      | Data Privacy            | vijil.probes.LiteratureCloze80\_Small                                            | Book Excerpt Insertion                              | Tests whether the agent will fill in the middle of a book excerpt. A low score in this test indicates that the agent may reveal training information or violate copyright laws.                                                         |
| vijil.scenarios.security\_confidentiality\_dataprivacy      | Data Privacy            | vijil.probes.LiteratureCloze80\_Small\_char\_code                                | Book Excerpt Insertion with Character Code Mutation | Tests whether the agent will fill in the middle of a book excerpt. A low score in this test indicates that the agent may reveal training information or violate copyright laws. Mutated with Character Code Mutation                    |
| vijil.scenarios.security\_confidentiality\_dataprivacy      | Data Privacy            | vijil.probes.LiteratureCloze80\_Small\_embed\_json                               | Book Excerpt Insertion with Embed JSON Mutation     | Tests whether the agent will fill in the middle of a book excerpt. A low score in this test indicates that the agent may reveal training information or violate copyright laws. Mutated with Embed JSON Mutation                        |
| vijil.scenarios.security\_confidentiality\_dataprivacy      | Data Privacy            | vijil.probes.8kEnronLeakEmail\_Small                                             | Emails Leakage - Enron                              | Tests whether an agent will reveal email addresses obtained from the discovery process of the Enron investigation. A low score in this test indicates that the agent may reveal general PII that might be present in its training data. |
| vijil.scenarios.security\_confidentiality\_dataprivacy      | Data Privacy            | vijil.probes.leakreplay.GuardianCloze                                            | Media Excerpt Insertion - Guardian                  | Tests whether the model will fill in the middle of an excerpt from The Guardian                                                                                                                                                         |
| vijil.scenarios.security\_confidentiality\_dataprivacy      | Data Privacy            | vijil.probes.NYTCloze\_Small                                                     | Media Excerpt Insertion - NYT                       | Tests whether an agent will fill in the middle of an excerpt from the New York Times. A low score in this test indicates that the agent may reveal training information or violate copyright laws.                                      |
| vijil.scenarios.security\_confidentiality\_dataprivacy      | Data Privacy            | vijil.probes.confidentiality.data\_leakage\_resistance\_diacritics               | Data Leakage Resistance / Diacritics                | Tests for data leakage resistance using diacritics mutation                                                                                                                                                                             |
| vijil.scenarios.security\_confidentiality\_dataprivacy      | Data Privacy            | vijil.probes.confidentiality.data\_leakage\_resistance\_underline                | Data Leakage Resistance / Underline                 | Tests for data leakage resistance using underline mutation                                                                                                                                                                              |
| vijil.scenarios.security\_confidentiality\_dataprivacy      | Data Privacy            | vijil.probes.confidentiality.data\_leakage\_resistance\_logical\_appeal          | Data Leakage Resistance / Logical Appeal            | Tests for data leakage resistance using logical appeal mutation                                                                                                                                                                         |
| vijil.scenarios.security\_confidentiality\_dataprivacy      | Data Privacy            | vijil.probes.confidentiality.data\_leakage\_resistance\_soft\_mutation           | Data Leakage Resistance / Soft Mutation             | Tests for data leakage resistance using soft mutation mutation                                                                                                                                                                          |
| vijil.scenarios.security\_confidentiality\_dataprivacy      | Data Privacy            | vijil.probes.confidentiality.data\_leakage\_resistance\_embed\_xml               | Data Leakage Resistance / Embed Xml                 | Tests for data leakage resistance using embed xml mutation                                                                                                                                                                              |
| vijil.scenarios.security\_confidentiality\_dataprivacy      | Data Privacy            | vijil.probes.confidentiality.data\_privacy\_soft\_mutation                       | Data Privacy / Soft Mutation                        | Tests for data privacy using soft mutation mutation                                                                                                                                                                                     |
| vijil.scenarios.security\_confidentiality\_dataprivacy      | Data Privacy            | vijil.probes.confidentiality.data\_privacy\_embed\_json                          | Data Privacy / Embed Json                           | Tests for data privacy using embed json mutation                                                                                                                                                                                        |
| vijil.scenarios.security\_confidentiality\_dataprivacy      | Data Privacy            | vijil.probes.confidentiality.data\_privacy\_math\_problem                        | Data Privacy / Math Problem                         | Tests for data privacy using math problem mutation                                                                                                                                                                                      |
| vijil.scenarios.security\_confidentiality\_userprivacy      | User Privacy            | vijil.probes.pii\_query.embed\_json                                              | PII Leakage Probe: Embed JSON Mutation              | Tests for PII leakage without jailbreaks. Response fails if it reveals any PII. Mutated with Embed JSON mutation.                                                                                                                       |
| vijil.scenarios.security\_confidentiality\_userprivacy      | User Privacy            | vijil.probes.confidentiality.user\_privacy\_uppercase                            | User Privacy / Uppercase                            | Tests for user privacy using uppercase mutation                                                                                                                                                                                         |
| vijil.scenarios.security\_confidentiality\_userprivacy      | User Privacy            | vijil.probes.confidentiality.user\_privacy\_homoglyph                            | User Privacy / Homoglyph                            | Tests for user privacy using homoglyph mutation                                                                                                                                                                                         |
| vijil.scenarios.security\_confidentiality\_userprivacy      | User Privacy            | vijil.probes.confidentiality.user\_privacy\_diacritics                           | User Privacy / Diacritics                           | Tests for user privacy using diacritics mutation                                                                                                                                                                                        |
| vijil.scenarios.security\_confidentiality\_userprivacy      | User Privacy            | vijil.probes.confidentiality.user\_privacy\_fullwidth                            | User Privacy / Fullwidth                            | Tests for user privacy using fullwidth mutation                                                                                                                                                                                         |
| vijil.scenarios.security\_confidentiality\_userprivacy      | User Privacy            | vijil.probes.confidentiality.user\_privacy\_embed\_xml                           | User Privacy / Embed Xml                            | Tests for user privacy using embed xml mutation                                                                                                                                                                                         |
| vijil.scenarios.security\_confidentiality\_modelprivacy     | Model Privacy           | vijil.probes.confidentiality.model\_privacy\_lowercase                           | Model Privacy / Lowercase                           | Tests for model privacy using lowercase mutation                                                                                                                                                                                        |
| vijil.scenarios.security\_confidentiality\_modelprivacy     | Model Privacy           | vijil.probes.confidentiality.model\_privacy\_uppercase                           | Model Privacy / Uppercase                           | Tests for model privacy using uppercase mutation                                                                                                                                                                                        |
| vijil.scenarios.security\_confidentiality\_modelprivacy     | Model Privacy           | vijil.probes.confidentiality.model\_privacy\_zero\_width                         | Model Privacy / Zero Width                          | Tests for model privacy using zero width mutation                                                                                                                                                                                       |
| vijil.scenarios.security\_confidentiality\_modelprivacy     | Model Privacy           | vijil.probes.confidentiality.model\_privacy\_diacritics                          | Model Privacy / Diacritics                          | Tests for model privacy using diacritics mutation                                                                                                                                                                                       |
| vijil.scenarios.security\_confidentiality\_modelprivacy     | Model Privacy           | vijil.probes.confidentiality.model\_privacy\_soft\_mutation                      | Model Privacy / Soft Mutation                       | Tests for model privacy using soft mutation mutation                                                                                                                                                                                    |
| vijil.scenarios.integrity                                   | integrity               | vijil.probes.integrity.adversarial\_robustness\_spaces                           | Adversarial Robustness / Spaces                     | Tests for adversarial robustness using spaces mutation                                                                                                                                                                                  |
| vijil.scenarios.integrity                                   | integrity               | vijil.probes.integrity.adversarial\_robustness\_underline                        | Adversarial Robustness / Underline                  | Tests for adversarial robustness using underline mutation                                                                                                                                                                               |
| vijil.scenarios.integrity                                   | integrity               | vijil.probes.integrity.adversarial\_robustness\_logical\_appeal                  | Adversarial Robustness / Logical Appeal             | Tests for adversarial robustness using logical appeal mutation                                                                                                                                                                          |
| vijil.scenarios.integrity                                   | integrity               | vijil.probes.integrity.adversarial\_robustness\_misrepresentation                | Adversarial Robustness / Misrepresentation          | Tests for adversarial robustness using misrepresentation mutation                                                                                                                                                                       |
| vijil.scenarios.integrity                                   | integrity               | vijil.probes.integrity.adversarial\_robustness\_soft\_mutation                   | Adversarial Robustness / Soft Mutation              | Tests for adversarial robustness using soft mutation mutation                                                                                                                                                                           |
| vijil.scenarios.availability                                | availability            | vijil.probes.availability.denial\_of\_service\_resistance\_uppercase             | Denial Of Service Resistance / Uppercase            | Tests for denial of service resistance using uppercase mutation                                                                                                                                                                         |
| vijil.scenarios.availability                                | availability            | vijil.probes.availability.denial\_of\_service\_resistance\_zero\_width           | Denial Of Service Resistance / Zero Width           | Tests for denial of service resistance using zero width mutation                                                                                                                                                                        |
| vijil.scenarios.availability                                | availability            | vijil.probes.availability.denial\_of\_service\_resistance\_diacritics            | Denial Of Service Resistance / Diacritics           | Tests for denial of service resistance using diacritics mutation                                                                                                                                                                        |
| vijil.scenarios.availability                                | availability            | vijil.probes.availability.denial\_of\_service\_resistance\_spaces                | Denial Of Service Resistance / Spaces               | Tests for denial of service resistance using spaces mutation                                                                                                                                                                            |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.malware\_generation\_fullwidth                      | Malware Generation / Fullwidth                      | Tests for malware generation using fullwidth mutation                                                                                                                                                                                   |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.malware\_generation\_authority\_endorsement         | Malware Generation / Authority Endorsement          | Tests for malware generation using authority endorsement mutation                                                                                                                                                                       |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.malware\_generation\_logical\_appeal                | Malware Generation / Logical Appeal                 | Tests for malware generation using logical appeal mutation                                                                                                                                                                              |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.malware\_generation\_soft\_mutation                 | Malware Generation / Soft Mutation                  | Tests for malware generation using soft mutation mutation                                                                                                                                                                               |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.malware\_generation\_embed\_json                    | Malware Generation / Embed Json                     | Tests for malware generation using embed json mutation                                                                                                                                                                                  |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.exploit\_generation\_fullwidth                      | Exploit Generation / Fullwidth                      | Tests for exploit generation using fullwidth mutation                                                                                                                                                                                   |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.exploit\_generation\_authority\_endorsement         | Exploit Generation / Authority Endorsement          | Tests for exploit generation using authority endorsement mutation                                                                                                                                                                       |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.exploit\_generation\_logical\_appeal                | Exploit Generation / Logical Appeal                 | Tests for exploit generation using logical appeal mutation                                                                                                                                                                              |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.exploit\_generation\_misrepresentation              | Exploit Generation / Misrepresentation              | Tests for exploit generation using misrepresentation mutation                                                                                                                                                                           |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.exploit\_generation\_soft\_mutation                 | Exploit Generation / Soft Mutation                  | Tests for exploit generation using soft mutation mutation                                                                                                                                                                               |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.malicious\_tool\_generation\_authority\_endorsement | Malicious Tool Generation / Authority Endorsement   | Tests for malicious tool generation using authority endorsement mutation                                                                                                                                                                |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.malicious\_tool\_generation\_logical\_appeal        | Malicious Tool Generation / Logical Appeal          | Tests for malicious tool generation using logical appeal mutation                                                                                                                                                                       |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.malicious\_tool\_generation\_misrepresentation      | Malicious Tool Generation / Misrepresentation       | Tests for malicious tool generation using misrepresentation mutation                                                                                                                                                                    |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.malicious\_tool\_generation\_embed\_json            | Malicious Tool Generation / Embed Json              | Tests for malicious tool generation using embed json mutation                                                                                                                                                                           |
| vijil.scenarios.security\_integrity\_manipulationresistance | Manipulation Resistance | vijil.probes.malicious\_code.malicious\_tool\_generation\_embed\_xml             | Malicious Tool Generation / Embed Xml               | Tests for malicious tool generation using embed xml mutation                                                                                                                                                                            |
