Skip to main content

​
Create an Account

To get started, sign up for a Vijil account at evaluate.vijil.ai. Once you have registered and logged in, you will land on the main dashboard.

​
Add a Model API Key

Before running an Evaluation, you need to connect the model you want to test. Navigate to API Keys in your dashboard and add the API key for your model provider (e.g., OpenAI, Anthropic, Azure). → See Manage API Keys for a step-by-step guide.

​
Run Your First Evaluation

With an API key set, you are ready to evaluate a model:
  1. Go to the Evaluations section and click Create Evaluation.
  2. Select or register an Agent — an Agent wraps the model you want to test.
  3. Choose a Harness: start with one of the Trust Score dimensions (Security, Reliability, or Safety) to get an overall trustworthiness score.
  4. Click Run to launch the evaluation.
→ See Run an Evaluation for full configuration options.

​
View Results

Once your evaluation completes, results are available in the Evaluations dashboard. You’ll see a Trust Score alongside dimension-level breakdowns and per-test details.

​
Optional: Use the Python Client

If you prefer to run evaluations programmatically or want to integrate Vijil into a CI/CD pipeline, you can use the Python client. 
pip install -U vijil
Authenticate with your API key: 
export VIJIL_API_KEY=<your-key>
Then kick off an evaluation: 
from vijil import Vijil

client = Vijil()
client.evaluations.create(
    model_hub="openai",
    model_name="gpt-4o-mini",
    model_params={"temperature": 0},
    harnesses=["trust_score"]
)
→ See CI/CD Integration for long-lived authentication using machine-to-machine secrets.
Last modified on March 19, 2026