Before You Begin
Vijil requires two things to evaluate your agents:- An account: Where your agents, evaluations, and results live
- Model provider keys: Credentials for the LLM providers your agents use (OpenAI, Anthropic, etc.)
Creating Your Account
Navigate to evaluate.vijil.ai and sign up with your work email or Google account.
Using a
+ alias (like you+vijil@company.com) can help you filter Vijil notifications in your inbox.The Console
Once verified, you’ll land on the dashboard. The left sidebar organizes the console into functional areas:
| Section | Purpose |
|---|---|
| Dashboard | Overview and Getting Started wizard |
| Agents | Register agents you want to evaluate |
| Harnesses | Configure test scenarios |
| Evaluations | Run and monitor evaluations |
| Playground | Interactive testing environment |
| Keys | Model provider API keys |
Adding Model Provider Keys
Vijil needs API keys to communicate with the LLMs powering your agents. These keys are stored encrypted and never logged.- Click Keys in the sidebar
- Click Add new key
- Select the model hub (OpenAI, Anthropic, Together, etc.)
- Enter a name and your API key
- Set the requests-per-minute limit to match your provider’s rate limits

Supported Model Providers
| Provider | Hub Name | Notes |
|---|---|---|
| OpenAI | OpenAI | GPT-4, GPT-4o, o1, o3 |
| Anthropic | Anthropic | Claude 3, Claude 4 |
| GCP | Gemini via Vertex AI | |
| AWS | Bedrock | Claude, Titan, Llama via Bedrock |
| Meta | Together | Llama 4 via Together AI |
| Mistral | Mistral | Mistral, Magistral |
Setting Up Your Team
For collaboration, create a team workspace. Team members can share agents, run evaluations, and view reports based on their role.- Click Team in the sidebar
- Click Create Your Team
- Enter a team name and description

Inviting Members
After creating a team:- Go to Team settings
- Click Invite Member
- Enter their email address
- Assign a role
| Role | Capabilities |
|---|---|
| Owner | Full access including billing and team management |
| Admin | Full access except billing |
| Member | Run evaluations and view results |
| Viewer | View results only |
Enterprise SSO
For organizations using identity providers, Vijil supports:- SAML 2.0
- OIDC
- Azure AD
- Okta
Next Steps
Your workspace is configured. Continue to:Quick Start
Run your first evaluation end-to-end
Register an Agent
Add your AI agent to Vijil