Before You Begin
Vijil requires two things to evaluate your agents:
- An account — Where your agents, evaluations, and results live
- Model provider keys — Credentials for the LLM providers your agents use (OpenAI, Anthropic, etc.)
If your organization uses SSO, your administrator may have already provisioned your account. Check with your team before creating a new one.
Creating Your Account
Navigate to evaluate.vijil.ai and sign up with your work email or Google account.
After submitting, you’ll receive a verification email. Click the link to activate your account.
Using a + alias (like you+vijil@company.com) can help you filter Vijil notifications in your inbox.
The Console
Once verified, you’ll land on the dashboard. The left sidebar organizes the console into functional areas:
| Section | Purpose |
|---|
| Dashboard | Overview and Getting Started wizard |
| Agents | Register agents you want to evaluate |
| Harnesses | Configure test scenarios |
| Evaluations | Run and monitor evaluations |
| Playground | Interactive testing environment |
| Keys | Model provider API keys |
The Getting Started wizard walks you through the critical path: register an agent, create a harness, run an evaluation, and configure protection. Each step unlocks the next.
Adding Model Provider Keys
Vijil needs API keys to communicate with the LLMs powering your agents. These keys are stored encrypted and never logged.
- Click Keys in the sidebar
- Click Add new key
- Select the model hub (OpenAI, Anthropic, Together, etc.)
- Enter a name and your API key
- Set the requests-per-minute limit to match your provider’s rate limits
Vijil stores your keys in the cloud provider’s key management system. However, you should still use dedicated API keys for Vijil rather than sharing keys across services. This makes rotation and access auditing cleaner.
Supported Model Providers
| Provider | Hub Name | Notes |
|---|
| OpenAI | OpenAI | GPT-4, GPT-4o, o1, o3 |
| Anthropic | Anthropic | Claude 3, Claude 4 |
| Google | GCP | Gemini via Vertex AI |
| AWS | Bedrock | Claude, Titan, Llama via Bedrock |
| Meta | Together | Llama 4 via Together AI |
| Mistral | Mistral | Mistral, Magistral |
Setting Up Your Team
For collaboration, create a team workspace. Team members can share agents, run evaluations, and view reports based on their role.
- Click Team in the sidebar
- Click Create Your Team
- Enter a team name and description
Inviting Members
After creating a team:
- Go to Team settings
- Click Invite Member
- Enter their email address
- Assign a role
| Role | Capabilities |
|---|
| Owner | Full access including billing and team management |
| Admin | Full access except billing |
| Member | Run evaluations and view results |
| Viewer | View results only |
Invited members receive an email with instructions to join your workspace.
Enterprise SSO
For organizations using identity providers, Vijil supports:
- SAML 2.0
- OIDC
- Azure AD
- Okta
SSO configuration is managed through Enterprise Deployment. Contact your administrator or sales@vijil.ai to enable SSO for your organization.
Next Steps
Your workspace is configured. Continue to: