Skip to main content

Before You Begin

Vijil requires two things to evaluate your agents:
  1. An account — Where your agents, evaluations, and results live
  2. Model provider keys — Credentials for the LLM providers your agents use (OpenAI, Anthropic, etc.)
If your organization uses SSO, your administrator may have already provisioned your account. Check with your team before creating a new one.

Creating Your Account

Navigate to evaluate.vijil.ai and sign up with your work email or Google account.
Vijil signup form
After submitting, you’ll receive a verification email. Click the link to activate your account.
Using a + alias (like you+vijil@company.com) can help you filter Vijil notifications in your inbox.

The Console

Once verified, you’ll land on the dashboard. The left sidebar organizes the console into functional areas:
Vijil dashboard with Getting Started wizard
SectionPurpose
DashboardOverview and Getting Started wizard
AgentsRegister agents you want to evaluate
HarnessesConfigure test scenarios
EvaluationsRun and monitor evaluations
PlaygroundInteractive testing environment
KeysModel provider API keys
The Getting Started wizard walks you through the critical path: register an agent, create a harness, run an evaluation, and configure protection. Each step unlocks the next.

Adding Model Provider Keys

Vijil needs API keys to communicate with the LLMs powering your agents. These keys are stored encrypted and never logged.
  1. Click Keys in the sidebar
  2. Click Add new key
  3. Select the model hub (OpenAI, Anthropic, Together, etc.)
  4. Enter a name and your API key
  5. Set the requests-per-minute limit to match your provider’s rate limits
Add Model Hub Key modal
Vijil stores your keys in the cloud provider’s key management system. However, you should still use dedicated API keys for Vijil rather than sharing keys across services. This makes rotation and access auditing cleaner.

Supported Model Providers

ProviderHub NameNotes
OpenAIOpenAIGPT-4, GPT-4o, o1, o3
AnthropicAnthropicClaude 3, Claude 4
GoogleGCPGemini via Vertex AI
AWSBedrockClaude, Titan, Llama via Bedrock
MetaTogetherLlama 4 via Together AI
MistralMistralMistral, Magistral

Setting Up Your Team

For collaboration, create a team workspace. Team members can share agents, run evaluations, and view reports based on their role.
  1. Click Team in the sidebar
  2. Click Create Your Team
  3. Enter a team name and description
Create team modal

Inviting Members

After creating a team:
  1. Go to Team settings
  2. Click Invite Member
  3. Enter their email address
  4. Assign a role
RoleCapabilities
OwnerFull access including billing and team management
AdminFull access except billing
MemberRun evaluations and view results
ViewerView results only
Invited members receive an email with instructions to join your workspace.

Enterprise SSO

For organizations using identity providers, Vijil supports:
  • SAML 2.0
  • OIDC
  • Azure AD
  • Okta
SSO configuration is managed through Enterprise Deployment. Contact your administrator or sales@vijil.ai to enable SSO for your organization.

Next Steps

Your workspace is configured. Continue to: