Skip to main content
Vijil can evaluate agents and models hosted on supported model providers. Use this guide to identify the provider credentials, endpoint details, and rate-limit settings you need before running an evaluation.

​
What Vijil Can Evaluate

Vijil evaluates agents by sending requests to an endpoint you register. The endpoint must expose an OpenAI-compatible interface, regardless of which model, framework, or cloud service powers the agent behind it:
  • If your agent already exposes an OpenAI-compatible endpoint, you can register it directly.
  • If it uses a native API that does not expose that interface, create an adapter service that lets Vijil invoke the agent through the supported request and response shape.
Vijil does not require you to choose from a provider or model list. The OpenAI-style endpoint is what matters.

​
When You Need an Adapter

Use an adapter when your agent’s native API is not OpenAI-compatible. The adapter should accept Vijil’s compatible request, translate it to the native agent or provider call, then translate the result back into the compatible response shape. Native Anthropic, AWS Bedrock, Google Vertex AI, and Agentforce-style APIs are examples of integrations that may need this adapter layer if they are not already exposed through an OpenAI-compatible endpoint. An adapter should handle:
  • Authentication to the upstream agent or provider
  • Mapping the registered model identifier to the model or deployment your agent uses
  • Translating request fields into the upstream API format
  • Translating upstream responses into the compatible response format
  • Provider or application errors in a way that Vijil can surface during evaluation

​
Register the Agent in Vijil

When registering the agent, provide the fields Vijil needs to call the endpoint. The endpoint can route to a hosted model, a multi-step agent, a local service exposed through a secure tunnel, or an adapter in front of a non-compatible provider API. The important contract is the endpoint interface, not the underlying provider.

​
Rate Limiting

Rate limits are configured per API key in Vijil. Set the Vijil-side limit below the strictest relevant limit for your account, model, tier, project, region, and endpoint capacity. Many providers share account-level quota across API keys. Do not allocate the full account quota to a Vijil API key if production agents or other systems use the same provider account. Use provider quota documentation and dashboards to choose a safe value.
Start with a conservative limit for new evaluations. Increase it only after confirming that provider dashboards, application logs, and Vijil evaluation logs show enough headroom.

​
Next Steps

Run Evaluations

Execute and monitor evaluations

Understand Results

Interpret evaluation results

Configure Protection

Set up Dome Guardrails
Last modified on July 9, 2026