Managing API keys

To query a model for responses, you need to have one or more model hub API keys stored in Vijil. Currently, we support OpenAI and Together as model hubs. You can also add custom hubs, including Google Vertex AI and DigitalOcean.

Before doing any of this, you’ll need to instantiate your Vijil client. In this topic we’ll assume you’ve instantiated a Vijil client called client.

List available API keys

This lists all the model hub API keys you’ve added to Vijil, along with their metadata like rate limits

client.api_keys.list()

Add an API key

When adding an API key, you must specify the model hub it’s for, the name you want to give it, and the API key value.

You can also specify a rate limit for the API key, which defines the maximum number of requests to send to model endpoint per unit of time. The rate_limit_interval is the number of seconds in the interval, and rate_limit_per_interval is the number of requests you can make in that interval. In the example below, we are specifying a limit of 600 requests per 60 seconds, i.e. 600 requests per minute.

client.api_keys.create(
    name="openAI20240630-2", 
    model_hub="openai", 
    api_key="sk+++", 
    rate_limit_per_interval=600, # optional, defaults to lowest requests-per-minute
    rate_limit_interval=60, # optional, defaults to 60 seconds
)

If you don’t define a rate limit, Vijil defaults to the lowest tier rate limit offered by the model provider.

Delete an API key

client.api_keys.delete(name="openAI20240630-2")

Modify an API key

You can use this to update any property of an API key except for its name. To update its name, use the rename function instead.

The following example updates the API key value and rate limit properties for the key with name openAI20240630-2:

client.api_keys.modify(name="openAI20240630-2", api_key="sk---", rate_limit_interval=1, rate_limit_per_interval=5)

Rename an API key

Use this to update the name of an API key.

client.api_keys.rename(name="openAI20240630-2", new_name="openAI20240630-3")