Model Configurations

The model object in your Agent configuration defines which language model processes the conversation. It is a required field when creating or updating an Agent.

Schema

{
"model": {
"provider": "openai",
"model": "gpt-4o-mini",
"system_prompt": "You are a helpful AI assistant.",
"temperature": 0.8,
"max_tokens": 3500,
"tools": []
}
}

Parameters

PropertyTypeRequiredDescription
providerstringLLM provider (see supported providers below)
modelstringModel ID from the provider (e.g. gpt-4o-mini)
system_promptstringThe system instruction given to the model
temperaturenumberRandomness level — 0.0 to 2.0, default 0.8
max_tokensnumberMax tokens per response, default 3500
toolsarrayList of tool IDs to attach to this model, default []

Supported Providers

Providerprovider value
OpenAIopenai
Anthropicanthropic
Google Geminigoogle
Groqgroq
DeepSeekdeep-seek