LLM_AZURE_OPENAI_API_KEY
, LLM_AZURE_ENDPOINT
, LLM_AZURE_DEPLOYMENT
and LLM_AZURE_API_VERSION
environment variables. You can obtain the Azure API key from the Azure.
Optionally, you can use Azure Identity to authenticate with Azure OpenAI, which allows you to use managed identities or service principals for production and Azure CLI login for development instead of an API key. If an Azure Identity is to be used, do not set the LLM_AZURE_OPENAI_API_KEY
environment variable or the api_key in the config dictionary.
Note: The following are currently unsupported with reasoning modelsParallel tool calling
,temperature
,top_p
,presence_penalty
,frequency_penalty
,logprobs
,top_logprobs
,logit_bias
,max_tokens
azure_openai_structured
model yet.
azure_openai
config are present in Master List of All Params in Config.