Supported LLMs
Azure OpenAI
To use Azure OpenAI models, you have to set the LLM_AZURE_OPENAI_API_KEY
, LLM_AZURE_ENDPOINT
, LLM_AZURE_DEPLOYMENT
and LLM_AZURE_API_VERSION
environment variables. You can obtain the Azure API key from the Azure.
Usage
We also support the new OpenAI structured-outputs model.
Config
All available parameters for the azure_openai
config are present in Master List of All Params in Config.