LiteLLM Proxy Server
LiteLLM with Azure
Before starting this guide, ensure you have completed the Installation Guide and installed all required dependencies.
Run LiteLLM as a Docker Container
To connect LiteLLM with an Azure model
, configure your litellm_config.yaml
as follows:
Before starting the container, ensure you have correctly set the following environment variables:
AZURE_API_KEY
AZURE_API_BASE
AZURE_API_VERSION
Run the container using:
Once running, LiteLLM will be accessible at: http://0.0.0.0:4000
To confirm that config.yaml
is correctly mounted, check the logs:
Initiate Chat
To communicate with LiteLLM, configure the model in config_list
and initiate a chat session.