Understanding LiteLLM Proxy’s Models and Endpoints
You can primarily add models to LiteLLM Proxy in one of 2 ways:
- In your config file as per these posts:
- On the LiteLLM Proxy User Interface
Model list in the LiteLLM User Interface
Go to your model list as per the screenshot below. You will see some model Statuses is “Config Model” (in green) and the one is “DB Model” in orange.
The Config Models reside in my config file, while the DB Model I added via the user interface. Adding models via the user interface is much simpler.
Take Note: In order to add models via the user interface, you need to set the following environment variable:
STORE_MODEL_IN_DB=True
Add a model via the LiteLLM User Interface
If you do want to keep all your models in config, you can use the user interface to see what the model mapping and capabilities are. Check the green and blue blocks.
This is much simpler than going through the documentation to figure this out.
