Clients.model_defaults

Model defaults registry for LiteLLM-based clients.

Provides default configuration values (max_tokens, temperature, system_instructions) for various AI models to simplify client configuration. Values are loaded from config.yaml.

Model defaults registry for LiteLLM-based clients.

Provides default configuration values (max_tokens, temperature, system_instructions) for various AI models to simplify client configuration. Values are loaded from config.yaml.

get_model_defaults(model_string)[source]

Get defaults for a model string.

Parameters:: model_string (str) – LiteLLM model identifier (e.g., “azure/mistral-small-2503”)
Returns:: Dictionary with default settings
Return type:: dict[str, Any]

register_model_defaults(model_string, defaults)[source]

Register custom defaults for a model.

Parameters:

model_string (str) – LiteLLM model identifier
defaults (dict[str, Any]) – Dictionary of default settings

Return type:

None

Functions