API by router
Model overrides
List Model Overrides
AuthorizationBearer <token>
In: header
Query Parameters
customer_id?Customer Id
Header Parameters
X-Api-Key?X-Api-Key
Response Body
curl -X GET "https://loading/v1/model-overrides?customer_id=497f6eca-6276-4993-bfeb-53cbbbba6f08" \ -H "X-Api-Key: string"[
{
"budget_daily_usd": 0,
"budget_monthly_usd": 0,
"created_at": "2019-08-24T14:15:22Z",
"customer_id": "160c0c4b-9966-4dc1-a916-8407eb10d74e",
"embedding_model": "string",
"fallback_models": [
null
],
"id": "497f6eca-6276-4993-bfeb-53cbbbba6f08",
"max_tokens": 0,
"primary_model": "string",
"temperature": 0,
"tenant_id": "34f5c98e-f430-457b-a812-92637d0c6fd0",
"updated_at": "2019-08-24T14:15:22Z"
}
]{
"detail": [
{
"loc": [
"string"
],
"msg": "string",
"type": "string"
}
]
}Create Model Override
AuthorizationBearer <token>
In: header
Header Parameters
X-Api-Key?X-Api-Key
budget_daily_usd?Budget Daily Usd
budget_monthly_usd?Budget Monthly Usd
customer_id?Customer Id
embedding_model?Embedding Model
fallback_models?Fallback Models
max_tokens?Max Tokens
primary_model?Primary Model
temperature?Temperature
Response Body
curl -X POST "https://loading/v1/model-overrides" \ -H "X-Api-Key: string" \ -H "Content-Type: application/json" \ -d '{}'{
"budget_daily_usd": 0,
"budget_monthly_usd": 0,
"created_at": "2019-08-24T14:15:22Z",
"customer_id": "160c0c4b-9966-4dc1-a916-8407eb10d74e",
"embedding_model": "string",
"fallback_models": [
null
],
"id": "497f6eca-6276-4993-bfeb-53cbbbba6f08",
"max_tokens": 0,
"primary_model": "string",
"temperature": 0,
"tenant_id": "34f5c98e-f430-457b-a812-92637d0c6fd0",
"updated_at": "2019-08-24T14:15:22Z"
}{
"detail": [
{
"loc": [
"string"
],
"msg": "string",
"type": "string"
}
]
}Resolve Model Policy
Resolve the effective model policy for a customer.
Merges: platform defaults < tenant override < customer override. Instance-level config (model_policy) takes final precedence at runtime. Admin-only — exposes budget and model policy config.
AuthorizationBearer <token>
In: header
Path Parameters
customer_idCustomer Id
Format
uuidHeader Parameters
X-Api-Key?X-Api-Key
Response Body
curl -X GET "https://loading/v1/model-overrides/resolve/497f6eca-6276-4993-bfeb-53cbbbba6f08" \ -H "X-Api-Key: string"{
"budget_daily_usd": 0,
"budget_monthly_usd": 0,
"embedding_model": "string",
"fallback_models": [
"string"
],
"max_tokens": 0,
"primary_model": "string",
"source": "string",
"temperature": 0
}{
"detail": [
{
"loc": [
"string"
],
"msg": "string",
"type": "string"
}
]
}Delete Model Override
AuthorizationBearer <token>
In: header
Path Parameters
override_idOverride Id
Format
uuidHeader Parameters
X-Api-Key?X-Api-Key
Response Body
curl -X DELETE "https://loading/v1/model-overrides/497f6eca-6276-4993-bfeb-53cbbbba6f08" \ -H "X-Api-Key: string"Empty
{
"detail": [
{
"loc": [
"string"
],
"msg": "string",
"type": "string"
}
]
}Update Model Override
AuthorizationBearer <token>
In: header
Path Parameters
override_idOverride Id
Format
uuidHeader Parameters
X-Api-Key?X-Api-Key
budget_daily_usd?Budget Daily Usd
budget_monthly_usd?Budget Monthly Usd
customer_id?Customer Id
embedding_model?Embedding Model
fallback_models?Fallback Models
max_tokens?Max Tokens
primary_model?Primary Model
temperature?Temperature
Response Body
curl -X PUT "https://loading/v1/model-overrides/497f6eca-6276-4993-bfeb-53cbbbba6f08" \ -H "X-Api-Key: string" \ -H "Content-Type: application/json" \ -d '{}'{
"budget_daily_usd": 0,
"budget_monthly_usd": 0,
"created_at": "2019-08-24T14:15:22Z",
"customer_id": "160c0c4b-9966-4dc1-a916-8407eb10d74e",
"embedding_model": "string",
"fallback_models": [
null
],
"id": "497f6eca-6276-4993-bfeb-53cbbbba6f08",
"max_tokens": 0,
"primary_model": "string",
"temperature": 0,
"tenant_id": "34f5c98e-f430-457b-a812-92637d0c6fd0",
"updated_at": "2019-08-24T14:15:22Z"
}{
"detail": [
{
"loc": [
"string"
],
"msg": "string",
"type": "string"
}
]
}