Update or archive a model master
Change the values a model master stores, set the job creation warnings, and archive one you no longer need.
Change the values that CosmicAC prefills into new jobs for a model, or archive a model master you no longer need. To update one from the Models page instead, see Update a model master in the web interface.
Editing a model master doesn't change a job that already serves the model. CosmicAC applies the new values to the next job that anyone creates for that model.
Prerequisites
You need the following before you start:
- A running CosmicAC deployment. See Installation.
- Your CosmicAC base URL, the address where your CosmicAC UI is reachable. CosmicAC serves the API under /api, so each request uses <base-url>/api.
- A terminal with curl.
Update a model master
To update a model master, send a PATCH request with only the fields to change:
curl -X PATCH <base-url>/api/v1/model-masters/<id> \
-H "Content-Type: application/json" \
-d '{ "disk_gb": 750, "replica": 2 }'To change a model's runtime image, send a PATCH request with runtime_image:
curl -X PATCH <base-url>/api/v1/model-masters/<id> \
-H "Content-Type: application/json" \
-d '{ "runtime_image": "vllm/vllm-openai:v0.15.1" }'Set the job creation warnings
CosmicAC warns when a new job's value differs from the value the model master stores for the same parameter. The min and max lists set which parameters CosmicAC checks and in which direction.
| List | CosmicAC warns when the new job's value is |
|---|---|
| min | Lower than the model master's value. |
| max | Higher than the model master's value. |
CosmicAC compares numeric parameters only, so a name such as base_os_image never warns.
A PATCH request replaces each list, so send the full list:
curl -X PATCH <base-url>/api/v1/model-masters/<id> \
-H "Content-Type: application/json" \
-d '{ "min": ["max_model_length"], "max": ["gpu_memory_utilisation", "replica"] }'The web interface shows these warnings because it calls the job validation endpoint before creating a job. When you create a job directly through the API, CosmicAC returns no warnings.
Archive a model master
To archive a model master, send a DELETE request with its id:
curl -X DELETE <base-url>/api/v1/model-masters/<id>The request archives the model master rather than deleting it. An archived model master still appears in a list request that sets status=archived.