Manage model masters

List, get, add, update, and archive the default serving parameters for each model.

Model masters hold the default serving parameters for each model. For what a model master is, see Model masters.

Use the web interface to add a model master from a vLLM recipe, or to update one. For everything else, including adding a model master manually and archiving one, use the cosmicac-app-node API.

In the web interface

Add a model master from a vLLM recipe

Create a model master from a published vLLM recipe instead of entering the values manually.

Update a model master in the web interface

Update a model master's parameters from the Models page, without using the API.

Through the CosmicAC API

List and get model masters

Find a model master and read the values it stores.

Add a model master

Create a model master by sending its serving parameters.

Update or archive a model master

Change stored values, set the job creation warnings, and archive a model master you no longer need.