Models

Upload

Upload a model from Hugging Face or S3 for inference on a dedicated endpoint.

tg models upload \
    --model-name [TEXT] \
    --model-source [URI]

Flag	Type	Description
`--model-name`	`string`	The name to give your uploaded model. required
`--model-source`	`string`	The source URI of the model. required
`--model-type`	`model` or `adapter`	Whether the model is a full model or an adapter.
`--hf-token`	`string`	Hugging Face token, used when uploading from Hugging Face.
`--description`	`string`	A description of your model.
`--base-model`	`string`	The base model for an adapter when running against a serverless pool. Only used with `--model-type adapter`.
`--lora-model`	`string`	The LoRA pool for an adapter when running against a dedicated pool. Only used with `--model-type adapter`.

# List models
tg models list

Flag	Type	Description
`--type`	`dedicated`	Filter to models that can be deployed on dedicated endpoints. `dedicated` is the only available value.
`--after`	`string`	The cursor to start from for pagination.