Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Body
application/json
Deployment configuration
gpu_type
enum<string>
required
GPUType specifies the GPU hardware to use (e.g., "h100-80gb").
Available options:
h100-80gb,
h100-40gb-mig,
h200-140gb,
b200-192gb
image
string
required
Image is the container image to deploy from registry.together.ai.
name
string
required
Name is the unique identifier for your deployment. Must contain lowercase letters, numbers, or hyphens, start with a lowercase letter or number, and be 4-63 characters. It cannot be changed.
Required string length: 4 - 63
args
string[]
Args overrides the container's CMD. Provide as an array of arguments (e.g., ["python", "app.py"])
autoscaling
object
Autoscaling configuration. Example: {"metric": "QueueBacklogPerWorker", "target": 1.01} to scale based on queue backlog. Omit or set to null to disable autoscaling
Option 1
Option 2
Option 3
Show child attributes
capacity_type
enum<string>
Controls how replicas above reserved capacity behave. stable replicas stay running after scale-up; preemptible replicas may be evicted during capacity contention.
Available options:
stable,
preemptible
command
string[]
Command overrides the container's ENTRYPOINT. Provide as an array (e.g., ["/bin/sh", "-c"])
cpu
number
CPU is the number of CPU cores to allocate per container instance (e.g., 0.1 = 100 milli cores)
Required range: x >= 0.1
description
string
Description is an optional human-readable description of your deployment
environment_variables
object[]
EnvironmentVariables is a list of environment variables to set in the container. Each must have a name and either a value or value_from_secret
Show child attributes
gpu_count
integer
GPUCount is the number of GPUs to allocate per container instance. Defaults to 0 if not specified
health_check_path
string
HealthCheckPath is the HTTP path for health checks (e.g., "/health"). If set, the platform checks this endpoint to determine container health.
max_replicas
integer
MaxReplicas is the maximum number of container instances. Defaults to MinReplicas if not set.
memory
number
Memory is the amount of RAM to allocate per container instance in GiB (e.g., 0.5 = 512MiB)
Required range: x <= 1000
min_replicas
integer
MinReplicas is the minimum number of container instances to run. Defaults to 1 if not specified
model_mounts
object[]
Model weights to preload from Together's model registry into the container. At most one mount is supported, and it cannot be used with volumes.
Show child attributes
placement_group
string
PlacementGroup co-locates deployments that share this value onto one cluster, so in-cluster traffic between them stays local. A member that cannot co-locate stays pending. Leave empty for no group
port
integer
Port is the container port your application listens on (e.g., 8080 for web servers). Required if your application serves traffic
Required range: 1 <= x <= 65535
regions
string[]
Regions confines the deployment to clusters in these regions. Each entry is an exact region or a prefix family like "us-east" that matches every "us-east-*". A deployment that cannot place in any of them stays pending. Empty means any region
storage
integer
Storage is the amount of ephemeral disk storage to allocate per container instance (e.g., 10 = 10GiB)
Required range: x <= 400
termination_grace_period_seconds
integer
TerminationGracePeriodSeconds is the time in seconds to wait for graceful shutdown before forcefully terminating the replica
volumes
object[]
Volumes is a list of volume mounts to attach to the container. Each mount must reference an existing volume by name
Show child attributes
Response
Deployment created successfully
args
string[]
Args are the arguments passed to the container's command
autoscaling
object
Autoscaling contains autoscaling configuration parameters for this deployment. Omitted when autoscaling is disabled (nil)
Option 1
Option 2
Option 3
Show child attributes
capacity_type
enum<string>
Controls how replicas above reserved capacity behave. stable replicas stay running after scale-up; preemptible replicas may be evicted during capacity contention.
Available options:
stable,
preemptible
command
string[]
Command is the entrypoint command run in the container
cpu
number
CPU is the amount of CPU resource allocated to each replica in cores (fractional value is allowed)
created_at
string<date-time>
CreatedAt is the ISO8601 timestamp when this deployment was created
description
string
Description provides a human-readable explanation of the deployment's purpose or content
desired_replicas
integer
DesiredReplicas is the number of replicas that the orchestrator is targeting
environment_variables
object[]
EnvironmentVariables is a list of environment variables set in the container
Show child attributes
gpu_count
integer
GPUCount is the number of GPUs allocated to each replica in this deployment
gpu_type
enum<string>
GPUType specifies the type of GPU requested (if any) for this deployment
Available options:
h100-80gb,
h100-40gb-mig,
h200-140gb,
b200-192gb
health_check_path
string
HealthCheckPath is the HTTP path used for health checks of the application
id
string
ID is the unique identifier of the deployment
image
string
Image specifies the container image used for this deployment
max_replicas
integer
MaxReplicas is the maximum number of replicas to run for this deployment
memory
number
Memory is the amount of memory allocated to each replica in GiB (fractional value is allowed)
min_replicas
integer
MinReplicas is the minimum number of replicas to run for this deployment
model_mounts
object[]
Model weights mounted into this deployment, including the pinned revisions.
Show child attributes
name
string
Name is the name of the deployment
object
any
The object type, which is always deployment.
placement_group
string
PlacementGroup co-locates deployments that share this value onto one cluster. Empty when the deployment is not in a group
port
integer
Port is the container port that the deployment exposes
ready_replicas
integer
ReadyReplicas is the current number of replicas that are in the Ready state
regions
string[]
Regions confines the deployment to clusters in these regions (exact region or a prefix family like "us-east"). Empty means any region
replica_events
object
ReplicaEvents is a mapping of replica names or IDs to their status events
Show child attributes
status
enum<string>
Status represents the overall status of the deployment (e.g., Updating, Scaling, Ready, Failed)
Available options:
Updating,
Scaling,
Ready,
Failed,
ScaledToZero
storage
integer
Storage is the amount of storage (in MB or units as defined by the platform) allocated to each replica
termination_grace_period_seconds
integer
TerminationGracePeriodSeconds is the time in seconds to wait for graceful shutdown before forcefully terminating the replica
updated_at
string<date-time>
UpdatedAt is the ISO8601 timestamp when this deployment was last updated
volumes
object[]
Volumes is a list of volume mounts for this deployment
Show child attributes
Was this page helpful?
⌘I
Together AI SDK (Python)
from together import Togetherclient = Together()deployment = client.beta.jig.deploy( name="my-deployment", gpu_type="h100-80gb", image="registry.together.ai/proj_abcdefg1234567890/my-image:latest")print(deployment)
import Together from "together-ai";
const client = new Together();
const deployment = await client.beta.jig.deploy({
name: "my-deployment",
gpu_type: "h100-80gb",
image: "registry.together.ai/proj_abcdefg1234567890/my-image:latest"
});
console.log(deployment);
import Together from "together-ai";
const client = new Together();
const deployment = await client.beta.jig.deploy({
name: "my-deployment",
gpu_type: "h100-80gb",
image: "registry.together.ai/proj_abcdefg1234567890/my-image:latest"
});
console.log(deployment);
{"docsConfig":{"theme":"almond","$schema":"https://mintlify.com/docs.json","name":"Together AI docs","description":"Documentation for the Together AI platform for inference and training.","colors":{"primary":"#FC4C02","light":"#FC4C02","dark":"#FC4C02"},"logo":{"light":"https://mintcdn.com/togetherai-52386018/gasg_XMR14P-KB11/logo/logo.svg?fit=max\u0026auto=format\u0026n=gasg_XMR14P-KB11\u0026q=85\u0026s=7ce2e810455d35e5916bb7253983eb98","dark":"https://mintcdn.com/togetherai-52386018/gasg_XMR14P-KB11/logo/logo-dark.svg?fit=max\u0026auto=format\u0026n=gasg_XMR14P-KB11\u0026q=85\u0026s=66f335ef8c544ef8949c4ac31557e054"},"favicon":"https://mintcdn.com/togetherai-52386018/-CXURtHnBCqpvt1N/favicon.svg?fit=max\u0026auto=format\u0026n=-CXURtHnBCqpvt1N\u0026q=85\u0026s=b3f5eec5b039ae68b2dd2a70ad0c66be","api":{"openapi":[{"source":"openapi.yaml","overlays":["openapi-overlays/hide-unreleased.yaml"]}],"playground":{"display":"simple"},"mdx":{"server":"https://api.together.ai/v1"}},"appearance":{"default":"system"},"background":{"color":{"light":"#FFFFFF","dark":"#050608"}},"navbar":{"links":[{"href":"https://api.together.ai/","label":"Sign in"}]},"footer":{"links":[{"header":"Company","items":[{"label":"About us","href":"https://www.together.ai/about"},{"label":"Careers","href":"https://www.together.ai/careers"}]},{"header":"Examples","items":[{"label":"Cookbooks","href":"https://github.com/togethercomputer/together-cookbook"},{"label":"Demo apps","href":"https://www.together.ai/demos"}]},{"header":"Resources","items":[{"label":"Pricing","href":"https://www.together.ai/pricing"},{"label":"Support","href":"https://support.together.ai/"}]},{"header":"Legal","items":[{"label":"Cookie policy","href":"https://www.together.ai/cookie-policy"},{"label":"Consent preferences","href":"https://docs.together.ai/"}]}]},"fonts":{"heading":{"family":"The Future","weight":500,"source":"fonts/the-future-medium.woff2","format":"woff2"},"body":{"family":"The Future","weight":400,"source":"fonts/the-future-regular.woff2","format":"woff2"}},"icons":{"library":"tabler"},"integrations":{"ga4":{"measurementId":"G-9Q7932WNVC"}},"contextual":{"options":["copy","view","add-mcp","cursor"],"display":"header"},"styling":{"latex":false},"navigation":{"pages":[]}},"deployment":{"deploymentMetadataValue":{"subdomain":"togetherai-52386018","hasAudioNarration":false,"actualSubdomain":"togetherai-52386018","customDomains":["docs.together.ai"],"gitSource":{"type":"github","owner":"togethercomputer","repo":"mintlify-docs","deployBranch":"main","contentDirectory":"","isPrivate":true,"mountPath":"","label":""},"feedback":{"thumbs":true,"contextualFeedback":{"allowEmail":true},"agentFeedback":true},"entitlements":{"AI_CHAT":{"status":"ENABLED"},"WEB_MCP":{"status":"ENABLED"},"NARRATION":{"status":"ENABLED"}},"buildId":"6b00cc838c784e1a1fa0c5e0","clientVersion":"0.0.4263","searchFilterCounts":[{"language":"default","tag":"API reference","count":187},{"language":"default","tag":"TOGETHER APIS","count":182},{"language":"default","tag":"Documentation","count":170},{"language":"default","tag":"Endpoints","count":47},{"language":"default","tag":"Guides","count":42},{"language":"default","tag":"INFERENCE APIS","count":39},{"language":"default","tag":"Post-training","count":36},{"language":"default","tag":"POST-TRAINING","count":32},{"language":"default","tag":"Containers","count":26},{"language":"default","tag":"GPU CLUSTERS","count":23}]},"assistantConfig":{"enableStarterQuestions":true,"enableContextualStarterQuestions":true,"deflection":{"enabled":true,"type":"link","email":"[email protected]","url":"https://support.together.ai/"}},"basePath":"","hasChatPermissions":true,"hasWebMcpPermissions":true,"toggles":[{"name":"kill-isr","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-rbac-roles","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-mintlify-slack","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"agent-integrations-settings","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"rbac-expansion","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-pr-grouping","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"custom-prefix","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"analytics-v7","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"user-flows-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"no-publish-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-onboarding","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving-live","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"stripTemperatureMiddleware","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"support-platform-pylon-zendesk","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"snapshot-serving","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"instant-rollback","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications-server","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"granular-notifications","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automations-fable","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fixed-ai-action-pricing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"site-roles","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"automation-resolve-merge-conflict","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"scoped-publishing","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"mintql","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"page-level-analytics","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-version-history-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"billing-page-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"full-page-search","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workspace-projects","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"assistant-v5","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"fork-pr-previews","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"revalidation-jwt","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-sso-scim","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"hobby-abuse-scan","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"dashboard-inbox","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-signup","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-dual-write","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"workos-enabled","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"approve-review-flow","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"editor-metadata","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"sso-setup-deadline-banner","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"turbopuffer-serve","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"live-agents","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"starter-pricing","enabled":true,"variant":{"name":"treatment","enabled":true,"payload":{"type":"string","value":"treatment"},"feature_enabled":true},"impressionData":false},{"name":"llms-txt-v2","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false},{"name":"wildcard-email-auth","enabled":true,"variant":{"name":"disabled","enabled":false,"feature_enabled":true},"impressionData":false}],"googleFontsInlined":false},"customCss":[{"filePath":"style.css","content":"/* cyrillic-ext */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 300;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD2OwG_TA.woff2) format('woff2');\n unicode-range: U+0460-052F, U+1C80-1C8A, U+20B4, U+2DE0-2DFF, U+A640-A69F, U+FE2E-FE2F;\n}\n/* cyrillic */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 300;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD_OwG_TA.woff2) format('woff2');\n unicode-range: U+0301, U+0400-045F, U+0490-0491, U+04B0-04B1, U+2116;\n}\n/* greek */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 300;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD4OwG_TA.woff2) format('woff2');\n unicode-range: U+0370-0377, U+037A-037F, U+0384-038A, U+038C, U+038E-03A1, U+03A3-03FF;\n}\n/* vietnamese */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 300;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD0OwG_TA.woff2) format('woff2');\n unicode-range: U+0102-0103, U+0110-0111, U+0128-0129, U+0168-0169, U+01A0-01A1, U+01AF-01B0, U+0300-0301, U+0303-0304, U+0308-0309, U+0323, U+0329, U+1EA0-1EF9, U+20AB;\n}\n/* latin-ext */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 300;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD1OwG_TA.woff2) format('woff2');\n unicode-range: U+0100-02BA, U+02BD-02C5, U+02C7-02CC, U+02CE-02D7, U+02DD-02FF, U+0304, U+0308, U+0329, U+1D00-1DBF, U+1E00-1E9F, U+1EF2-1EFF, U+2020, U+20A0-20AB, U+20AD-20C4, U+2113, U+2C60-2C7F, U+A720-A7FF;\n}\n/* latin */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 300;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD7OwE.woff2) format('woff2');\n unicode-range: U+0000-00FF, U+0131, U+0152-0153, U+02BB-02BC, U+02C6, U+02DA, U+02DC, U+0304, U+0308, U+0329, U+2000-206F, U+20AC, U+2122, U+2191, U+2193, U+2212, U+2215, U+FEFF, U+FFFD;\n}\n/* cyrillic-ext */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 400;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD2OwG_TA.woff2) format('woff2');\n unicode-range: U+0460-052F, U+1C80-1C8A, U+20B4, U+2DE0-2DFF, U+A640-A69F, U+FE2E-FE2F;\n}\n/* cyrillic */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 400;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD_OwG_TA.woff2) format('woff2');\n unicode-range: U+0301, U+0400-045F, U+0490-0491, U+04B0-04B1, U+2116;\n}\n/* greek */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 400;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD4OwG_TA.woff2) format('woff2');\n unicode-range: U+0370-0377, U+037A-037F, U+0384-038A, U+038C, U+038E-03A1, U+03A3-03FF;\n}\n/* vietnamese */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 400;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD0OwG_TA.woff2) format('woff2');\n unicode-range: U+0102-0103, U+0110-0111, U+0128-0129, U+0168-0169, U+01A0-01A1, U+01AF-01B0, U+0300-0301, U+0303-0304, U+0308-0309, U+0323, U+0329, U+1EA0-1EF9, U+20AB;\n}\n/* latin-ext */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 400;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD1OwG_TA.woff2) format('woff2');\n unicode-range: U+0100-02BA, U+02BD-02C5, U+02C7-02CC, U+02CE-02D7, U+02DD-02FF, U+0304, U+0308, U+0329, U+1D00-1DBF, U+1E00-1E9F, U+1EF2-1EFF, U+2020, U+20A0-20AB, U+20AD-20C4, U+2113, U+2C60-2C7F, U+A720-A7FF;\n}\n/* latin */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 400;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD7OwE.woff2) format('woff2');\n unicode-range: U+0000-00FF, U+0131, U+0152-0153, U+02BB-02BC, U+02C6, U+02DA, U+02DC, U+0304, U+0308, U+0329, U+2000-206F, U+20AC, U+2122, U+2191, U+2193, U+2212, U+2215, U+FEFF, U+FFFD;\n}\n/* cyrillic-ext */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 500;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD2OwG_TA.woff2) format('woff2');\n unicode-range: U+0460-052F, U+1C80-1C8A, U+20B4, U+2DE0-2DFF, U+A640-A69F, U+FE2E-FE2F;\n}\n/* cyrillic */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 500;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD_OwG_TA.woff2) format('woff2');\n unicode-range: U+0301, U+0400-045F, U+0490-0491, U+04B0-04B1, U+2116;\n}\n/* greek */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 500;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD4OwG_TA.woff2) format('woff2');\n unicode-range: U+0370-0377, U+037A-037F, U+0384-038A, U+038C, U+038E-03A1, U+03A3-03FF;\n}\n/* vietnamese */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 500;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD0OwG_TA.woff2) format('woff2');\n unicode-range: U+0102-0103, U+0110-0111, U+0128-0129, U+0168-0169, U+01A0-01A1, U+01AF-01B0, U+0300-0301, U+0303-0304, U+0308-0309, U+0323, U+0329, U+1EA0-1EF9, U+20AB;\n}\n/* latin-ext */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 500;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD1OwG_TA.woff2) format('woff2');\n unicode-range: U+0100-02BA, U+02BD-02C5, U+02C7-02CC, U+02CE-02D7, U+02DD-02FF, U+0304, U+0308, U+0329, U+1D00-1DBF, U+1E00-1E9F, U+1EF2-1EFF, U+2020, U+20A0-20AB, U+20AD-20C4, U+2113, U+2C60-2C7F, U+A720-A7FF;\n}\n/* latin */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 500;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD7OwE.woff2) format('woff2');\n unicode-range: U+0000-00FF, U+0131, U+0152-0153, U+02BB-02BC, U+02C6, U+02DA, U+02DC, U+0304, U+0308, U+0329, U+2000-206F, U+20AC, U+2122, U+2191, U+2193, U+2212, U+2215, U+FEFF, U+FFFD;\n}\n/* cyrillic-ext */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 600;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD2OwG_TA.woff2) format('woff2');\n unicode-range: U+0460-052F, U+1C80-1C8A, U+20B4, U+2DE0-2DFF, U+A640-A69F, U+FE2E-FE2F;\n}\n/* cyrillic */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 600;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD_OwG_TA.woff2) format('woff2');\n unicode-range: U+0301, U+0400-045F, U+0490-0491, U+04B0-04B1, U+2116;\n}\n/* greek */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 600;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD4OwG_TA.woff2) format('woff2');\n unicode-range: U+0370-0377, U+037A-037F, U+0384-038A, U+038C, U+038E-03A1, U+03A3-03FF;\n}\n/* vietnamese */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 600;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD0OwG_TA.woff2) format('woff2');\n unicode-range: U+0102-0103, U+0110-0111, U+0128-0129, U+0168-0169, U+01A0-01A1, U+01AF-01B0, U+0300-0301, U+0303-0304, U+0308-0309, U+0323, U+0329, U+1EA0-1EF9, U+20AB;\n}\n/* latin-ext */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 600;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD1OwG_TA.woff2) format('woff2');\n unicode-range: U+0100-02BA, U+02BD-02C5, U+02C7-02CC, U+02CE-02D7, U+02DD-02FF, U+0304, U+0308, U+0329, U+1D00-1DBF, U+1E00-1E9F, U+1EF2-1EFF, U+2020, U+20A0-20AB, U+20AD-20C4, U+2113, U+2C60-2C7F, U+A720-A7FF;\n}\n/* latin */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 600;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD7OwE.woff2) format('woff2');\n unicode-range: U+0000-00FF, U+0131, U+0152-0153, U+02BB-02BC, U+02C6, U+02DA, U+02DC, U+0304, U+0308, U+0329, U+2000-206F, U+20AC, U+2122, U+2191, U+2193, U+2212, U+2215, U+FEFF, U+FFFD;\n}\n/* cyrillic-ext */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 700;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD2OwG_TA.woff2) format('woff2');\n unicode-range: U+0460-052F, U+1C80-1C8A, U+20B4, U+2DE0-2DFF, U+A640-A69F, U+FE2E-FE2F;\n}\n/* cyrillic */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 700;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD_OwG_TA.woff2) format('woff2');\n unicode-range: U+0301, U+0400-045F, U+0490-0491, U+04B0-04B1, U+2116;\n}\n/* greek */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 700;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD4OwG_TA.woff2) format('woff2');\n unicode-range: U+0370-0377, U+037A-037F, U+0384-038A, U+038C, U+038E-03A1, U+03A3-03FF;\n}\n/* vietnamese */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 700;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD0OwG_TA.woff2) format('woff2');\n unicode-range: U+0102-0103, U+0110-0111, U+0128-0129, U+0168-0169, U+01A0-01A1, U+01AF-01B0, U+0300-0301, U+0303-0304, U+0308-0309, U+0323, U+0329, U+1EA0-1EF9, U+20AB;\n}\n/* latin-ext */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 700;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD1OwG_TA.woff2) format('woff2');\n unicode-range: U+0100-02BA, U+02BD-02C5, U+02C7-02CC, U+02CE-02D7, U+02DD-02FF, U+0304, U+0308, U+0329, U+1D00-1DBF, U+1E00-1E9F, U+1EF2-1EFF, U+2020, U+20A0-20AB, U+20AD-20C4, U+2113, U+2C60-2C7F, U+A720-A7FF;\n}\n/* latin */\n@font-face {\n font-family: 'JetBrains Mono';\n font-style: normal;\n font-weight: 700;\n font-display: block;\n src: url(/_mintlify/assets/fonts/google/s/jetbrainsmono/v24/tDbV2o-flEEny0FZhsfKu5WU4xD7OwE.woff2) format('woff2');\n unicode-range: U+0000-00FF, U+0131, U+0152-0153, U+02BB-02BC, U+02C6, U+02DA, U+02DC, U+0304, U+0308, U+0329, U+2000-206F, U+20AC, U+2122, U+2191, U+2193, U+2212, U+2215, U+FEFF, U+FFFD;\n}\n@font-face{font-family:'The Future';src:url('/fonts/the-future-light.woff2') format('woff2');font-weight:300;font-style:normal;font-display:block}@font-face{font-family:'The Future';src:url('/fonts/the-future-bold.woff2') format('woff2');font-weight:700;font-style:normal;font-display:block}body{font-family:'The Future', ui-sans-serif, system-ui, sans-serif!important}code,pre,kbd,samp,.font-mono{font-family:\"JetBrains Mono\", \"SF Mono\", SFMono-Regular, ui-monospace, monospace!important}body :is(.tracking-tight){letter-spacing:0.02em}h1{letter-spacing:-0.5px!important;font-weight:500!important}h2,h3,h4,h5,h6{font-weight:500!important}#content-container>div{max-width:1080px}#topbar-cta-button>a{border-radius:9999px;background-color:white;border:1px solid #EDE9E8;padding:0.375rem 0.75rem;gap:0.625rem;height:32px}#topbar-cta-button>a>div>span{font-size:0.875rem;line-height:1.25rem;font-weight:500;text-align:left;color:#262626;\u0026::after{content:url(\"data:image/svg+xml,%3Csvg%20width%3D%225%22%20height%3D%2221%22%20viewBox%3D%220%200%205%2021%22%20fill%3D%22none%22%20xmlns%3D%22http%3A%2F%2Fwww.w3.org%2F2000%2Fsvg%22%3E%3Cpath%20d%3D%22M1.25%208.44531L3.75%2010.9453L1.25%2013.4453%22%20stroke%3D%22%23262626%22%20stroke-width%3D%221.25%22%20stroke-linecap%3D%22round%22%2F%3E%3C%2Fsvg%3E\");display:inline-block;width:5px;height:21px;vertical-align:middle;margin-left:0.25rem;margin-top:-2px}}.prose:is(.dark *){color:#dadfe7}.method-nav-pill>span[class*=\"#3064E3\"]{background-color:#972E02!important}.method-nav-pill>span[class*=\"bg-blue\"]{background-color:rgba(151, 46, 2, 0.2)!important}.method-nav-pill>span[class*=\"text-blue\"]{color:#972E02!important}.dark .method-nav-pill>span[class*=\"text-blue\"]{color:#fc8050!important}.sidebar-group>button>div,.sidebar-group>div>div,nav [class*=\"group\"]>div:first-child,nav [class*=\"group\"]>button>div{font-family:'The Future', ui-sans-serif, system-ui, sans-serif!important}h1,h2,h3,h4,h5,h6,.prose h1,.prose h2,.prose h3,.prose h4,.prose h5,.prose h6,p,span,a,li,label,button,input,textarea,select,strong,b,.prose strong,.prose b{font-family:'The Future', ui-sans-serif, system-ui, sans-serif!important}strong,b,.prose strong,.prose b,.prose a{font-weight:500!important}pre,pre *,code span,.code-group pre,.code-group pre *,.code-group .code-block-background,.code-group .code-block-background *{font-family:\"JetBrains Mono\", \"SF Mono\", SFMono-Regular, ui-monospace, monospace!important}.columns.card-group>.card:has([data-component-part=\"card-image\"]){border:none!important;box-shadow:none!important;padding:0.25rem!important}.columns.card-group>.card:has([data-component-part=\"card-image\"]):hover{border-color:transparent!important}.columns.card-group>.card [data-component-part=\"card-image\"]{height:170px;width:100%;display:block;object-fit:cover;border-radius:12px;transition:transform 0.3s ease-out}.columns.card-group>.card:hover [data-component-part=\"card-image\"]{transform:scale(1.03)}.columns.card-group>.card:has([data-component-part=\"card-image\"]) [data-component-part=\"card-content-container\"]{padding-left:0!important;padding-right:0!important;padding-top:0.875rem!important}.sidebar-group a[target=\"_blank\"] svg,.sidebar-group a[href*=\"http\"] svg.flex-shrink-0{flex-shrink:0;margin-left:2px;width:10px;height:10px}"}]}
{"page":{"pagePath":"reference/deployments-create","slug":"/reference/deployments-create","pageMetadata":{"openapi":"openapi.yaml POST /v1/deployments","title":"Create a new deployment","description":"Create a new deployment with specified configuration","href":"/reference/deployments-create"},"description":{"compiledSource":"\"use strict\";\nconst {jsx: _jsx} = arguments[0];\nconst {useMDXComponents: _provideComponents} = arguments[0];\nfunction _createMdxContent(props) {\n const _components = {\n p: \"p\",\n ..._provideComponents(),\n ...props.components\n };\n return _jsx(_components.p, {\n children: \"Create a new deployment with specified configuration\"\n });\n}\nfunction MDXContent(props = {}) {\n const {wrapper: MDXLayout} = {\n ..._provideComponents(),\n ...props.components\n };\n return MDXLayout ? _jsx(MDXLayout, {\n ...props,\n children: _jsx(_createMdxContent, {\n ...props\n })\n }) : _createMdxContent(props);\n}\nreturn {\n default: MDXContent\n};\n","frontmatter":{},"scope":{}},"pageType":"default","mdx":{"mdxSource":{"compiledSource":"\"use strict\";const{Fragment:_Fragment,jsx:_jsx}=arguments[0];const{useMDXComponents:_provideComponents}=arguments[0];function _createMdxContent(props){return _jsx(_Fragment,{})}function MDXContent(props={}){const{wrapper:MDXLayout}={..._provideComponents(),...props.components};return MDXLayout?_jsx(MDXLayout,{...props,children:_jsx(_createMdxContent,{...props})}):_createMdxContent(props)}return{default:MDXContent}","frontmatter":{},"scope":{"config":{},"pageMetadata":{"openapi":"openapi.yaml POST /v1/deployments","title":"Create a new deployment","description":"Create a new deployment with specified configuration","href":"/reference/deployments-create"}}},"mdxSourceWithNoJs":null},"mdxExtracts":{"tableOfContents":[],"codeExamples":{}},"jsLinks":["/_mintlify/custom/togetherai-52386018/9caa6b942e5ff42e/cookie-banner.js","/_mintlify/custom/togetherai-52386018/640c2436e532f72c/docs/intro-custom.js","/_mintlify/custom/togetherai-52386018/f691cce87ef66561/cookbook-script.js"],"openApiReferenceData":{"operation":{"description":"Create a new deployment with specified configuration","summary":"Create a new deployment","tags":["Deployments"],"requestBody":"a2a02e04-ab34-4402-9b89-6ca2e8bd8ef5","responses":{"200":"737a08cd-4bfd-4ff9-add3-8d2fde968918","400":"6c3afcb7-196a-4e24-96db-f2b69396923c","500":"87615c88-c9ab-42b5-9481-105c264ba0e8"},"x-codeSamples":[{"lang":"Python","label":"Together AI SDK (Python)","source":"from together import Together\nclient = Together()\n\ndeployment = client.beta.jig.deploy(\n name=\"my-deployment\",\n gpu_type=\"h100-80gb\",\n image=\"registry.together.ai/proj_abcdefg1234567890/my-image:latest\"\n)\nprint(deployment)\n"},{"lang":"TypeScript","label":"Together AI SDK (TypeScript)","source":"import Together from \"together-ai\";\nconst client = new Together();\n\nconst deployment = await client.beta.jig.deploy({\n name: \"my-deployment\",\n gpu_type: \"h100-80gb\",\n image: \"registry.together.ai/proj_abcdefg1234567890/my-image:latest\"\n});\nconsole.log(deployment);\n"},{"lang":"JavaScript","label":"Together AI SDK (JavaScript)","source":"import Together from \"together-ai\";\nconst client = new Together();\n\nconst deployment = await client.beta.jig.deploy({\n name: \"my-deployment\",\n gpu_type: \"h100-80gb\",\n image: \"registry.together.ai/proj_abcdefg1234567890/my-image:latest\"\n});\nconsole.log(deployment);\n"}],"method":"post","type":"path","servers":["2b4a3615-7e45-49fa-b8d8-074fddae6e15"],"security":["ddd2cc19-3ad6-47b0-a1b6-9ad202bfd8d6"],"path":"/v1/deployments","baseUrlOptions":["https://api.together.ai"],"title":"Create a new deployment","codeSamples":[{"label":"Together AI SDK (Python)","lang":"Python","source":"from together import Together\nclient = Together()\n\ndeployment = client.beta.jig.deploy(\n name=\"my-deployment\",\n gpu_type=\"h100-80gb\",\n image=\"registry.together.ai/proj_abcdefg1234567890/my-image:latest\"\n)\nprint(deployment)\n"},{"label":"Together AI SDK (TypeScript)","lang":"TypeScript","source":"import Together from \"together-ai\";\nconst client = new Together();\n\nconst deployment = await client.beta.jig.deploy({\n name: \"my-deployment\",\n gpu_type: \"h100-80gb\",\n image: \"registry.together.ai/proj_abcdefg1234567890/my-image:latest\"\n});\nconsole.log(deployment);\n"},{"label":"Together AI SDK (JavaScript)","lang":"JavaScript","source":"import Together from \"together-ai\";\nconst client = new Together();\n\nconst deployment = await client.beta.jig.deploy({\n name: \"my-deployment\",\n gpu_type: \"h100-80gb\",\n image: \"registry.together.ai/proj_abcdefg1234567890/my-image:latest\"\n});\nconsole.log(deployment);\n"}],"requiredOnlyExamples":false,"requestExampleType":"codeSamples","responseExampleType":"generated"},"dependencies":{"parameters":{},"requestBody":{"content":{"application/json":{"schema":{"properties":{"gpu_type":{"description":"GPUType specifies the GPU hardware to use (e.g., \"h100-80gb\").","enum":["h100-80gb","h100-40gb-mig","h200-140gb","b200-192gb"],"type":"string","isRequired":true,"uniqueKey":"gpu_type","typeLabel":"enum\u003cstring>"},"image":{"description":"Image is the container image to deploy from registry.together.ai.","type":"string","isRequired":true,"uniqueKey":"image","typeLabel":"string"},"name":{"description":"Name is the unique identifier for your deployment. Must contain lowercase letters, numbers, or hyphens, start with a lowercase letter or number, and be 4-63 characters. It cannot be changed.","maxLength":63,"minLength":4,"type":"string","isRequired":true,"uniqueKey":"name","typeLabel":"string"},"args":{"description":"Args overrides the container's CMD. Provide as an array of arguments (e.g., [\"python\", \"app.py\"])","items":{"type":"string","uniqueKey":"args.items.[INDEX]","typeLabel":"string"},"type":"array","uniqueKey":"args","typeLabel":"string[]"},"autoscaling":{"oneOf":[{"type":"object","description":"Autoscaling configuration. Example: {\"metric\": \"QueueBacklogPerWorker\", \"target\": 1.01} to scale based on queue backlog. Omit or set to null to disable autoscaling","properties":{"metric":{"description":"Metric must be HTTPTotalRequests or HTTPAvgRequestDuration","enum":["HTTPTotalRequests","HTTPAvgRequestDuration"],"example":"HTTPTotalRequests","type":"string","uniqueKey":"autoscaling.oneOf.0.metric","typeLabel":"enum\u003cstring>"},"target":{"description":"Target is the threshold value. Default: 100 for HTTPTotalRequests, 500 (ms) for HTTPAvgRequestDuration","example":100,"type":"number","uniqueKey":"autoscaling.oneOf.0.target","typeLabel":"number"},"time_interval_minutes":{"description":"TimeIntervalMinutes is the rate window in minutes. Default: 10","example":10,"type":"integer","uniqueKey":"autoscaling.oneOf.0.time_interval_minutes","typeLabel":"integer"}},"uniqueKey":"autoscaling.oneOf.0","typeLabel":"object"},{"type":"object","description":"Autoscaling configuration. Example: {\"metric\": \"QueueBacklogPerWorker\", \"target\": 1.01} to scale based on queue backlog. Omit or set to null to disable autoscaling","properties":{"metric":{"description":"Metric must be QueueBacklogPerWorker","enum":["QueueBacklogPerWorker"],"example":"QueueBacklogPerWorker","type":"string","uniqueKey":"autoscaling.oneOf.1.metric","typeLabel":"enum\u003cstring>"},"model":{"description":"Model overrides the model name for queue status lookup. Defaults to the deployment app name","type":"string","uniqueKey":"autoscaling.oneOf.1.model","typeLabel":"string"},"target":{"description":"Target is the threshold value. Default: 1.01","example":1.01,"type":"number","uniqueKey":"autoscaling.oneOf.1.target","typeLabel":"number"}},"uniqueKey":"autoscaling.oneOf.1","typeLabel":"object"},{"type":"object","description":"Autoscaling configuration. Example: {\"metric\": \"QueueBacklogPerWorker\", \"target\": 1.01} to scale based on queue backlog. Omit or set to null to disable autoscaling","properties":{"custom_metric_name":{"description":"CustomMetricName is the Prometheus metric name. Must match [a-zA-Z_:][a-zA-Z0-9_:]*","example":"my_custom_metric","type":"string","uniqueKey":"autoscaling.oneOf.2.custom_metric_name","typeLabel":"string"},"metric":{"description":"Metric must be CustomMetric","enum":["CustomMetric"],"example":"CustomMetric","type":"string","uniqueKey":"autoscaling.oneOf.2.metric","typeLabel":"enum\u003cstring>"},"target":{"description":"Target is the threshold value. Default: 500","example":500,"type":"number","uniqueKey":"autoscaling.oneOf.2.target","typeLabel":"number"}},"uniqueKey":"autoscaling.oneOf.2","typeLabel":"object"}],"uniqueKey":"autoscaling","typeLabel":"object"},"capacity_type":{"description":"Controls how replicas above reserved capacity behave. `stable` replicas stay running after scale-up; `preemptible` replicas may be evicted during capacity contention.","enum":["stable","preemptible"],"type":"string","uniqueKey":"capacity_type","typeLabel":"enum\u003cstring>"},"command":{"description":"Command overrides the container's ENTRYPOINT. Provide as an array (e.g., [\"/bin/sh\", \"-c\"])","items":{"type":"string","uniqueKey":"command.items.[INDEX]","typeLabel":"string"},"type":"array","uniqueKey":"command","typeLabel":"string[]"},"cpu":{"description":"CPU is the number of CPU cores to allocate per container instance (e.g., 0.1 = 100 milli cores)","minimum":0.1,"type":"number","uniqueKey":"cpu","typeLabel":"number"},"description":{"description":"Description is an optional human-readable description of your deployment","type":"string","uniqueKey":"description","typeLabel":"string"},"environment_variables":{"description":"EnvironmentVariables is a list of environment variables to set in the container. Each must have a name and either a value or value_from_secret","items":{"properties":{"name":{"description":"Name is the environment variable name (e.g., \"DATABASE_URL\"). Must start with a letter or underscore, followed by letters, numbers, or underscores","type":"string","isRequired":true,"uniqueKey":"environment_variables.items.[INDEX].name","typeLabel":"string"},"value":{"description":"Value is the plain text value for the environment variable. Use this for non-sensitive values. Either Value or ValueFromSecret must be set, but not both","type":"string","uniqueKey":"environment_variables.items.[INDEX].value","typeLabel":"string"},"value_from_secret":{"description":"ValueFromSecret references a secret by name or ID to use as the value. Use this for sensitive values like API keys or passwords. Either Value or ValueFromSecret must be set, but not both","type":"string","uniqueKey":"environment_variables.items.[INDEX].value_from_secret","typeLabel":"string"}},"required":["name"],"type":"object","uniqueKey":"environment_variables.items.[INDEX]","typeLabel":"object"},"type":"array","uniqueKey":"environment_variables","typeLabel":"object[]"},"gpu_count":{"description":"GPUCount is the number of GPUs to allocate per container instance. Defaults to 0 if not specified","type":"integer","uniqueKey":"gpu_count","typeLabel":"integer"},"health_check_path":{"description":"HealthCheckPath is the HTTP path for health checks (e.g., \"/health\"). If set, the platform checks this endpoint to determine container health.","type":"string","uniqueKey":"health_check_path","typeLabel":"string"},"max_replicas":{"description":"MaxReplicas is the maximum number of container instances. Defaults to MinReplicas if not set.","type":"integer","uniqueKey":"max_replicas","typeLabel":"integer"},"memory":{"description":"Memory is the amount of RAM to allocate per container instance in GiB (e.g., 0.5 = 512MiB)","maximum":1000,"type":"number","uniqueKey":"memory","typeLabel":"number"},"min_replicas":{"description":"MinReplicas is the minimum number of container instances to run. Defaults to 1 if not specified","type":"integer","uniqueKey":"min_replicas","typeLabel":"integer"},"model_mounts":{"description":"Model weights to preload from Together's model registry into the container. At most one mount is supported, and it cannot be used with volumes.","items":{"properties":{"model_id":{"description":"Model registry identifier (`ml_...`) whose weights are mounted.","example":"ml_CbJNwQC2ZqCU2iFT3mrCh","type":"string","isRequired":true,"uniqueKey":"model_mounts.items.[INDEX].model_id","typeLabel":"string"},"mount_path":{"description":"Container path where model weights are mounted, such as `/models`.","example":"/models","type":"string","isRequired":true,"uniqueKey":"model_mounts.items.[INDEX].mount_path","typeLabel":"string"},"revision_id":{"description":"Optional validated revision identifier (`rv_...`) to pin; defaults to the latest validated revision.","example":"rv_8kQ2mN4pL7xR9tV1wY3zA","type":"string","uniqueKey":"model_mounts.items.[INDEX].revision_id","typeLabel":"string"}},"required":["model_id","mount_path"],"type":"object","uniqueKey":"model_mounts.items.[INDEX]","typeLabel":"object"},"type":"array","uniqueKey":"model_mounts","typeLabel":"object[]"},"placement_group":{"description":"PlacementGroup co-locates deployments that share this value onto one cluster, so in-cluster traffic between them stays local. A member that cannot co-locate stays pending. Leave empty for no group","type":"string","uniqueKey":"placement_group","typeLabel":"string"},"port":{"description":"Port is the container port your application listens on (e.g., 8080 for web servers). Required if your application serves traffic","maximum":65535,"minimum":1,"type":"integer","uniqueKey":"port","typeLabel":"integer"},"regions":{"description":"Regions confines the deployment to clusters in these regions. Each entry is an exact region or a prefix family like \"us-east\" that matches every \"us-east-*\". A deployment that cannot place in any of them stays pending. Empty means any region","items":{"type":"string","uniqueKey":"regions.items.[INDEX]","typeLabel":"string"},"type":"array","uniqueKey":"regions","typeLabel":"string[]"},"storage":{"description":"Storage is the amount of ephemeral disk storage to allocate per container instance (e.g., 10 = 10GiB)","maximum":400,"type":"integer","uniqueKey":"storage","typeLabel":"integer"},"termination_grace_period_seconds":{"description":"TerminationGracePeriodSeconds is the time in seconds to wait for graceful shutdown before forcefully terminating the replica","type":"integer","uniqueKey":"termination_grace_period_seconds","typeLabel":"integer"},"volumes":{"description":"Volumes is a list of volume mounts to attach to the container. Each mount must reference an existing volume by name","items":{"properties":{"mount_path":{"description":"MountPath is the path in the container where the volume mounts (e.g., \"/data\").","type":"string","isRequired":true,"uniqueKey":"volumes.items.[INDEX].mount_path","typeLabel":"string"},"name":{"description":"Name is the name of the volume to mount. Must reference an existing volume by name or ID","type":"string","isRequired":true,"uniqueKey":"volumes.items.[INDEX].name","typeLabel":"string"},"version":{"description":"Version is the volume version to mount. On create, defaults to the latest version. On update, defaults to the currently mounted version.","type":"integer","uniqueKey":"volumes.items.[INDEX].version","typeLabel":"integer"}},"required":["mount_path","name"],"type":"object","uniqueKey":"volumes.items.[INDEX]","typeLabel":"object"},"type":"array","uniqueKey":"volumes","typeLabel":"object[]"}},"required":["gpu_type","image","name"],"type":"object","uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"image":"\u003cstring>","name":"\u003cstring>","args":["\u003cstring>"],"autoscaling":{"metric":"HTTPTotalRequests","target":100,"time_interval_minutes":10},"command":["\u003cstring>"],"cpu":1.1,"description":"\u003cstring>","environment_variables":[{"name":"\u003cstring>","value":"\u003cstring>","value_from_secret":"\u003cstring>"}],"gpu_count":123,"health_check_path":"\u003cstring>","max_replicas":123,"memory":123,"min_replicas":123,"model_mounts":[{"model_id":"ml_CbJNwQC2ZqCU2iFT3mrCh","mount_path":"/models","revision_id":"rv_8kQ2mN4pL7xR9tV1wY3zA"}],"placement_group":"\u003cstring>","port":32768,"regions":["\u003cstring>"],"storage":123,"termination_grace_period_seconds":123,"volumes":[{"mount_path":"\u003cstring>","name":"\u003cstring>","version":123}]}}},"exampleType":"generated"}},"description":"Deployment configuration","required":true,"exampleType":"generated"},"responses":{"737a08cd-4bfd-4ff9-add3-8d2fde968918":{"description":"Deployment created successfully","content":{"application/json":{"schema":{"properties":{"args":{"description":"Args are the arguments passed to the container's command","items":{"type":"string","uniqueKey":"args.items.[INDEX]","typeLabel":"string"},"type":"array","uniqueKey":"args","typeLabel":"string[]"},"autoscaling":{"oneOf":[{"type":"object","description":"Autoscaling contains autoscaling configuration parameters for this deployment. Omitted when autoscaling is disabled (nil)","properties":{"metric":{"description":"Metric must be HTTPTotalRequests or HTTPAvgRequestDuration","enum":["HTTPTotalRequests","HTTPAvgRequestDuration"],"example":"HTTPTotalRequests","type":"string","uniqueKey":"autoscaling.oneOf.0.metric","typeLabel":"enum\u003cstring>"},"target":{"description":"Target is the threshold value. Default: 100 for HTTPTotalRequests, 500 (ms) for HTTPAvgRequestDuration","example":100,"type":"number","uniqueKey":"autoscaling.oneOf.0.target","typeLabel":"number"},"time_interval_minutes":{"description":"TimeIntervalMinutes is the rate window in minutes. Default: 10","example":10,"type":"integer","uniqueKey":"autoscaling.oneOf.0.time_interval_minutes","typeLabel":"integer"}},"uniqueKey":"autoscaling.oneOf.0","typeLabel":"object"},{"type":"object","description":"Autoscaling contains autoscaling configuration parameters for this deployment. Omitted when autoscaling is disabled (nil)","properties":{"metric":{"description":"Metric must be QueueBacklogPerWorker","enum":["QueueBacklogPerWorker"],"example":"QueueBacklogPerWorker","type":"string","uniqueKey":"autoscaling.oneOf.1.metric","typeLabel":"enum\u003cstring>"},"model":{"description":"Model overrides the model name for queue status lookup. Defaults to the deployment app name","type":"string","uniqueKey":"autoscaling.oneOf.1.model","typeLabel":"string"},"target":{"description":"Target is the threshold value. Default: 1.01","example":1.01,"type":"number","uniqueKey":"autoscaling.oneOf.1.target","typeLabel":"number"}},"uniqueKey":"autoscaling.oneOf.1","typeLabel":"object"},{"type":"object","description":"Autoscaling contains autoscaling configuration parameters for this deployment. Omitted when autoscaling is disabled (nil)","properties":{"custom_metric_name":{"description":"CustomMetricName is the Prometheus metric name. Must match [a-zA-Z_:][a-zA-Z0-9_:]*","example":"my_custom_metric","type":"string","uniqueKey":"autoscaling.oneOf.2.custom_metric_name","typeLabel":"string"},"metric":{"description":"Metric must be CustomMetric","enum":["CustomMetric"],"example":"CustomMetric","type":"string","uniqueKey":"autoscaling.oneOf.2.metric","typeLabel":"enum\u003cstring>"},"target":{"description":"Target is the threshold value. Default: 500","example":500,"type":"number","uniqueKey":"autoscaling.oneOf.2.target","typeLabel":"number"}},"uniqueKey":"autoscaling.oneOf.2","typeLabel":"object"}],"uniqueKey":"autoscaling","typeLabel":"object"},"capacity_type":{"description":"Controls how replicas above reserved capacity behave. `stable` replicas stay running after scale-up; `preemptible` replicas may be evicted during capacity contention.","enum":["stable","preemptible"],"type":"string","uniqueKey":"capacity_type","typeLabel":"enum\u003cstring>"},"command":{"description":"Command is the entrypoint command run in the container","items":{"type":"string","uniqueKey":"command.items.[INDEX]","typeLabel":"string"},"type":"array","uniqueKey":"command","typeLabel":"string[]"},"cpu":{"description":"CPU is the amount of CPU resource allocated to each replica in cores (fractional value is allowed)","type":"number","uniqueKey":"cpu","typeLabel":"number"},"created_at":{"description":"CreatedAt is the ISO8601 timestamp when this deployment was created","type":"string","format":"date-time","uniqueKey":"created_at","typeLabel":"string\u003cdate-time>"},"description":{"description":"Description provides a human-readable explanation of the deployment's purpose or content","type":"string","uniqueKey":"description","typeLabel":"string"},"desired_replicas":{"description":"DesiredReplicas is the number of replicas that the orchestrator is targeting","type":"integer","uniqueKey":"desired_replicas","typeLabel":"integer"},"environment_variables":{"description":"EnvironmentVariables is a list of environment variables set in the container","items":{"properties":{"name":{"description":"Name is the environment variable name (e.g., \"DATABASE_URL\"). Must start with a letter or underscore, followed by letters, numbers, or underscores","type":"string","isRequired":true,"uniqueKey":"environment_variables.items.[INDEX].name","typeLabel":"string"},"value":{"description":"Value is the plain text value for the environment variable. Use this for non-sensitive values. Either Value or ValueFromSecret must be set, but not both","type":"string","uniqueKey":"environment_variables.items.[INDEX].value","typeLabel":"string"},"value_from_secret":{"description":"ValueFromSecret references a secret by name or ID to use as the value. Use this for sensitive values like API keys or passwords. Either Value or ValueFromSecret must be set, but not both","type":"string","uniqueKey":"environment_variables.items.[INDEX].value_from_secret","typeLabel":"string"},"value_from_secret_expires_at":{"description":"ValueFromSecretExpiresAt is the ISO8601 timestamp when the referenced secret expires and is deleted. Read-only, ignored in requests","readOnly":true,"type":"string","format":"date-time","uniqueKey":"environment_variables.items.[INDEX].value_from_secret_expires_at","typeLabel":"string\u003cdate-time>"}},"required":["name"],"type":"object","uniqueKey":"environment_variables.items.[INDEX]","typeLabel":"object"},"type":"array","uniqueKey":"environment_variables","typeLabel":"object[]"},"gpu_count":{"description":"GPUCount is the number of GPUs allocated to each replica in this deployment","type":"integer","uniqueKey":"gpu_count","typeLabel":"integer"},"gpu_type":{"description":"GPUType specifies the type of GPU requested (if any) for this deployment","enum":["h100-80gb","h100-40gb-mig","h200-140gb","b200-192gb"],"type":"string","uniqueKey":"gpu_type","typeLabel":"enum\u003cstring>"},"health_check_path":{"description":"HealthCheckPath is the HTTP path used for health checks of the application","type":"string","uniqueKey":"health_check_path","typeLabel":"string"},"id":{"description":"ID is the unique identifier of the deployment","type":"string","uniqueKey":"id","typeLabel":"string"},"image":{"description":"Image specifies the container image used for this deployment","type":"string","uniqueKey":"image","typeLabel":"string"},"max_replicas":{"description":"MaxReplicas is the maximum number of replicas to run for this deployment","type":"integer","uniqueKey":"max_replicas","typeLabel":"integer"},"memory":{"description":"Memory is the amount of memory allocated to each replica in GiB (fractional value is allowed)","type":"number","uniqueKey":"memory","typeLabel":"number"},"min_replicas":{"description":"MinReplicas is the minimum number of replicas to run for this deployment","type":"integer","uniqueKey":"min_replicas","typeLabel":"integer"},"model_mounts":{"description":"Model weights mounted into this deployment, including the pinned revisions.","items":{"properties":{"model_id":{"description":"Model registry identifier (`ml_...`) whose weights are mounted.","example":"ml_CbJNwQC2ZqCU2iFT3mrCh","type":"string","isRequired":true,"uniqueKey":"model_mounts.items.[INDEX].model_id","typeLabel":"string"},"mount_path":{"description":"Container path where model weights are mounted, such as `/models`.","example":"/models","type":"string","isRequired":true,"uniqueKey":"model_mounts.items.[INDEX].mount_path","typeLabel":"string"},"revision_id":{"description":"Optional validated revision identifier (`rv_...`) to pin; defaults to the latest validated revision.","example":"rv_8kQ2mN4pL7xR9tV1wY3zA","type":"string","uniqueKey":"model_mounts.items.[INDEX].revision_id","typeLabel":"string"}},"required":["model_id","mount_path"],"type":"object","uniqueKey":"model_mounts.items.[INDEX]","typeLabel":"object"},"type":"array","uniqueKey":"model_mounts","typeLabel":"object[]"},"name":{"description":"Name is the name of the deployment","type":"string","uniqueKey":"name","typeLabel":"string"},"object":{"description":"The object type, which is always `deployment`.","const":"deployment","uniqueKey":"object","typeLabel":"any"},"placement_group":{"description":"PlacementGroup co-locates deployments that share this value onto one cluster. Empty when the deployment is not in a group","type":"string","uniqueKey":"placement_group","typeLabel":"string"},"port":{"description":"Port is the container port that the deployment exposes","type":"integer","uniqueKey":"port","typeLabel":"integer"},"ready_replicas":{"description":"ReadyReplicas is the current number of replicas that are in the Ready state","type":"integer","uniqueKey":"ready_replicas","typeLabel":"integer"},"regions":{"description":"Regions confines the deployment to clusters in these regions (exact region or a prefix family like \"us-east\"). Empty means any region","items":{"type":"string","uniqueKey":"regions.items.[INDEX]","typeLabel":"string"},"type":"array","uniqueKey":"regions","typeLabel":"string[]"},"replica_events":{"additionalProperties":{"properties":{"image":{"description":"Image is the container image used for this replica","type":"string","uniqueKey":"replica_events.additionalProperties.image","typeLabel":"string"},"replica_ready_since":{"description":"ReplicaReadySince is the timestamp when the replica became ready to serve traffic","type":"string","uniqueKey":"replica_events.additionalProperties.replica_ready_since","typeLabel":"string"},"replica_status":{"description":"ReplicaStatus is the current status of the replica (e.g., \"Running\", \"Waiting\", \"Terminated\")","type":"string","uniqueKey":"replica_events.additionalProperties.replica_status","typeLabel":"string"},"replica_status_message":{"description":"ReplicaStatusMessage provides a human-readable message explaining the replica's status","type":"string","uniqueKey":"replica_events.additionalProperties.replica_status_message","typeLabel":"string"},"replica_status_reason":{"description":"ReplicaStatusReason provides a brief machine-readable reason for the replica's status","type":"string","uniqueKey":"replica_events.additionalProperties.replica_status_reason","typeLabel":"string"},"revision_id":{"description":"RevisionID is the deployment revision ID associated with this replica","type":"string","uniqueKey":"replica_events.additionalProperties.revision_id","typeLabel":"string"},"volume_preload_completed_at":{"description":"VolumePreloadCompletedAt is the timestamp when the volume preload completed","type":"string","uniqueKey":"replica_events.additionalProperties.volume_preload_completed_at","typeLabel":"string"},"volume_preload_started_at":{"description":"VolumePreloadStartedAt is the timestamp when the volume preload started","type":"string","uniqueKey":"replica_events.additionalProperties.volume_preload_started_at","typeLabel":"string"},"volume_preload_status":{"description":"VolumePreloadStatus is the status of the volume preload (e.g., \"InProgress\", \"Completed\", \"Failed\")","type":"string","uniqueKey":"replica_events.additionalProperties.volume_preload_status","typeLabel":"string"}},"type":"object","uniqueKey":"replica_events.additionalProperties","typeLabel":"object"},"description":"ReplicaEvents is a mapping of replica names or IDs to their status events","type":"object","uniqueKey":"replica_events","typeLabel":"object"},"status":{"type":"string","description":"Status represents the overall status of the deployment (e.g., Updating, Scaling, Ready, Failed)","enum":["Updating","Scaling","Ready","Failed","ScaledToZero"],"x-enum-varnames":["DeploymentStatusUpdating","DeploymentStatusScaling","DeploymentStatusReady","DeploymentStatusFailed","DeploymentStatusScaledToZero"],"uniqueKey":"status","typeLabel":"enum\u003cstring>"},"storage":{"description":"Storage is the amount of storage (in MB or units as defined by the platform) allocated to each replica","type":"integer","uniqueKey":"storage","typeLabel":"integer"},"termination_grace_period_seconds":{"description":"TerminationGracePeriodSeconds is the time in seconds to wait for graceful shutdown before forcefully terminating the replica","type":"integer","uniqueKey":"termination_grace_period_seconds","typeLabel":"integer"},"updated_at":{"description":"UpdatedAt is the ISO8601 timestamp when this deployment was last updated","type":"string","format":"date-time","uniqueKey":"updated_at","typeLabel":"string\u003cdate-time>"},"volumes":{"description":"Volumes is a list of volume mounts for this deployment","items":{"properties":{"mount_path":{"description":"MountPath is the path in the container where the volume mounts (e.g., \"/data\").","type":"string","isRequired":true,"uniqueKey":"volumes.items.[INDEX].mount_path","typeLabel":"string"},"name":{"description":"Name is the name of the volume to mount. Must reference an existing volume by name or ID","type":"string","isRequired":true,"uniqueKey":"volumes.items.[INDEX].name","typeLabel":"string"},"version":{"description":"Version is the volume version to mount. On create, defaults to the latest version. On update, defaults to the currently mounted version.","type":"integer","uniqueKey":"volumes.items.[INDEX].version","typeLabel":"integer"}},"required":["mount_path","name"],"type":"object","uniqueKey":"volumes.items.[INDEX]","typeLabel":"object"},"type":"array","uniqueKey":"volumes","typeLabel":"object[]"}},"type":"object","uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{"args":["\u003cstring>"],"autoscaling":{"metric":"HTTPTotalRequests","target":100,"time_interval_minutes":10},"capacity_type":"stable","command":["\u003cstring>"],"cpu":123,"created_at":"2023-11-07T05:31:56Z","description":"\u003cstring>","desired_replicas":123,"environment_variables":[{"name":"\u003cstring>","value":"\u003cstring>","value_from_secret":"\u003cstring>","value_from_secret_expires_at":"2023-11-07T05:31:56Z"}],"gpu_count":123,"gpu_type":"h100-80gb","health_check_path":"\u003cstring>","id":"\u003cstring>","image":"\u003cstring>","max_replicas":123,"memory":123,"min_replicas":123,"model_mounts":[{"model_id":"ml_CbJNwQC2ZqCU2iFT3mrCh","mount_path":"/models","revision_id":"rv_8kQ2mN4pL7xR9tV1wY3zA"}],"name":"\u003cstring>","object":"deployment","placement_group":"\u003cstring>","port":123,"ready_replicas":123,"regions":["\u003cstring>"],"replica_events":{},"status":"Updating","storage":123,"termination_grace_period_seconds":123,"updated_at":"2023-11-07T05:31:56Z","volumes":[{"mount_path":"\u003cstring>","name":"\u003cstring>","version":123}]}}},"exampleType":"generated"}},"exampleType":"generated"},"6c3afcb7-196a-4e24-96db-f2b69396923c":{"description":"Invalid request","content":{"application/json":{"schema":{"type":"object","uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{}}},"exampleType":"generated"}},"exampleType":"generated"},"87615c88-c9ab-42b5-9481-105c264ba0e8":{"description":"Internal server error","content":{"application/json":{"schema":{"type":"object","uniqueKey":"","typeLabel":"object"},"examples":{"Example":{"title":"Example","value":{}}},"exampleType":"generated"}},"exampleType":"generated"}},"security":{"ddd2cc19-3ad6-47b0-a1b6-9ad202bfd8d6":{"bearerAuth":{"type":"http","scheme":"bearer","x-bearer-format":"bearer","x-default":"default","scopes":[],"schemeName":"bearerAuth"}}},"servers":{"2b4a3615-7e45-49fa-b8d8-074fddae6e15":{"url":"https://api.together.ai","description":"Default environment for APIs"}},"processedSecurityOptions":[{"schemes":[{"scheme":{"type":"http","scheme":"bearer","x-bearer-format":"bearer","x-default":"default","scopes":[],"schemeName":"bearerAuth"},"schema":{"title":"Bearer Auth","type":"string","isRequired":true,"description":"Bearer authentication header of the form `Bearer \u003ctoken>`, where `\u003ctoken>` is your auth token.","format":"bearer","default":"default","typeLabel":"string\u003cbearer>","deprecated":false},"schemeName":"bearerAuth","name":"Authorization"}],"title":"bearerAuth"}]},"originalFileLocation":"openapi.yaml"},"subdomain":"togetherai-52386018","siteName":"Together AI docs","title":"Create a new deployment - Together AI docs","contextualStarterQuestions":[{"_id":"6ad91de3fbf19541c895c336","deploymentId":"686f1c528aaae71885a4b279","questionText":"How do I set deployment parameters?","status":"active","generatedBy":"contextual","path":"reference/deployments-create","createdAt":"2026-10-21T20:17:39.568Z","updatedAt":"2026-10-21T20:17:39.568Z","__v":0},{"_id":"6ad91de3fbf19541c895c335","deploymentId":"686f1c528aaae71885a4b279","questionText":"What configuration options exist?","status":"active","generatedBy":"contextual","path":"reference/deployments-create","createdAt":"2026-10-21T20:17:39.568Z","updatedAt":"2026-10-21T20:17:39.568Z","__v":0},{"_id":"6ad91de3fbf19541c895c334","deploymentId":"686f1c528aaae71885a4b279","questionText":"How do I create a deployment?","status":"active","generatedBy":"contextual","path":"reference/deployments-create","createdAt":"2026-10-21T20:17:39.568Z","updatedAt":"2026-10-21T20:17:39.568Z","__v":0}],"navMaps":{"firstHrefInVersion":{},"firstHrefInLanguage":{}},"lastModified":"2026-10-21T20:17:09.778Z","originalFileLocation":"reference/deployments-create.mdx"},"headHtml":"\u003cscript data-mint-head>(function(){var d=document.documentElement,p=null;if(!p){try{p=localStorage.getItem(\"isDarkMode\")}catch(e){}if(p==='true')p='dark';else if(p==='false')p='light';if(p!=='light'\u0026\u0026p!=='dark'\u0026\u0026p!=='system')p=\"system\"}var r=p==='system'?(matchMedia(\"(prefers-color-scheme: dark)\").matches?'dark':'light'):p;d.classList.remove(r==='dark'?'light':'dark');d.classList.add(r);d.setAttribute(\"data-theme-preference\",p)})();\u003c/script>\u003cmeta data-mint-head name=\"description\" content=\"Create a new deployment with specified configuration\">\u003cmeta data-mint-head name=\"application-name\" content=\"Together AI docs\">\u003cmeta data-mint-head name=\"generator\" content=\"Mintlify\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/togetherai-52386018/GkjET5UlJhhSwWhA/_generated/favicon/android-chrome-192x192.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"apple-touch-icon\" type=\"image/png\" sizes=\"180x180\" href=\"/mintlify-assets/_mintlify/favicons/togetherai-52386018/GkjET5UlJhhSwWhA/_generated/favicon/apple-touch-icon.png\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/togetherai-52386018/GkjET5UlJhhSwWhA/_generated/favicon/favicon-16x16.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/togetherai-52386018/GkjET5UlJhhSwWhA/_generated/favicon/favicon-32x32.png\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/togetherai-52386018/GkjET5UlJhhSwWhA/_generated/favicon/favicon.ico\" media=\"(prefers-color-scheme: light)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"192x192\" href=\"/mintlify-assets/_mintlify/favicons/togetherai-52386018/GkjET5UlJhhSwWhA/_generated/favicon-dark/android-chrome-192x192.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"16x16\" href=\"/mintlify-assets/_mintlify/favicons/togetherai-52386018/GkjET5UlJhhSwWhA/_generated/favicon-dark/favicon-16x16.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"icon\" type=\"image/png\" sizes=\"32x32\" href=\"/mintlify-assets/_mintlify/favicons/togetherai-52386018/GkjET5UlJhhSwWhA/_generated/favicon-dark/favicon-32x32.png\" media=\"(prefers-color-scheme: dark)\">\u003clink data-mint-head rel=\"shortcut icon\" type=\"image/x-icon\" href=\"/mintlify-assets/_mintlify/favicons/togetherai-52386018/GkjET5UlJhhSwWhA/_generated/favicon-dark/favicon.ico\" media=\"(prefers-color-scheme: dark)\">\u003cmeta data-mint-head property=\"og:title\" content=\"Create a new deployment - Together AI docs\">\u003cmeta data-mint-head property=\"og:description\" content=\"Create a new deployment with specified configuration\">\u003cmeta data-mint-head property=\"og:site_name\" content=\"Together AI docs\">\u003cmeta data-mint-head property=\"og:url\" content=\"https://docs.together.ai/reference/deployments-create\">\u003cmeta data-mint-head property=\"og:type\" content=\"website\">\u003cmeta data-mint-head property=\"og:image\" content=\"https://togetherai-52386018.mintlify.site/_mintlify/api/og/v2?division=Deployments\u0026amp;title=Create+a+new+deployment\u0026amp;description=Create+a+new+deployment+with+specified+configuration\u0026amp;theme=f16cbd51dcb07dd312be70df\u0026amp;signature=ea20e0e8a211ae6720c63e1d39f8d4cd9cbdc4bd1c22e47f3635719b98217b35\">\u003cmeta data-mint-head property=\"og:image:width\" content=\"1200\">\u003cmeta data-mint-head property=\"og:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"twitter:card\" content=\"summary_large_image\">\u003cmeta data-mint-head name=\"twitter:title\" content=\"Create a new deployment - Together AI docs\">\u003cmeta data-mint-head name=\"twitter:description\" content=\"Create a new deployment with specified configuration\">\u003cmeta data-mint-head name=\"twitter:image\" content=\"https://togetherai-52386018.mintlify.site/_mintlify/api/og/v2?division=Deployments\u0026amp;title=Create+a+new+deployment\u0026amp;description=Create+a+new+deployment+with+specified+configuration\u0026amp;theme=f16cbd51dcb07dd312be70df\u0026amp;signature=ea20e0e8a211ae6720c63e1d39f8d4cd9cbdc4bd1c22e47f3635719b98217b35\">\u003cmeta data-mint-head name=\"twitter:image:width\" content=\"1200\">\u003cmeta data-mint-head name=\"twitter:image:height\" content=\"630\">\u003cmeta data-mint-head name=\"msapplication-config\" content=\"/mintlify-assets/_mintlify/favicons/togetherai-52386018/GkjET5UlJhhSwWhA/_generated/favicon/browserconfig.xml\">\u003cmeta data-mint-head name=\"apple-mobile-web-app-title\" content=\"Together AI docs\">\u003cmeta data-mint-head name=\"msapplication-TileColor\" content=\"#FC4C02\">\u003clink data-mint-head rel=\"canonical\" href=\"https://docs.together.ai/reference/deployments-create\">\u003clink data-mint-head rel=\"alternate\" type=\"application/xml\" href=\"/sitemap.xml\">\u003clink data-mint-head rel=\"alternate\" type=\"text/markdown\" href=\"/reference/deployments-create.md\">\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@graph\":[{\"@type\":\"Organization\",\"@id\":\"https://docs.together.ai/#organization\",\"name\":\"Together AI docs\",\"url\":\"https://docs.together.ai\",\"logo\":{\"@type\":\"ImageObject\",\"url\":\"https://mintcdn.com/togetherai-52386018/gasg_XMR14P-KB11/logo/logo.svg?fit=max\u0026auto=format\u0026n=gasg_XMR14P-KB11\u0026q=85\u0026s=7ce2e810455d35e5916bb7253983eb98\"}},{\"@type\":\"WebSite\",\"@id\":\"https://docs.together.ai#website\",\"name\":\"Together AI docs\",\"url\":\"https://docs.together.ai\",\"publisher\":{\"@id\":\"https://docs.together.ai/#organization\"}},{\"@type\":\"WebPage\",\"@id\":\"https://docs.together.ai/reference/deployments-create#webpage\",\"url\":\"https://docs.together.ai/reference/deployments-create\",\"name\":\"Create a new deployment\",\"description\":\"Create a new deployment with specified configuration\",\"dateModified\":\"2026-10-21T20:17:09.778Z\",\"isPartOf\":{\"@id\":\"https://docs.together.ai#website\"},\"breadcrumb\":{\"@id\":\"https://docs.together.ai/reference/deployments-create#breadcrumb\"}},{\"@type\":\"BreadcrumbList\",\"@id\":\"https://docs.together.ai/reference/deployments-create#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"TOGETHER APIS\",\"item\":\"https://docs.together.ai/reference/chat-completions\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Containers\",\"item\":\"https://docs.together.ai/reference/deployments-list\"},{\"@type\":\"ListItem\",\"position\":3,\"name\":\"Deployments\",\"item\":\"https://docs.together.ai/reference/deployments-list\"},{\"@type\":\"ListItem\",\"position\":4,\"name\":\"Create a new deployment\",\"item\":\"https://docs.together.ai/reference/deployments-create\"}]},{\"@type\":[\"TechArticle\",\"APIReference\"],\"@id\":\"https://docs.together.ai/reference/deployments-create#apireference\",\"headline\":\"Create a new deployment\",\"name\":\"Create a new deployment\",\"description\":\"Create a new deployment with specified configuration\",\"url\":\"https://docs.together.ai/reference/deployments-create\",\"mainEntityOfPage\":{\"@id\":\"https://docs.together.ai/reference/deployments-create#webpage\"},\"dateModified\":\"2026-10-21T20:17:09.778Z\",\"publisher\":{\"@id\":\"https://docs.together.ai/#organization\"},\"isPartOf\":{\"@id\":\"https://docs.together.ai#website\"}}]}\u003c/script>\u003cscript data-mint-head type=\"application/ld+json\">{\"@context\":\"https://schema.org\",\"@type\":\"WebSite\",\"name\":\"Together AI docs\",\"publisher\":{\"@type\":\"Organization\",\"name\":\"Together AI docs\"},\"provider\":{\"@type\":\"Organization\",\"name\":\"Mintlify\",\"url\":\"https://mintlify.com\"}}\u003c/script>","agentPointerHref":"/reference/deployments-create.md","siteName":"Together AI docs","nav":{"global":null,"tabs":[{"tab":"Documentation","pages":[{"title":"Documentation","href":"/intro"}]},{"tab":"Guides","pages":[{"title":"Guides","href":"/docs/guides"}]},{"tab":"Learn","pages":[{"title":"Learn","href":"/learn"}]},{"tab":"Demos","pages":[{"title":"Demos","href":"/examples"}]},{"tab":"API reference","groups":[{"group":"TOGETHER APIS","pages":[{"group":"Chat","pages":[{"openapi":"openapi.yaml POST /v1/chat/completions","title":"Create chat completion","href":"/reference/chat-completions"}]},{"group":"Images","pages":[{"openapi":"openapi.yaml POST /v1/images/generations","title":"Create image","href":"/reference/post-images-generations"}]},{"group":"Audio","pages":[{"openapi":"openapi.yaml POST /v1/audio/speech","title":"Create audio generation request","href":"/reference/audio-speech"},{"title":"Create realtime text-to-speech","openapi":"openapi.yaml GET /v1/audio/speech/websocket","href":"/reference/audio-speech-websocket"},{"title":"List voices","openapi":"openapi.yaml GET /v1/voices","href":"/reference/voices-list"},{"openapi":"openapi.yaml POST /v1/audio/transcriptions","title":"Create audio transcription request","href":"/reference/audio-transcriptions"},{"openapi":"openapi.yaml POST /v1/audio/translations","title":"Create audio translation request","href":"/reference/audio-translations"},{"openapi":"openapi.yaml GET /v1/realtime","title":"Real-time audio transcription via WebSocket","href":"/reference/audio-transcriptions-realtime"}]},{"group":"Videos","pages":[{"openapi":"openapi.yaml POST /v2/videos","title":"Create video","href":"/reference/create-videos"},{"openapi":"openapi.yaml GET /v2/videos/{id}","title":"Fetch video metadata","href":"/reference/get-videos-id"}]},{"group":"Rerank","pages":[{"openapi":"openapi.yaml POST /v1/rerank","title":"Create a rerank request","href":"/reference/rerank"}]},{"group":"Completion","pages":[{"openapi":"openapi.yaml POST /v1/completions","title":"Create completion","href":"/reference/completions"}]},{"group":"Batches","pages":[{"openapi":"openapi.yaml GET /v1/batches","title":"List batch jobs","href":"/reference/batch-list"},{"openapi":"openapi.yaml POST /v1/batches","title":"Create a batch job","href":"/reference/batch-create"},{"openapi":"openapi.yaml GET /v1/batches/{id}","title":"Get a batch job","href":"/reference/batch-get"},{"openapi":"openapi.yaml POST /v1/batches/{id}/cancel","title":"Cancel a batch job","href":"/reference/batch-cancel"}]},{"group":"Post-training","pages":[{"openapi":"openapi.yaml GET /v1/rl/supported-models","title":"List supported models","href":"/reference/post-training/supported-models-list"},{"openapi":"openapi.yaml POST /v1/rl/rollouts/estimate","title":"Estimate rollout time and price","href":"/reference/post-training/rollouts-estimate"},{"group":"Model resources","pages":[{"openapi":"openapi.yaml GET /v1/rl/model-resources","title":"List model resources","href":"/reference/post-training/model-resources-list"},{"openapi":"openapi.yaml POST /v1/rl/model-resources","title":"Create model resources","href":"/reference/post-training/model-resources-create"},{"openapi":"openapi.yaml POST /v1/rl/model-resources/estimate-cost","title":"Estimate on-demand model resource cost","href":"/reference/post-training/model-resources-estimate-cost"},{"openapi":"openapi.yaml GET /v1/rl/model-resources/{model_resources_id}","title":"Get model resources","href":"/reference/post-training/model-resources-get"},{"openapi":"openapi.yaml POST /v1/rl/model-resources/{model_resources_id}/extend-expiry","title":"Extend model resources expiry","href":"/reference/post-training/model-resources-extend-expiry"},{"openapi":"openapi.yaml POST /v1/rl/model-resources/{model_resources_id}/stop","title":"Stop model resources","href":"/reference/post-training/model-resources-stop"}]},{"group":"Training sessions","pages":[{"openapi":"openapi.yaml GET /v1/rl/training-sessions","title":"List training sessions","href":"/reference/post-training/training-sessions-list"},{"openapi":"openapi.yaml POST /v1/rl/training-sessions","title":"Create training session","href":"/reference/post-training/training-sessions-create"},{"openapi":"openapi.yaml GET /v1/rl/training-sessions/{session_id}","title":"Get training session","href":"/reference/post-training/training-sessions-get"},{"openapi":"openapi.yaml PATCH /v1/rl/training-sessions/{session_id}","title":"Update a training session","href":"/reference/post-training/training-sessions-update"},{"openapi":"openapi.yaml POST /v1/rl/training-sessions/{session_id}/stop","title":"Stop training session","href":"/reference/post-training/training-sessions-stop"}]},{"group":"Operations","pages":[{"openapi":"openapi.yaml POST /v1/rl/training-sessions/{session_id}/operations/forward-backward","title":"Forward-backward pass","href":"/reference/post-training/operations-forward-backward-create"},{"openapi":"openapi.yaml GET /v1/rl/training-sessions/{session_id}/operations/forward-backward/{operation_id}","title":"Get forward-backward operation","href":"/reference/post-training/operations-forward-backward-get"},{"openapi":"openapi.yaml POST /v1/rl/training-sessions/{session_id}/operations/custom-forward-backward","title":"Custom forward-backward pass","href":"/reference/post-training/operations-custom-forward-backward-create"},{"openapi":"openapi.yaml GET /v1/rl/training-sessions/{session_id}/operations/custom-forward-backward/{operation_id}","title":"Get custom forward-backward operation","href":"/reference/post-training/operations-custom-forward-backward-get"},{"openapi":"openapi.yaml POST /v1/rl/training-sessions/{session_id}/operations/optim-step","title":"Optimizer step","href":"/reference/post-training/operations-optim-step-create"},{"openapi":"openapi.yaml GET /v1/rl/training-sessions/{session_id}/operations/optim-step/{operation_id}","title":"Get optim-step operation","href":"/reference/post-training/operations-optim-step-get"},{"openapi":"openapi.yaml POST /v1/rl/training-sessions/{session_id}/operations/sample","title":"Sample","href":"/reference/post-training/operations-sample-create"},{"openapi":"openapi.yaml GET /v1/rl/training-sessions/{session_id}/operations/sample/{operation_id}","title":"Get sample operation","href":"/reference/post-training/operations-sample-get"},{"openapi":"openapi.yaml POST /v1/rl/training-sessions/{session_id}/operations/weights-sync","title":"Weights sync","href":"/reference/post-training/operations-weights-sync-create"},{"openapi":"openapi.yaml GET /v1/rl/training-sessions/{session_id}/operations/weights-sync/{operation_id}","title":"Get weights-sync operation","href":"/reference/post-training/operations-weights-sync-get"},{"openapi":"openapi.yaml POST /v1/rl/training-sessions/{session_id}/operations/inference-checkpoint","title":"Create inference checkpoint","href":"/reference/post-training/operations-inference-checkpoint-create"},{"openapi":"openapi.yaml GET /v1/rl/training-sessions/{session_id}/operations/inference-checkpoint/{operation_id}","title":"Get inference checkpoint operation","href":"/reference/post-training/operations-inference-checkpoint-get"},{"openapi":"openapi.yaml POST /v1/rl/training-sessions/{session_id}/operations/training-checkpoint","title":"Save training checkpoint","href":"/reference/post-training/operations-training-checkpoint-create"},{"openapi":"openapi.yaml GET /v1/rl/training-sessions/{session_id}/operations/training-checkpoint/{operation_id}","title":"Get save training checkpoint operation","href":"/reference/post-training/operations-training-checkpoint-get"}]},{"group":"Checkpoints","pages":[{"openapi":"openapi.yaml GET /v1/rl/checkpoints","title":"List checkpoints","href":"/reference/post-training/checkpoints-list"},{"openapi":"openapi.yaml GET /v1/rl/checkpoints/{id}","title":"Get checkpoint","href":"/reference/post-training/checkpoints-get"},{"openapi":"openapi.yaml GET /v1/rl/checkpoints/{id}/download","title":"Download checkpoint","href":"/reference/post-training/checkpoints-download"}]},{"group":"FP4 preparation","pages":[{"openapi":"openapi.yaml POST /v1/shaping/prepare-for-fp4-inference","title":"Prepare a fine-tuned model for FP4 inference","href":"/reference/post-training/fp4-inference-create"},{"openapi":"openapi.yaml POST /v1/shaping/prepare-for-fp4-inference/estimate","title":"Estimate FP4 preparation cost","href":"/reference/post-training/fp4-inference-estimate"},{"title":"List FP4 preparation jobs","openapi":"openapi.yaml GET /v1/shaping","href":"/reference/post-training/shaping-jobs-list"},{"title":"Get FP4 preparation job","openapi":"openapi.yaml GET /v1/shaping/{id}","href":"/reference/post-training/shaping-jobs-get"},{"title":"Cancel FP4 preparation job","openapi":"openapi.yaml POST /v1/shaping/{id}/cancel","href":"/reference/post-training/shaping-jobs-cancel"},{"title":"List FP4 preparation job events","openapi":"openapi.yaml GET /v1/shaping/{id}/events","href":"/reference/post-training/shaping-jobs-list-events"}]}]},{"group":"Fine-tuning","pages":[{"openapi":"openapi.yaml POST /v1/fine-tunes","title":"Create job","href":"/reference/post-fine-tunes"},{"openapi":"openapi.yaml POST /v1/fine-tunes/estimate-price","title":"Estimate price","href":"/reference/post-fine-tunes-estimate-price"},{"openapi":"openapi.yaml POST /v1/fine-tunes/preview","title":"Preview tokenized data","href":"/reference/post-fine-tunes-preview"},{"openapi":"openapi.yaml GET /v1/fine-tunes","title":"List all jobs","href":"/reference/get-fine-tunes"},{"openapi":"openapi.yaml GET /v1/fine-tunes/{id}","title":"List job","href":"/reference/get-fine-tunes-id"},{"openapi":"openapi.yaml GET /v1/fine-tunes/{id}/events","title":"List job events","href":"/reference/get-fine-tunes-id-events"},{"openapi":"openapi.yaml GET /v1/fine-tunes/{id}/checkpoints","title":"List checkpoints","href":"/reference/get-fine-tunes-id-checkpoint"},{"openapi":"openapi.yaml GET /v1/fine-tunes/{id}/metrics","title":"Get metrics","href":"/reference/get-fine-tunes-id-metrics"},{"openapi":"openapi.yaml GET /v1/fine-tunes/{id}/download-tokenized-dataset","title":"Download tokenized dataset","href":"/reference/get-fine-tunes-id-download-tokenized-dataset"},{"openapi":"openapi.yaml GET /v1/finetune/download","title":"Download model","href":"/reference/get-finetune-download"},{"openapi":"openapi.yaml POST /v1/fine-tunes/{id}/cancel","title":"Cancel job","href":"/reference/post-fine-tunes-id-cancel"},{"openapi":"openapi.yaml DELETE /v1/fine-tunes/{id}","title":"Delete a fine-tune job","href":"/reference/delete-fine-tunes-id"},{"openapi":"openapi.yaml GET /v1/fine-tunes/models/supported","title":"List supported models","href":"/reference/get-fine-tunes-models-supported"},{"openapi":"openapi.yaml GET /v1/fine-tunes/models/limits","title":"Get model limits","href":"/reference/get-fine-tunes-models-limits"}]},{"group":"Files","pages":[{"openapi":"openapi.yaml GET /v1/files","title":"List all files","href":"/reference/get-files"},{"openapi":"openapi.yaml GET /v1/files/{id}","title":"Retrieve file metadata","href":"/reference/get-files-id"},{"openapi":"openapi.yaml DELETE /v1/files/{id}","title":"Delete a file","href":"/reference/delete-files-id"},{"openapi":"openapi.yaml GET /v1/files/{id}/content","title":"Get file contents","href":"/reference/get-files-id-content"},{"openapi":"openapi.yaml POST /v1/files/upload","title":"Upload a file","href":"/reference/upload-file"}]},{"group":"Clusters","pages":[{"openapi":"openapi.yaml POST /v1/compute/clusters","title":"Create a GPU cluster","href":"/reference/clusters-create"},{"openapi":"openapi.yaml GET /v1/compute/clusters","title":"List all GPU clusters","href":"/reference/clusters-list"},{"openapi":"openapi.yaml GET /v1/compute/clusters/{cluster_id}","title":"Get GPU cluster by cluster ID","href":"/reference/clusters-get"},{"openapi":"openapi.yaml PUT /v1/compute/clusters/{cluster_id}","title":"Update a GPU cluster","href":"/reference/clusters-update"},{"openapi":"openapi.yaml DELETE /v1/compute/clusters/{cluster_id}","title":"Delete GPU cluster by cluster ID","href":"/reference/clusters-delete"},{"group":"Storage","pages":[{"openapi":"openapi.yaml POST /v1/compute/clusters/storage/volumes","title":"Create a shared volume","href":"/reference/clusters_storages-create"},{"openapi":"openapi.yaml GET /v1/compute/clusters/storage/volumes","title":"List all shared volumes","href":"/reference/clusters_storages-list"},{"openapi":"openapi.yaml GET /v1/compute/clusters/storage/volumes/{volume_id}","title":"Get a shared volume by ID","href":"/reference/clusters_storages-get"},{"openapi":"openapi.yaml PUT /v1/compute/clusters/storage/volumes","title":"Update a shared volume","href":"/reference/clusters_storages-update"},{"openapi":"openapi.yaml DELETE /v1/compute/clusters/storage/volumes/{volume_id}","title":"Delete a shared volume by ID","href":"/reference/clusters_storages-delete"}]},{"group":"Remediation","pages":[{"openapi":"openapi.yaml GET /v1/compute/clusters/{cluster_id}/instances/{instance_id}/remediations/{remediation_id}","title":null,"href":"/reference/remediation-get"},{"openapi":"openapi.yaml GET /v1/compute/clusters/{cluster_id}/instances/{instance_id}/remediations","title":"List remediations","href":"/reference/remediation-list"},{"openapi":"openapi.yaml POST /v1/compute/clusters/{cluster_id}/instances/{instance_id}/remediations","title":null,"href":"/reference/remediation-create"},{"openapi":"openapi.yaml POST /v1/compute/clusters/{cluster_id}/instances/{instance_id}/remediations/{remediation_id}/approve","title":null,"href":"/reference/remediation-approve"},{"openapi":"openapi.yaml POST /v1/compute/clusters/{cluster_id}/instances/{instance_id}/remediations/{remediation_id}/cancel","title":null,"href":"/reference/remediation-cancel"},{"openapi":"openapi.yaml POST /v1/compute/clusters/{cluster_id}/instances/{instance_id}/remediations/{remediation_id}/reject","title":null,"href":"/reference/remediation-reject"}]},{"openapi":"openapi.yaml GET /v1/compute/regions","title":"List regions and corresponding supported driver versions","href":"/reference/clusters-list-regions"}]},{"group":"Containers","pages":[{"group":"Deployments","pages":[{"openapi":"openapi.yaml GET /v1/deployments","title":"Get the list of deployments","description":"Get a list of all deployments in your project","href":"/reference/deployments-list"},{"openapi":"openapi.yaml POST /v1/deployments","title":"Create a new deployment","href":"/reference/deployments-create"},{"openapi":"openapi.yaml GET /v1/deployments/{id}","title":"Get a deployment by ID or name","description":"Retrieve details of a specific deployment by its ID or name","href":"/reference/deployments-get"},{"openapi":"openapi.yaml PATCH /v1/deployments/{id}","title":"Update a deployment","href":"/reference/deployments-update"},{"openapi":"openapi.yaml DELETE /v1/deployments/{id}","title":"Delete a deployment","href":"/reference/deployments-delete"},{"openapi":"openapi.yaml GET /v1/deployments/{id}/logs","title":"Get logs for a deployment","href":"/reference/deployments-logs"},{"openapi":"openapi.yaml GET /v1/deployments/{id}/revisions","title":"List revision history events of a deployment","href":"/reference/deployments-revisions-list"},{"openapi":"openapi.yaml GET /v1/deployments/{id}/revisions/{revisionIdentifier}","title":"Get the full configuration of a specific revision","href":"/reference/deployments-revisions-get"},{"openapi":"openapi.yaml POST /v1/deployments/{id}/rollback","title":"Roll back a deployment to a previous revision","href":"/reference/deployments-rollback"}]},{"group":"Secrets","pages":[{"openapi":"openapi.yaml GET /v1/deployments/secrets","title":"Get the list of project secrets","href":"/reference/deployments-secrets-list"},{"openapi":"openapi.yaml POST /v1/deployments/secrets","title":"Create a new secret","href":"/reference/deployments-secrets-create"},{"openapi":"openapi.yaml GET /v1/deployments/secrets/{id}","title":"Get a secret by ID or name","href":"/reference/deployments-secrets-get"},{"openapi":"openapi.yaml PATCH /v1/deployments/secrets/{id}","title":"Update a secret","href":"/reference/deployments-secrets-update"},{"openapi":"openapi.yaml DELETE /v1/deployments/secrets/{id}","title":"Delete a secret","href":"/reference/deployments-secrets-delete"}]},{"group":"Storage","pages":[{"openapi":"openapi.yaml GET /v1/deployments/storage/{filename}","title":"Download a file","href":"/reference/deployments-storage-get"},{"openapi":"openapi.yaml GET /v1/deployments/storage/{filename}/url","title":"Get a file download URL","href":"/reference/deployments-storage-get-url"},{"openapi":"openapi.yaml GET /v1/deployments/storage/volumes","title":"Get the list of project volumes","href":"/reference/deployments-storage-volumes-list"},{"openapi":"openapi.yaml POST /v1/deployments/storage/volumes","title":"Create a new volume","href":"/reference/deployments-storage-volumes-create"},{"openapi":"openapi.yaml GET /v1/deployments/storage/volumes/{id}","title":"Get a volume by ID or name","href":"/reference/deployments-storage-volumes-get"},{"openapi":"openapi.yaml PATCH /v1/deployments/storage/volumes/{id}","title":"Update a volume","href":"/reference/deployments-storage-volumes-update"},{"openapi":"openapi.yaml DELETE /v1/deployments/storage/volumes/{id}","title":"Delete a volume","href":"/reference/deployments-storage-volumes-delete"}]},{"group":"Queue","pages":[{"openapi":"openapi.yaml POST /v1/queue/submit","title":"Submit a queued job","href":"/reference/queue-submit"},{"openapi":"openapi.yaml GET /v1/queue/status","title":"Get job status","href":"/reference/queue-status"},{"openapi":"openapi.yaml POST /v1/queue/cancel","title":"Cancel a queued job","href":"/reference/queue-cancel"},{"openapi":"openapi.yaml POST /v1/queue/clear","title":"Clear a model's pending jobs","href":"/reference/queue-clear"},{"openapi":"openapi.yaml GET /v1/queue/metrics","title":"Get queue metrics","href":"/reference/queue-metrics"}]}]},{"group":"Identity","pages":[{"openapi":"openapi.yaml GET /v3/whoami","title":"Identify the caller","href":"/reference/whoami"},{"title":"List projects","openapi":"openapi.yaml GET /v1/projects","href":"/reference/projects-list"}]},{"group":"Billing","pages":[{"title":"Get billing usage","openapi":"openapi.yaml GET /v1/billing/usage","tag":"BETA","playground":"simple","href":"/reference/billing-usage"}]},{"group":"Endpoints","pages":[{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints","title":"List endpoints","href":"/reference/dmi/endpoints-list"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/endpoints","title":"Create an endpoint","href":"/reference/dmi/endpoints-create"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{id}","title":"Get an endpoint","href":"/reference/dmi/endpoints-get"},{"openapi":"openapi.yaml PATCH /v2/projects/{projectId}/endpoints/{id}","title":"Update an endpoint","href":"/reference/dmi/endpoints-update"},{"openapi":"openapi.yaml DELETE /v2/projects/{projectId}/endpoints/{id}","title":"Delete an endpoint","href":"/reference/dmi/endpoints-delete"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{id}/events","title":"List endpoint events","href":"/reference/dmi/endpoints-list-events"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{id}/analytics","title":"Get endpoint analytics","href":"/reference/dmi/endpoints-analytics"},{"openapi":"openapi.yaml GET /v2/organizations/{organizationId}/endpoints","title":"List organization endpoints","href":"/reference/dmi/endpoints-list-organization"},{"group":"Deployments","pages":[{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{endpointId}/deployments","title":"List deployments","href":"/reference/dmi/deployments-list"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/endpoints/{endpointId}/deployments","title":"Create a deployment","href":"/reference/dmi/deployments-create"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{endpointId}/deployments/{id}","title":"Get a deployment","href":"/reference/dmi/deployments-get"},{"openapi":"openapi.yaml PATCH /v2/projects/{projectId}/endpoints/{endpointId}/deployments/{id}","title":"Update a deployment","href":"/reference/dmi/deployments-update"},{"openapi":"openapi.yaml DELETE /v2/projects/{projectId}/endpoints/{endpointId}/deployments/{id}","title":"Delete a deployment","href":"/reference/dmi/deployments-delete"}]},{"group":"Adapters","pages":[{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{endpointId}/deployments/{deploymentId}/adapters","title":"List deployment adapters","href":"/reference/dmi/adapters-list"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/endpoints/{endpointId}/deployments/{deploymentId}/adapters","title":"Add a deployment adapter","href":"/reference/dmi/adapters-add"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{endpointId}/deployments/{deploymentId}/adapters/{id}","title":"Get a deployment adapter","href":"/reference/dmi/adapters-get"},{"openapi":"openapi.yaml PATCH /v2/projects/{projectId}/endpoints/{endpointId}/deployments/{deploymentId}/adapters/{id}","title":"Update a deployment adapter","href":"/reference/dmi/adapters-update"},{"openapi":"openapi.yaml DELETE /v2/projects/{projectId}/endpoints/{endpointId}/deployments/{deploymentId}/adapters/{id}","title":"Remove a deployment adapter","href":"/reference/dmi/adapters-remove"}]},{"group":"Placement profiles","pages":[{"openapi":"openapi.yaml GET /v2/projects/{projectId}/placement-profiles","title":"List placement profiles","href":"/reference/dmi/placement-profiles-list"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/placement-profiles/{id}","title":"Get a placement profile","href":"/reference/dmi/placement-profiles-get"}]},{"group":"Instance types","pages":[{"openapi":"openapi.yaml GET /v2/public/inference-instance-types","title":"List inference instance types","href":"/reference/dmi/instance-types-list"},{"openapi":"openapi.yaml GET /v2/public/inference-instance-types/{id}","title":"Get an inference instance type","href":"/reference/dmi/instance-types-get"}]},{"group":"A/B experiments","pages":[{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{endpointId}/abExperiments","title":"List A/B experiments","href":"/reference/dmi/ab-experiments-list"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/endpoints/{endpointId}/abExperiments","title":"Create an A/B experiment","href":"/reference/dmi/ab-experiments-create"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{endpointId}/abExperiments/{id}","title":"Get an A/B experiment","href":"/reference/dmi/ab-experiments-get"},{"openapi":"openapi.yaml PATCH /v2/projects/{projectId}/endpoints/{endpointId}/abExperiments/{id}","title":"Update an A/B experiment","href":"/reference/dmi/ab-experiments-update"},{"openapi":"openapi.yaml DELETE /v2/projects/{projectId}/endpoints/{endpointId}/abExperiments/{id}","title":"Delete an A/B experiment","href":"/reference/dmi/ab-experiments-delete"}]},{"group":"Shadow experiments","pages":[{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{endpointId}/shadowExperiments","title":"List shadow experiments","href":"/reference/dmi/shadow-experiments-list"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/endpoints/{endpointId}/shadowExperiments","title":"Create a shadow experiment","href":"/reference/dmi/shadow-experiments-create"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{endpointId}/shadowExperiments/{id}","title":"Get a shadow experiment","href":"/reference/dmi/shadow-experiments-get"},{"openapi":"openapi.yaml PATCH /v2/projects/{projectId}/endpoints/{endpointId}/shadowExperiments/{id}","title":"Update a shadow experiment","href":"/reference/dmi/shadow-experiments-update"},{"openapi":"openapi.yaml DELETE /v2/projects/{projectId}/endpoints/{endpointId}/shadowExperiments/{id}","title":"Delete a shadow experiment","href":"/reference/dmi/shadow-experiments-delete"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{endpointId}/shadowExperiments/{experimentId}/targets","title":"List shadow experiment targets","href":"/reference/dmi/shadow-experiment-targets-list"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/endpoints/{endpointId}/shadowExperiments/{experimentId}/targets","title":"Create a shadow experiment target","href":"/reference/dmi/shadow-experiment-targets-create"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{endpointId}/shadowExperiments/{experimentId}/targets/{id}","title":"Get a shadow experiment target","href":"/reference/dmi/shadow-experiment-targets-get"},{"openapi":"openapi.yaml PATCH /v2/projects/{projectId}/endpoints/{endpointId}/shadowExperiments/{experimentId}/targets/{id}","title":"Update a shadow experiment target","href":"/reference/dmi/shadow-experiment-targets-update"},{"openapi":"openapi.yaml DELETE /v2/projects/{projectId}/endpoints/{endpointId}/shadowExperiments/{experimentId}/targets/{id}","title":"Delete a shadow experiment target","href":"/reference/dmi/shadow-experiment-targets-delete"}]},{"group":"Rollouts","pages":[{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{endpointId}/rollouts","title":"List endpoint rollouts","href":"/reference/dmi/rollouts-list"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/endpoints/{endpointId}/rollouts/preview-defaults","title":"Preview rollout defaults","href":"/reference/dmi/rollouts-preview-defaults"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/endpoints/{endpointId}/rollouts","title":"Create a rollout","href":"/reference/dmi/rollouts-create"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/endpoints/{endpointId}/rollouts/{id}","title":"Get a rollout","href":"/reference/dmi/rollouts-get"},{"openapi":"openapi.yaml DELETE /v2/projects/{projectId}/endpoints/{endpointId}/rollouts/{id}","title":"Delete a rollout","href":"/reference/dmi/rollouts-delete"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/endpoints/{endpointId}/rollouts/{id}/start","title":"Start a rollout","href":"/reference/dmi/rollouts-start"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/endpoints/{endpointId}/rollouts/{id}/pause","title":"Pause a rollout","href":"/reference/dmi/rollouts-pause"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/endpoints/{endpointId}/rollouts/{id}/resume","title":"Resume a rollout","href":"/reference/dmi/rollouts-resume"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/endpoints/{endpointId}/rollouts/{id}/promote","title":"Promote a rollout","href":"/reference/dmi/rollouts-promote"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/endpoints/{endpointId}/rollouts/{id}/cancel","title":"Cancel a rollout","href":"/reference/dmi/rollouts-cancel"}]}]},{"group":"Models","pages":[{"openapi":"openapi.yaml GET /v2/supported-models","title":"List supported models","href":"/reference/dmi/supported-models-list"},{"openapi":"openapi.yaml GET /v2/supported-models/{id}","title":"Get a supported model","href":"/reference/dmi/supported-models-get"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/models","title":"List project models","href":"/reference/dmi/models-list"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/models","title":"Create a model","href":"/reference/dmi/models-create"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/models/{id}","title":"Get a model","href":"/reference/dmi/models-get"},{"openapi":"openapi.yaml PATCH /v2/projects/{projectId}/models/{id}","title":"Update a model","href":"/reference/dmi/models-update"},{"openapi":"openapi.yaml DELETE /v2/projects/{projectId}/models/{id}","title":"Delete a model","href":"/reference/dmi/models-delete"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/models/{id}/files","title":"List model files","href":"/reference/dmi/models-list-files"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/models/{id}/revisions","title":"List model revisions","href":"/reference/dmi/models-list-revisions"},{"title":"Get a model revision","openapi":"openapi.yaml GET /v2/projects/{projectId}/models/{id}/revisions/{revisionId}","href":"/reference/dmi/models-get-revision"},{"openapi":"openapi.yaml GET /v2/organizations/{organizationId}/models","title":"List organization models","href":"/reference/dmi/models-list-organization"},{"openapi":"openapi.yaml GET /v2/organizations/{organizationId}/models/{modelId}","title":"Get organization model","href":"/reference/dmi/models-get-organization"},{"openapi":"openapi.yaml POST /v2/projects/{projectId}/models/uploads","title":"Create a remote model upload","href":"/reference/dmi/model-uploads-create"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/models/uploads","title":"List remote model uploads","href":"/reference/dmi/model-uploads-list"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/models/uploads/{id}","title":"Get a remote model upload","href":"/reference/dmi/model-uploads-get"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/models/uploads/{id}/events","title":"List remote model upload events","href":"/reference/dmi/model-uploads-list-events"},{"group":"Model configurations","pages":[{"openapi":"openapi.yaml GET /v2/projects/{projectId}/configs","title":"List model configurations","href":"/reference/dmi/configs-list"},{"openapi":"openapi.yaml GET /v2/projects/{projectId}/configs/{id}","title":"Get a model configuration","href":"/reference/dmi/configs-get"}]}]}]},{"group":"SDK LIBRARIES","pages":[{"title":"Python Library","url":"https://github.com/togethercomputer/together-py","href":"/python-library"},{"title":"TypeScript Library","url":"https://github.com/togethercomputer/together-typescript","href":"/typescript-library"},{"title":"SDK v3 migration","href":"/docs/sdk-v3-migration-guide"},{"title":"SDK v2 migration (Python)","href":"/docs/pythonv2-migration-guide"}]},{"group":"ERROR CODES","pages":[{"title":"Error codes","mode":"wide","href":"/docs/error-codes"}]}]},{"tab":"CLI","pages":[{"title":"CLI","href":"/reference/cli/getting-started"}]},{"tab":"Changelog","pages":[{"title":"Changelog","href":"/docs/changelog"}]}]},"basePath":"","title":"Create a new deployment - Together AI docs","deploymentId":"dpl_7AgmPo2RyRWZ68ZGceW618SWGEAz","buildId":"dpl_7AgmPo2RyRWZ68ZGceW618SWGEAz","dynamics":["c2aa737661","b0f84f53ff","a9bb46feb3","2b790eda92"],"chunks":["OpenApiReferenceProvider-wzXgrCiA.js","snippetPresets-Ctn0LgL5.js","utils-knxdv-fi.js","style-to-object-BY3JEAdk.js","utils-Szn2cJIN.js","v4-DIgz8zy6.js","addUniqueKeysToSchema-CYggQ38U.js","conditional-requirements-CFM0id0Q.js","cloneDeep-a_SFy_bM.js","_Uint8Array-CYON-SEw.js","isObject-FP1Yky1u.js","Page-Dn3dap3J.js","CodeSnippet-Ba_bs1zd.js","DynamicMarkdown-T8UDalrO.js","SectionHeading-DANTRrnD.js","icon-Mqg-z9_o.js","ApiExamples-Bp2XNIJ2.js","usePlaygroundInputsStore-Bv5ea2yO.js","shallow-BeX-jZPB.js","isEqual-DiyXA5rL.js","CodeSnippets-DXnnQSz3.js","getApiPlaygroundDisplay-D0IrdxIN.js","MethodPill-gS6fR7OH.js","getPastedJson-B3wZ4biI.js","Check2Icon-BT0wGl3r.js","axios-CsQoIw0U.js","Markdown-DUz08Fig.js","AssistantPageLink-D3sNlIci.js","dist-BbIWfytJ.js","lib-DMeTj1gb.js","lib-B8HbPgcC.js","katex-Dbtb6Wk7.js","html-void-elements-mCSPHezU.js","marked.esm-CZWythHk.js"]}