Get Queue Metrics

cURL

curl -X GET "https://api.together.ai/v1/queue/metrics?model=my-org/video-generator" \
  -H "Authorization: Bearer $TOGETHER_API_KEY"

{
  "messages_waiting": 12,
  "messages_running": 3,
  "total_jobs": 15
}

GET

queue

metrics

cURL

curl -X GET "https://api.together.ai/v1/queue/metrics?model=my-org/video-generator" \
  -H "Authorization: Bearer $TOGETHER_API_KEY"

{
  "messages_waiting": 12,
  "messages_running": 3,
  "total_jobs": 15
}

Authorization

string

header

default:default

required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

model

string

required

Model name to get metrics for

Queue metrics

messages_running

integer

required

Number of jobs currently being processed

messages_waiting

integer

required

Number of jobs waiting to be claimed by a worker

total_jobs

integer

required

Total number of active jobs (waiting + running)

⌘I