Get queue metrics

curl --request GET \
  --url https://api.together.ai/v1/queue/metrics \
  --header 'Authorization: Bearer <token>'

{
  "messages_running": 123,
  "messages_waiting": 123,
  "total_jobs": 123
}

GET

queue

metrics

Get queue metrics

curl --request GET \
  --url https://api.together.ai/v1/queue/metrics \
  --header 'Authorization: Bearer <token>'

{
  "messages_running": 123,
  "messages_waiting": 123,
  "total_jobs": 123
}

Authorization

string

header

default:default

required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

model

string

required

Model name to get metrics for

Queue metrics

Queue job counts for a model.

messages_running

integer

required

Number of jobs currently being processed

messages_waiting

integer

required

Number of jobs waiting to be claimed by a worker

total_jobs

integer

required

Total number of active jobs (waiting + running)

⌘I