Get evaluation job status and results

# Docs for v1 can be found by changing the above selector ^
from together import Together
import os

client = Together(
    api_key=os.environ.get("TOGETHER_API_KEY"),
)

response = client.evals.status('eval_id')

print(response.status)
print(response.results)

{
  "results": {
    "generation_fail_count": 0,
    "judge_fail_count": 0,
    "invalid_label_count": 0,
    "result_file_id": "file-1234-aefd",
    "pass_percentage": 10,
    "label_counts": "{\"yes\": 10, \"no\": 0}"
  }
}

{
  "error": {
    "message": "<string>",
    "type": "<string>",
    "param": null,
    "code": null
  }
}

{
  "error": {
    "message": "<string>",
    "type": "<string>",
    "param": null,
    "code": null
  }
}

GET

evaluation

{id}

status

# Docs for v1 can be found by changing the above selector ^
from together import Together
import os

client = Together(
    api_key=os.environ.get("TOGETHER_API_KEY"),
)

response = client.evals.status('eval_id')

print(response.status)
print(response.results)

{
  "results": {
    "generation_fail_count": 0,
    "judge_fail_count": 0,
    "invalid_label_count": 0,
    "result_file_id": "file-1234-aefd",
    "pass_percentage": 10,
    "label_counts": "{\"yes\": 10, \"no\": 0}"
  }
}

{
  "error": {
    "message": "<string>",
    "type": "<string>",
    "param": null,
    "code": null
  }
}

{
  "error": {
    "message": "<string>",
    "type": "<string>",
    "param": null,
    "code": null
  }
}

Authorizations

Authorization

string

header

default:default

required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Path Parameters

string

required

The ID of the evaluation job to get the status of

Response

Evaluation job status and results retrieved successfully

status

enum<string>

The status of the evaluation job

Available options:

completed,

error,

user_error,

running,

queued,

pending

results

object

The results of the evaluation job

Option 1
Option 2
Option 3

Show child attributes

Get evaluation job details

Get model list

⌘I

TOGETHER APIS

SDK LIBRARIES

ERROR CODES

Get evaluation job status and results

Authorizations

Path Parameters

Response