Skip to main content
GET
/
evaluation
# Docs for v2 can be found by changing the above selector ^
from together import Together
import os

client = Together(
    api_key=os.environ.get("TOGETHER_API_KEY"),
)

jobs = client.evaluation.list()

for job in jobs:
    print(job.workflow_id)
[
  {
    "workflow_id": "eval-1234aedf",
    "type": "classify",
    "owner_id": "<string>",
    "status": "completed",
    "status_updates": [
      {
        "status": "pending",
        "message": "Job is pending evaluation",
        "timestamp": "2025-07-23T17:10:04.837888Z"
      }
    ],
    "parameters": {},
    "created_at": "2025-07-23T17:10:04.837888Z",
    "updated_at": "2025-07-23T17:10:04.837888Z",
    "results": {
      "generation_fail_count": 0,
      "judge_fail_count": 0,
      "invalid_label_count": 0,
      "result_file_id": "file-1234-aefd",
      "pass_percentage": 10,
      "label_counts": "{\"yes\": 10, \"no\": 0}"
    }
  }
]

Authorizations

​
Authorization
string
header
default:default
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Query Parameters

​
status
string
default:pending
​
limit
integer
default:10
​
userId
string

Admin users can specify a user ID to filter jobs. Pass empty string to get all jobs.

Response

evaluation jobs retrieved successfully

​
workflow_id
string

The evaluation job ID

Example:

"eval-1234aedf"

​
type
enum<string>

The type of evaluation

Available options:
classify,
score,
compare
Example:

"classify"

​
owner_id
string

ID of the job owner (admin only)

​
status
enum<string>

Current status of the job

Available options:
pending,
queued,
running,
completed,
error,
user_error
Example:

"completed"

​
status_updates
object[]

History of status updates (admin only)

​
parameters
object

The parameters used for this evaluation

​
created_at
string<date-time>

When the job was created

Example:

"2025-07-23T17:10:04.837888Z"

​
updated_at
string<date-time>

When the job was last updated

Example:

"2025-07-23T17:10:04.837888Z"

​
results
object

Results of the evaluation (when completed)

  • Option 1
  • Option 2
  • Option 3
  • Option 4