Skip to main content
POST
/
evaluation
Create an evaluation job
curl --request POST \
  --url https://api.together.xyz/v1/evaluation \
  --header 'Authorization: Bearer <token>' \
  --header 'Content-Type: application/json' \
  --data '{
  "type": "classify",
  "parameters": {
    "judge": {
      "model": "meta-llama/Llama-3-70B-Instruct-Turbo",
      "system_template": "Imagine you are a helpful assistant",
      "model_source": "serverless",
      "external_api_token": "<string>",
      "external_base_url": "<string>"
    },
    "labels": [
      "yes",
      "no"
    ],
    "pass_labels": [
      "yes"
    ],
    "model_to_evaluate": "<string>",
    "input_data_file_path": "file-1234-aefd"
  }
}'
{
  "workflow_id": "eval-1234-1244513",
  "status": "pending"
}

Authorizations

Authorization
string
header
default:default
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Body

application/json
type
enum<string>
required

The type of evaluation to perform

Available options:
classify,
score,
compare
Example:

"classify"

parameters
object
required

Type-specific parameters for the evaluation

  • Option 1
  • Option 2
  • Option 3

Response

Evaluation job created successfully

workflow_id
string

The ID of the created evaluation job

Example:

"eval-1234-1244513"

status
enum<string>

Initial status of the job

Available options:
pending