List all endpoints - Together AI docs

# Docs for v1 can be found by changing the above selector ^
from together import Together
import os

client = Together(
    api_key=os.environ.get("TOGETHER_API_KEY"),
)

response = client.endpoints.list()

for endpoint in response.data:
    print(endpoint.id)

{
  "object": "list",
  "data": [
    {
      "object": "endpoint",
      "id": "endpoint-5c0c20db-62fe-4f41-8ffc-d9e4ea1a264e",
      "name": "allenai/OLMo-7B",
      "model": "allenai/OLMo-7B",
      "type": "serverless",
      "owner": "together",
      "state": "STARTED",
      "created_at": "2024-02-28T21:34:35.444Z"
    }
  ]
}

{
  "error": {
    "message": "<string>",
    "type": "<string>",
    "param": null,
    "code": null
  }
}

{
  "error": {
    "message": "<string>",
    "type": "<string>",
    "param": null,
    "code": null
  }
}

GET

endpoints

# Docs for v1 can be found by changing the above selector ^
from together import Together
import os

client = Together(
    api_key=os.environ.get("TOGETHER_API_KEY"),
)

response = client.endpoints.list()

for endpoint in response.data:
    print(endpoint.id)

{
  "object": "list",
  "data": [
    {
      "object": "endpoint",
      "id": "endpoint-5c0c20db-62fe-4f41-8ffc-d9e4ea1a264e",
      "name": "allenai/OLMo-7B",
      "model": "allenai/OLMo-7B",
      "type": "serverless",
      "owner": "together",
      "state": "STARTED",
      "created_at": "2024-02-28T21:34:35.444Z"
    }
  ]
}

{
  "error": {
    "message": "<string>",
    "type": "<string>",
    "param": null,
    "code": null
  }
}

{
  "error": {
    "message": "<string>",
    "type": "<string>",
    "param": null,
    "code": null
  }
}

Authorizations

Authorization

string

header

default:default

required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Query Parameters

type

enum<string>

Filter endpoints by type

Available options:

dedicated,

serverless

usage_type

enum<string>

Filter endpoints by usage type

Available options:

on-demand,

reserved

mine

boolean

If true, return only endpoints owned by the caller

Response

200

object

any

required

The object type, which is always list.

data

object[]

required

Show child attributes

List available hardware configurations

⌘I