Authorizations
Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Query Parameters
Filter endpoints by type
Available options:
dedicated, serverless from together import Together
import os
client = Together(
api_key=os.environ.get("TOGETHER_API_KEY"),
)
endpoints = client.endpoints.list()
for endpoint in endpoints:
print(endpoint.id){
"object": "list",
"data": [
{
"object": "endpoint",
"id": "endpoint-5c0c20db-62fe-4f41-8ffc-d9e4ea1a264e",
"name": "allenai/OLMo-7B",
"model": "allenai/OLMo-7B",
"type": "serverless",
"owner": "together",
"state": "STARTED",
"created_at": "2024-02-28T21:34:35.444Z"
}
]
}Returns a list of all endpoints associated with your account. You can filter the results by type (dedicated or serverless).
from together import Together
import os
client = Together(
api_key=os.environ.get("TOGETHER_API_KEY"),
)
endpoints = client.endpoints.list()
for endpoint in endpoints:
print(endpoint.id){
"object": "list",
"data": [
{
"object": "endpoint",
"id": "endpoint-5c0c20db-62fe-4f41-8ffc-d9e4ea1a264e",
"name": "allenai/OLMo-7B",
"model": "allenai/OLMo-7B",
"type": "serverless",
"owner": "together",
"state": "STARTED",
"created_at": "2024-02-28T21:34:35.444Z"
}
]
}Bearer authentication header of the form Bearer <token>, where <token> is your auth token.
Filter endpoints by type
dedicated, serverless Was this page helpful?