Skip to main content
GET
/
compute
/
clusters
Together AI SDK (v2)
from together import Together
import os

client = Together(
    api_key=os.environ.get("TOGETHER_API_KEY"),
)

response = client.beta.clusters.list()

print(response.clusters)
{
  "clusters": [
    {
      "cluster_id": "<string>",
      "cluster_type": "KUBERNETES",
      "region": "<string>",
      "gpu_type": "H100_SXM",
      "cluster_name": "<string>",
      "volumes": [
        {
          "volume_id": "<string>",
          "volume_name": "<string>",
          "size_tib": 123,
          "status": "<string>"
        }
      ],
      "status": "WaitingForControlPlaneNodes",
      "control_plane_nodes": [
        {
          "node_id": "<string>",
          "node_name": "<string>",
          "status": "<string>",
          "host_name": "<string>",
          "num_cpu_cores": 123,
          "memory_gib": 123,
          "network": "<string>"
        }
      ],
      "gpu_worker_nodes": [
        {
          "node_id": "<string>",
          "node_name": "<string>",
          "status": "<string>",
          "host_name": "<string>",
          "num_cpu_cores": 123,
          "num_gpus": 123,
          "memory_gib": 123,
          "networks": [
            "<string>"
          ],
          "instance_id": "<string>"
        }
      ],
      "kube_config": "<string>",
      "num_gpus": 123,
      "cuda_version": "<string>",
      "nvidia_driver_version": "<string>",
      "duration_hours": 123,
      "slurm_shm_size_gib": 123,
      "capacity_pool_id": "<string>",
      "reservation_start_time": "2023-11-07T05:31:56Z",
      "reservation_end_time": "2023-11-07T05:31:56Z",
      "install_traefik": true,
      "created_at": "2023-11-07T05:31:56Z"
    }
  ]
}

Authorizations

Authorization
string
header
default:default
required

Bearer authentication header of the form Bearer <token>, where <token> is your auth token.

Response

200 - application/json

OK

clusters
object[]
required