1. Click on the Cluster size, for example 8xH1002. Enter a cluster name3. Choose a cluster type4. Select a Region5. Select the required duration for your cluster6. Create and name your shared volume. The minimum size is 1TB7. Optional: Select your Nvidia driver and CUDA versions8. Click on Proceed
Check Status of your Cluster
Increase your cluster size : click on the … in the cluster line and click on Edit Cluster and click on “Number of GPUs” select the desired amount and click update
Get the cluster Kubeconfig
To schedule kubernetes jobs on your cluster, download the kubectl context from the Instant Clusters UI page and copy it to your local machine
Text
Copy
Ask AI
~/.kube/config_k8s_together_instantexport KUBECONFIG=$HOME/.kube/config_k8s_together_instant or kubectl --kubeconfig=$HOME/.kube/config_k8s_together_instant get nodes
Note: It’s possible to name config as the default “config”. If doing so, make sure to take a backup of your current config file prior
Verify you can connect to your K8s cluster
Text
Copy
Ask AI
kubectl get nodesNAME STATUS ROLES AGE VERSION5fa43eae-01.cloud.together.ai Ready <none> 21h v1.31.4+k3s15fa43eae-02.cloud.together.ai Ready <none> 21h v1.31.4+k3s15fa43eae-hn1.cloud.together.ai Ready control-plane,etcd,master 22h v1.31.4+k3s15fa43eae-hn2.cloud.together.ai Ready control-plane,etcd,master 8h v1.31.4+k3s15fa43eae-hn3.cloud.together.ai Ready control-plane,etcd,master 22h v1.31.4+k3s1
How to deploy a pod from a docker image
Create a manifest yaml for storage to mount on your container
iii. Create a manifest yaml file with your docker image and mount the volumes created above. This is a general purpose shell test pod with ubuntu allowing you to see files on the data volume for example.
b. Create the pod by running kubectl apply -f manifest.yamlc. Get a shell into the pod by running kubectl exec -it test-pod -- bash
How to access to the Kubernetes Dashboard
You can access the k8s dashboard by clicking on your cluster’s name, then click on the k8s dashboard url. You will be prompted to enter a password, which can be obtained as follows:
You can authenticate with Together Cloud using Google Single Sign-On (SSO) via the tcloud CLI. Run the following command:
Text
Copy
Ask AI
%tcloud sso loginYour verification code is: ABC-DEFG-HIJOpening browser to https://www.google.com/deviceWaiting for device authorization...
Open https://www.google.com/device in your browser and enter the verification code to complete authentication. Note: You must be part of an approved Google Workspace organization to authenticate.
Callout: Cluster creation requires a valid payment method to be set up in your account.You can add a payment method at https://api.together.ai/settings/billing.