SDK v3 migration

• Dedicated model inference and GPU clusters are no longer in the beta namespace.
• /v1 is dropped from the base URL.
• whoami returns a typed identity.
• Deprecated APIs and import paths have been removed.

# Python SDK
uv add "together>=3.0.0"

# TypeScript SDK
npm install together-ai@latest

# Together CLI
uv tool install "together[cli]" --upgrade

​

Dedicated model inference out of the beta namespace

​

GPU clusters out of the beta namespace

• Autoscaling flag: clusters.create() no longer takes auto_scaled. Use auto_scale with auto_scale_max_gpus.
• Remediation ID: clusters.remediations.create() no longer takes remediation_id, and tg clusters remediations create no longer takes --remediation-id. The service assigns the ID, so read it from the response.

​

Removed v1 dedicated endpoint methods

• endpoints.create(), list(), retrieve(), update(), and delete() with v1 arguments.
• endpoints.list_hardware() and endpoints.list_avzones().
• endpoints.adapters.add(), remove(), and list(endpoint_id).
• models.list(dedicated=...), models.upload(), and models.uploads.status().

• tg endpoints create, start, stop, hardware, availability-zones, and adapters.
• tg models list --type and tg models upload --model-name --model-source.

​

Base URL without /v1

from together import Together

# 2.x: Together(base_url="https://api-inference.together.ai/v1")
client = Together(base_url="https://api-inference.together.ai")

import Together from "together-ai";

// 0.58: new Together({ baseURL: "https://api-inference.together.ai/v1" })
const client = new Together({ baseURL: "https://api-inference.together.ai" });

​

whoami returns a typed identity

from together import Together

client = Together()

# 2.x: project_id = client.whoami().project_id
identity = client.whoami()
if identity.type != "project_api_key":
    raise RuntimeError("TOGETHER_API_KEY must be a project API key")
project_id = identity.project.id

import Together from "together-ai";

const client = new Together();

// 0.58: const { project_id: projectId } = await client.whoami();
const identity = await client.whoami();
if (identity.type !== "project_api_key") {
  throw new Error("TOGETHER_API_KEY must be a project API key");
}
const projectId = identity.project.id;

​

Removed aliases and import paths

• Organization usage: Both SDKs add client.organization.usage.costs.list(). In TypeScript, client.organization replaces the empty client.beta.organization namespace. In Python, the types moved from together.types.beta.organization to together.types.organization.
• Post-training imports: The together.lib.beta.rl and together.lib.post_training import paths are gone. Import from together.post_training.
• Python errors and constants: The together.error and together.constants modules are gone. Import exceptions such as RateLimitError from together.
• Python v1 type aliases: together.types no longer exports ChatCompletion, ChatCompletionChunk, ChatCompletionUsage, ChatCompletionResponse, CompletionResponse, UsageData, ListEndpoint, ImageRequest, or ImageResponse. Import the generated types from their submodules instead, such as ChatCompletion from together.types.chat.

​

Removed APIs and parameters

• Legacy function calling: Chat completions no longer accept assistant messages with function_call or messages with the function role, and responses no longer include function_call. In TypeScript, the chat completion runner’s finalFunctionCall() is gone too. Use tools and messages with the tool role, as in Function calling.
• Video keyframes and references: videos.create() no longer takes top-level frame_images or reference_images. Pass them inside media, as in Reference images and keyframes.
• Code interpreter: client.code_interpreter in Python and client.codeInterpreter in TypeScript are gone, along with the API they called.
• Fine-tuning delete: fine_tuning.delete() no longer takes force.
• TypeScript fine-tuning inputs: fineTuning.create() no longer takes a top-level train_on_inputs. Pass it inside training_method. The Python SDK still accepts the keyword.
• FP4 preparation inputs: adapter_object_id and adapter_revision_id are gone from the inputs of post_training.prepare_for_fp4_inference.create() and estimate_cost(). Use model_object_id and model_revision_id.
• File processing status: File responses no longer include processed. Read processing_status.
• TypeScript file checks: client.files.upload() no longer takes a third check argument. Pass only the file path and the purpose. The SDK no longer checks file contents before uploading, but the server still validates them. The Python SDK keeps check.

​

Getting help

• Browse the SDK source in the together-py and together-typescript repos.
• For code written against the v1 Python SDK, start with the Python SDK v2 migration.
• Report issues on Discord or contact support.