Chat

Query a chat model

To query a chat model, use the together chat.completions method.

Use the --model option to choose your model, and the --message option to pass in a message's role and text:

together chat.completions \
  --model mistralai/Mixtral-8x7B-Instruct-v0.1 \
  --message "user" "What's 1 + 1?"

You can also pass in multiple messages:

together chat.completions \
  --model mistralai/Mixtral-8x7B-Instruct-v0.1 \
  --message "system" "You are a helpful assistant named Together" \
  --message "user" "What is your name?"

Start an interactive chat

You can start an interactive chat with the together chat.interactive method.

Pass in the model using the --model option to kick off a new chat:

together chat.interactive \
  --model mistralai/Mixtral-8x7B-Instruct-v0.1

View all commands

To see all the available chat completions commands, run:

together chat.completions --help

To see all the available chat interactive commands, run:

together chat.interactive --help