Models - Serverless endpoints

The following models are available through the Together Playgrounds and inference API as serverless endpoints. A dedicated instance(s) for these models can also be created for you at your request. See inference pricing.

Run the following command to see the correct prompt format and stop sequence(s).

together models info $MODEL_API_STRING

Chat Models

OrganizationModel NameModel String for APIMax Seq Length
StanfordAlpaca (7B)togethercomputer/alpaca-7b2048
AustismChronos Hermes (13B)Austism/chronos-hermes-13b2048
MetaCode Llama Instruct (13B)togethercomputer/CodeLlama-13b-Instruct8192
MetaCode Llama Instruct (34B)togethercomputer/CodeLlama-34b-Instruct8192
MetaCode Llama Instruct (7B)togethercomputer/CodeLlama-7b-Instruct8192
TII UAEFalcon Instruct (40B)togethercomputer/falcon-40b-instruct2048
TII UAEFalcon Instruct (7B)togethercomputer/falcon-7b-instruct2048
TogetherGPT-NeoXT-Chat-Base (20B)togethercomputer/GPT-NeoXT-Chat-Base-20B2048
MetaLLaMA-2 Chat (13B)togethercomputer/llama-2-13b-chat4096
MetaLLaMA-2 Chat (70B)togethercomputer/llama-2-70b-chat4096
MetaLLaMA-2 Chat (7B)togethercomputer/llama-2-7b-chat4096
TogetherLLaMA-2-7B-32K-Instruct (7B)togethercomputer/Llama-2-7B-32K-Instruct32768
mistralaiMistral (7B) Instructmistralai/Mistral-7B-Instruct-v0.14096
GrypheMythoMax-L2 (13B)Gryphe/MythoMax-L2-13b4096
NousResearchNous Hermes LLaMA-2 (7B)NousResearch/Nous-Hermes-llama-2-7b4096
NousResearchNous Hermes Llama-2 (13B)NousResearch/Nous-Hermes-Llama2-13b4096
NousResearchNous Hermes Llama-2 (70B)NousResearch/Nous-Hermes-Llama2-70b4096
NousResearchNous Capybara v1.9 (7B)NousResearch/Nous-Capybara-7B-V1p98192
tekniumOpenHermes-2-Mistral (7B)teknium/OpenHermes-2-Mistral-7B4096
tekniumOpenHermes-2.5-Mistral (7B)teknium/OpenHermes-2p5-Mistral-7B4096
OpenOrcaOpenOrca Mistral (7B) 8KOpen-Orca/Mistral-7B-OpenOrca8192
garage-bAIndPlatypus2 Instruct (70B)garage-bAInd/Platypus2-70B-instruct4096
TogetherPythia-Chat-Base (7B)togethercomputer/Pythia-Chat-Base-7B-v0.162048
QwenQwen-Chat (7B)togethercomputer/Qwen-7B-Chat8192
TogetherRedPajama-INCITE Chat (3B)togethercomputer/RedPajama-INCITE-Chat-3B-v12048
TogetherRedPajama-INCITE Chat (7B)togethercomputer/RedPajama-INCITE-7B-Chat2048
UpstageSOLAR v0 (70B)upstage/SOLAR-0-70b-16bit4096
LM SysVicuna v1.5 (7B)lmsys/vicuna-7b-v1.54096
LM SysVicuna v1.5 (13B)lmsys/vicuna-13b-v1.54096
LM SysVicuna v1.5 16K (13B)lmsys/vicuna-13b-v1.5-16k16384

Language Models

OrganizationModel NameModel String for APIMax Seq Len
TII UAEFalcon (40B)togethercomputer/falcon-40b2048
TII UAEFalcon (7B)togethercomputer/falcon-7b2048
TogetherGPT-JT (6B)togethercomputer/GPT-JT-6B-v12048
TogetherGPT-JT-Moderation (6B)togethercomputer/GPT-JT-Moderation-6B2048
MetaLLaMA (65B)huggyllama/llama-65b2048
MetaLLaMA-2 (13B)togethercomputer/llama-2-13b4096
MetaLLaMA-2 (70B)togethercomputer/llama-2-70b4096
MetaLLaMA-2 (7B)togethercomputer/llama-2-7b4096
TogetherLLaMA-2-32K (7B)togethercomputer/LLaMA-2-7B-32K32768
EleutherAILlemma (7B)EleutherAI/llemma_7b4096
mistralaiMistral (7B)mistralai/Mistral-7B-v0.14096
QwenQwen (7B)togethercomputer/Qwen-7B8192
TogetherRedPajama-INCITE (3B)togethercomputer/RedPajama-INCITE-Base-3B-v12048
TogetherRedPajama-INCITE (7B)togethercomputer/RedPajama-INCITE-7B-Base2048
TogetherRedPajama-INCITE Instruct (3B)togethercomputer/RedPajama-INCITE-Instruct-3B-v12048
TogetherRedPajama-INCITE Instruct (7B)togethercomputer/RedPajama-INCITE-7B-Instruct2048
WizardLMWizardLM v1.0 (70B)WizardLM/WizardLM-70B-V1.04096

Image Models

OrganizationModel NameModel String for API
WavymulderAnalog Diffusionwavymulder/Analog-Diffusion
Prompt HeroOpenjourney v4prompthero/openjourney
SG161222Realistic Vision 3.0SG161222/Realistic_Vision_V3.0_VAE
Runway MLStable Diffusion 1.5runwayml/stable-diffusion-v1-5
Stability AIStable Diffusion 2.1stabilityai/stable-diffusion-2-1
Stability AIStable Diffusion XL 1.0stabilityai/stable-diffusion-xl-base-1.0

Code Models

OrganizationModel NameModel String for APIMax Seq Len
MetaCode Llama (13B)togethercomputer/CodeLlama-13b16384
MetaCode Llama (34B)togethercomputer/CodeLlama-34b16384
MetaCode Llama (7B)togethercomputer/CodeLlama-7b16384
MetaCode Llama Python (13B)togethercomputer/CodeLlama-13b-Python16384
MetaCode Llama Python (34B)togethercomputer/CodeLlama-34b-Python16384
MetaCode Llama Python (7B)togethercomputer/CodeLlama-7b-Python16384
Numbers StationNSQL LLaMA-2 (7B)NumbersStation/nsql-llama-2-7B4096
PhindPhind Code LLaMA Python v1 (34B)Phind/Phind-CodeLlama-34B-Python-v116384
PhindPhind Code LLaMA v2 (34B)Phind/Phind-CodeLlama-34B-v216384
WizardLMWizardCoder v1.0 (15B)WizardLM/WizardCoder-15B-V1.08192


Request a model