Models - Dedicated instances

The following models can be hosted as a private dedicated instance(s) on Together platform at your request. To request, click the model name in the Together Playgrounds and click Contact Us. See the pricing in inference pricing.

Some of the models are also available through our serverless endpoints. Check out the full list in Models - Serverless endpoint.

Run the following command to see the correct prompt format and stop sequence(s).

together models info $MODEL_API_STRING

Chat Models

OrganizationModel NameModel String for APIMax Seq Length
StanfordAlpaca (7B)togethercomputer/alpaca-7b2048
AustismChronos Hermes (13B)Austism/chronos-hermes-13b2048
MetaCode Llama Instruct (13B)togethercomputer/CodeLlama-13b-Instruct8192
MetaCode Llama Instruct (34B)togethercomputer/CodeLlama-34b-Instruct8192
MetaCode Llama Instruct (7B)togethercomputer/CodeLlama-7b-Instruct8192
DatabricksDolly v2 (12B)databricks/dolly-v2-12b2048
DatabricksDolly v2 (3B)databricks/dolly-v2-3b2048
DatabricksDolly v2 (7B)databricks/dolly-v2-7b2048
TII UAEFalcon Instruct (40B)togethercomputer/falcon-40b-instruct2048
TII UAEFalcon Instruct (7B)togethercomputer/falcon-7b-instruct2048
TogetherGPT-NeoXT-Chat-Base (20B)togethercomputer/GPT-NeoXT-Chat-Base-20B2048
Tim DettmersGuanaco (13B)togethercomputer/guanaco-13b2048
Tim DettmersGuanaco (33B)togethercomputer/guanaco-33b2048
Tim DettmersGuanaco (65B)togethercomputer/guanaco-65b2048
Tim DettmersGuanaco (7B)togethercomputer/guanaco-7b2048
SalesforceInstructCodeT5 (16B)Salesforce/instructcodet5p-16b2048
LM SysKoala (13B)togethercomputer/Koala-13B2048
2048Koala (7B)togethercomputer/Koala-7B2048
OpenAssistantLLaMA 2 SFT v10 (70B)OpenAssistant/llama2-70b-oasst-sft-v104096
MetaLLaMA-2 Chat (13B)togethercomputer/llama-2-13b-chat4096
MetaLLaMA-2 Chat (70B)togethercomputer/llama-2-70b-chat4096
MetaLLaMA-2 Chat (7B)togethercomputer/llama-2-7b-chat4096
TogetherLLaMA-2-7B-32K-Instruct (7B)togethercomputer/Llama-2-7B-32K-Instruct32768
Mosaic MLMPT-Chat (30B)togethercomputer/mpt-30b-chat2048
Mosaic MLMPT-Chat (7B)togethercomputer/mpt-7b-chat2048
mistralaiMistral (7B) Instructmistralai/Mistral-7B-Instruct-v0.14096
GrypheMythoMax-L2 (13B)Gryphe/MythoMax-L2-13b4096
NousResearchNous Hermes LLaMA-2 (70B)NousResearch/Nous-Hermes-Llama2-70b4096
NousResearchNous Hermes LLaMA-2 (7B)NousResearch/Nous-Hermes-llama-2-7b4096
Nous ResearchNous Hermes Llama-2 (13B)NousResearch/Nous-Hermes-Llama2-13b4096
LAIONOpen-Assistant LLaMA SFT-6 (30B)OpenAssistant/oasst-sft-6-llama-30b-xor2048
LAIONOpen-Assistant Pythia SFT-4 (12B)OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.52048
LAIONOpen-Assistant StableLM SFT-7 (7B)OpenAssistant/stablelm-7b-sft-v7-epoch-34096
tekniumOpenHermes-2-Mistral (7B)teknium/OpenHermes-2-Mistral-7B4096
OpenOrcaOpenOrca Mistral (7B) 8KOpen-Orca/Mistral-7B-OpenOrca8192
garage-bAIndPlatypus2 Instruct (70B)garage-bAInd/Platypus2-70B-instruct4096
TogetherPythia-Chat-Base (7B)togethercomputer/Pythia-Chat-Base-7B-v0.162048
QwenQwen-Chat (7B)togethercomputer/Qwen-7B-Chat8192
TogetherRedPajama-INCITE Chat (3B)togethercomputer/RedPajama-INCITE-Chat-3B-v12048
TogetherRedPajama-INCITE Chat (7B)togethercomputer/RedPajama-INCITE-7B-Chat2048
UpstageSOLAR v0 (70B)upstage/SOLAR-0-70b-16bit4096
HuggingFaceH4StarCoderChat Alpha (16B)HuggingFaceH4/starchat-alpha8192
LM SysVicuna v1.3 (13B)lmsys/vicuna-13b-v1.32048
LM SysVicuna v1.3 (7B)lmsys/vicuna-7b-v1.32048
LM SysVicuna v1.5 (13B)lmsys/vicuna-13b-v1.54096
LM SysVicuna v1.5 (7B)lmsys/vicuna-7b-v1.54096
LM SysVicuna-FastChat-T5 (3B)lmsys/fastchat-t5-3b-v1.0512

Language Models

OrganizationModel NameModel String for APIMax Seq Length
TII UAEFalcon (40B)togethercomputer/falcon-40b2048
TII UAEFalcon (7B)togethercomputer/falcon-7b2048
GoogleFlan T5 XL (3B)google/flan-t5-xl512
GoogleFlan T5 XXL (11B)google/flan-t5-xxl512
EleutherAIGPT-J (6B)EleutherAI/gpt-j-6b2048
TogetherGPT-JT (6B)togethercomputer/GPT-JT-6B-v12048
TogetherGPT-JT-Moderation (6B)togethercomputer/GPT-JT-Moderation-6B2048
EleutherAIGPT-NeoX (20B)EleutherAI/gpt-neox-20b2048
MetaLLaMA (13B)huggyllama/llama-13b2048
MetaLLaMA (30B)huggyllama/llama-30b2048
MetaLLaMA (65B)huggyllama/llama-65b2048
MetaLLaMA (7B)huggyllama/llama-7b2048
MetaLLaMA-2 (13B)togethercomputer/llama-2-13b4096
MetaLLaMA-2 (70B)togethercomputer/llama-2-70b4096
MetaLLaMA-2 (7B)togethercomputer/llama-2-7b4096
TogetherLLaMA-2-32K (7B)togethercomputer/LLaMA-2-7B-32K32768
EleutherAILlemma (7B)EleutherAI/llemma_7b4096
Mosaic MLMPT (30B)togethercomputer/mpt-30b2048
2048MPT (7B)togethercomputer/mpt-7b2048
Mosaic MLMPT-Instruct (7B)togethercomputer/mpt-7b-instruct2048
mistralaiMistral (7B)mistralai/Mistral-7B-v0.14096
Numbers StationNSQL (6B)NumbersStation/nsql-6B2048
Nous ResearchNous Hermes (13B)NousResearch/Nous-Hermes-13b2048
EleutherAIPythia (12B)EleutherAI/pythia-12b-v02048
EleutherAIPythia (1B)EleutherAI/pythia-1b-v02048
EleutherAIPythia (2.8B)EleutherAI/pythia-2.8b-v02048
EleutherAIPythia (6.9B)EleutherAI/pythia-6.9b2048
QwenQwen (7B)togethercomputer/Qwen-7B8192
TogetherRedPajama-INCITE (3B)togethercomputer/RedPajama-INCITE-Base-3B-v12048
TogetherRedPajama-INCITE (7B)togethercomputer/RedPajama-INCITE-7B-Base2048
TogetherRedPajama-INCITE Instruct (3B)togethercomputer/RedPajama-INCITE-Instruct-3B-v12048
TogetherRedPajama-INCITE Instruct (7B)togethercomputer/RedPajama-INCITE-7B-Instruct2048
DefogSqlcoder (15B)defog/sqlcoder8192
Stability AIStableLM-Base-Alpha (3B)stabilityai/stablelm-base-alpha-3b4096
Stability AIStableLM-Base-Alpha (7B)stabilityai/stablelm-base-alpha-7b4096
WizardLMWizardLM v1.0 (70B)WizardLM/WizardLM-70B-V1.04096

Image Models

OrganizationModel NameModel String for API
Prompt HeroOpenjourney v4prompthero/openjourney
SG161222Realistic Vision 3.0SG161222/Realistic_Vision_V3.0_VAE
Runway MLStable Diffusion 1.5runwayml/stable-diffusion-v1-5
Stability AIStable Diffusion 2.1stabilityai/stable-diffusion-2-1
Stability AIStable Diffusion XL 1.0stabilityai/stable-diffusion-xl-base-1.0
WavymulderAnalog Diffusionwavymulder/Analog-Diffusion

Code Models

OrganizationModel NameModel String for APIMax Seq Length
MetaCode Llama (13B)togethercomputer/CodeLlama-13b8192
MetaCode Llama (34B)togethercomputer/CodeLlama-34b8192
MetaCode Llama (7B)togethercomputer/CodeLlama-7b8192
MetaCode Llama Python (13B)togethercomputer/CodeLlama-13b-Python8192
MetaCode Llama Python (34B)togethercomputer/CodeLlama-34b-Python8192
MetaCode Llama Python (7B)togethercomputer/CodeLlama-7b-Python8192
SalesforceCodeGen2 (16B)togethercomputer/codegen2-16B2048
SalesforceCodeGen2 (7B)togethercomputer/codegen2-7B2048
Numbers StationNSQL LLaMA-2 (7B)NumbersStation/nsql-llama-2-7B4096
BigCodeStarCoder (16B)bigcode/starcoder8192
WizardLMWizardCoder Python v1.0 (34B)WizardLM/WizardCoder-Python-34B-V1.08192


Request a model