Models - Dedicated instances
The following models can be hosted as a private dedicated instance(s) on Together platform at your request. To request, click the model name in the Together Playgrounds and click Contact Us. See the pricing in inference pricing.
Some of the models are also available through our serverless endpoints. Check out the full list in Models - Serverless endpoint.
Run the following command to see the correct prompt format and stop sequence(s).
together models info $MODEL_API_STRING
Chat Models
| Organization | Model Name | Model String for API | Max Seq Length |
|---|---|---|---|
| Stanford | Alpaca (7B) | togethercomputer/alpaca-7b | 2048 |
| Austism | Chronos Hermes (13B) | Austism/chronos-hermes-13b | 2048 |
| Meta | Code Llama Instruct (13B) | togethercomputer/CodeLlama-13b-Instruct | 8192 |
| Meta | Code Llama Instruct (34B) | togethercomputer/CodeLlama-34b-Instruct | 8192 |
| Meta | Code Llama Instruct (7B) | togethercomputer/CodeLlama-7b-Instruct | 8192 |
| Databricks | Dolly v2 (12B) | databricks/dolly-v2-12b | 2048 |
| Databricks | Dolly v2 (3B) | databricks/dolly-v2-3b | 2048 |
| Databricks | Dolly v2 (7B) | databricks/dolly-v2-7b | 2048 |
| TII UAE | Falcon Instruct (40B) | togethercomputer/falcon-40b-instruct | 2048 |
| TII UAE | Falcon Instruct (7B) | togethercomputer/falcon-7b-instruct | 2048 |
| Together | GPT-NeoXT-Chat-Base (20B) | togethercomputer/GPT-NeoXT-Chat-Base-20B | 2048 |
| Tim Dettmers | Guanaco (13B) | togethercomputer/guanaco-13b | 2048 |
| Tim Dettmers | Guanaco (33B) | togethercomputer/guanaco-33b | 2048 |
| Tim Dettmers | Guanaco (65B) | togethercomputer/guanaco-65b | 2048 |
| Tim Dettmers | Guanaco (7B) | togethercomputer/guanaco-7b | 2048 |
| Salesforce | InstructCodeT5 (16B) | Salesforce/instructcodet5p-16b | 2048 |
| LM Sys | Koala (13B) | togethercomputer/Koala-13B | 2048 |
| 2048 | Koala (7B) | togethercomputer/Koala-7B | 2048 |
| OpenAssistant | LLaMA 2 SFT v10 (70B) | OpenAssistant/llama2-70b-oasst-sft-v10 | 4096 |
| Meta | LLaMA-2 Chat (13B) | togethercomputer/llama-2-13b-chat | 4096 |
| Meta | LLaMA-2 Chat (70B) | togethercomputer/llama-2-70b-chat | 4096 |
| Meta | LLaMA-2 Chat (7B) | togethercomputer/llama-2-7b-chat | 4096 |
| Together | LLaMA-2-7B-32K-Instruct (7B) | togethercomputer/Llama-2-7B-32K-Instruct | 32768 |
| Mosaic ML | MPT-Chat (30B) | togethercomputer/mpt-30b-chat | 2048 |
| Mosaic ML | MPT-Chat (7B) | togethercomputer/mpt-7b-chat | 2048 |
| mistralai | Mistral (7B) Instruct | mistralai/Mistral-7B-Instruct-v0.1 | 4096 |
| Gryphe | MythoMax-L2 (13B) | Gryphe/MythoMax-L2-13b | 4096 |
| NousResearch | Nous Hermes LLaMA-2 (70B) | NousResearch/Nous-Hermes-Llama2-70b | 4096 |
| NousResearch | Nous Hermes LLaMA-2 (7B) | NousResearch/Nous-Hermes-llama-2-7b | 4096 |
| Nous Research | Nous Hermes Llama-2 (13B) | NousResearch/Nous-Hermes-Llama2-13b | 4096 |
| LAION | Open-Assistant LLaMA SFT-6 (30B) | OpenAssistant/oasst-sft-6-llama-30b-xor | 2048 |
| LAION | Open-Assistant Pythia SFT-4 (12B) | OpenAssistant/oasst-sft-4-pythia-12b-epoch-3.5 | 2048 |
| LAION | Open-Assistant StableLM SFT-7 (7B) | OpenAssistant/stablelm-7b-sft-v7-epoch-3 | 4096 |
| teknium | OpenHermes-2-Mistral (7B) | teknium/OpenHermes-2-Mistral-7B | 4096 |
| OpenOrca | OpenOrca Mistral (7B) 8K | Open-Orca/Mistral-7B-OpenOrca | 8192 |
| garage-bAInd | Platypus2 Instruct (70B) | garage-bAInd/Platypus2-70B-instruct | 4096 |
| Together | Pythia-Chat-Base (7B) | togethercomputer/Pythia-Chat-Base-7B-v0.16 | 2048 |
| Qwen | Qwen-Chat (7B) | togethercomputer/Qwen-7B-Chat | 8192 |
| Together | RedPajama-INCITE Chat (3B) | togethercomputer/RedPajama-INCITE-Chat-3B-v1 | 2048 |
| Together | RedPajama-INCITE Chat (7B) | togethercomputer/RedPajama-INCITE-7B-Chat | 2048 |
| Upstage | SOLAR v0 (70B) | upstage/SOLAR-0-70b-16bit | 4096 |
| HuggingFaceH4 | StarCoderChat Alpha (16B) | HuggingFaceH4/starchat-alpha | 8192 |
| LM Sys | Vicuna v1.3 (13B) | lmsys/vicuna-13b-v1.3 | 2048 |
| LM Sys | Vicuna v1.3 (7B) | lmsys/vicuna-7b-v1.3 | 2048 |
| LM Sys | Vicuna v1.5 (13B) | lmsys/vicuna-13b-v1.5 | 4096 |
| LM Sys | Vicuna v1.5 (7B) | lmsys/vicuna-7b-v1.5 | 4096 |
| LM Sys | Vicuna-FastChat-T5 (3B) | lmsys/fastchat-t5-3b-v1.0 | 512 |
Language Models
| Organization | Model Name | Model String for API | Max Seq Length |
|---|---|---|---|
| TII UAE | Falcon (40B) | togethercomputer/falcon-40b | 2048 |
| TII UAE | Falcon (7B) | togethercomputer/falcon-7b | 2048 |
| Flan T5 XL (3B) | google/flan-t5-xl | 512 | |
| Flan T5 XXL (11B) | google/flan-t5-xxl | 512 | |
| EleutherAI | GPT-J (6B) | EleutherAI/gpt-j-6b | 2048 |
| Together | GPT-JT (6B) | togethercomputer/GPT-JT-6B-v1 | 2048 |
| Together | GPT-JT-Moderation (6B) | togethercomputer/GPT-JT-Moderation-6B | 2048 |
| EleutherAI | GPT-NeoX (20B) | EleutherAI/gpt-neox-20b | 2048 |
| Meta | LLaMA (13B) | huggyllama/llama-13b | 2048 |
| Meta | LLaMA (30B) | huggyllama/llama-30b | 2048 |
| Meta | LLaMA (65B) | huggyllama/llama-65b | 2048 |
| Meta | LLaMA (7B) | huggyllama/llama-7b | 2048 |
| Meta | LLaMA-2 (13B) | togethercomputer/llama-2-13b | 4096 |
| Meta | LLaMA-2 (70B) | togethercomputer/llama-2-70b | 4096 |
| Meta | LLaMA-2 (7B) | togethercomputer/llama-2-7b | 4096 |
| Together | LLaMA-2-32K (7B) | togethercomputer/LLaMA-2-7B-32K | 32768 |
| EleutherAI | Llemma (7B) | EleutherAI/llemma_7b | 4096 |
| Mosaic ML | MPT (30B) | togethercomputer/mpt-30b | 2048 |
| 2048 | MPT (7B) | togethercomputer/mpt-7b | 2048 |
| Mosaic ML | MPT-Instruct (7B) | togethercomputer/mpt-7b-instruct | 2048 |
| mistralai | Mistral (7B) | mistralai/Mistral-7B-v0.1 | 4096 |
| Numbers Station | NSQL (6B) | NumbersStation/nsql-6B | 2048 |
| Nous Research | Nous Hermes (13B) | NousResearch/Nous-Hermes-13b | 2048 |
| EleutherAI | Pythia (12B) | EleutherAI/pythia-12b-v0 | 2048 |
| EleutherAI | Pythia (1B) | EleutherAI/pythia-1b-v0 | 2048 |
| EleutherAI | Pythia (2.8B) | EleutherAI/pythia-2.8b-v0 | 2048 |
| EleutherAI | Pythia (6.9B) | EleutherAI/pythia-6.9b | 2048 |
| Qwen | Qwen (7B) | togethercomputer/Qwen-7B | 8192 |
| Together | RedPajama-INCITE (3B) | togethercomputer/RedPajama-INCITE-Base-3B-v1 | 2048 |
| Together | RedPajama-INCITE (7B) | togethercomputer/RedPajama-INCITE-7B-Base | 2048 |
| Together | RedPajama-INCITE Instruct (3B) | togethercomputer/RedPajama-INCITE-Instruct-3B-v1 | 2048 |
| Together | RedPajama-INCITE Instruct (7B) | togethercomputer/RedPajama-INCITE-7B-Instruct | 2048 |
| Defog | Sqlcoder (15B) | defog/sqlcoder | 8192 |
| Stability AI | StableLM-Base-Alpha (3B) | stabilityai/stablelm-base-alpha-3b | 4096 |
| Stability AI | StableLM-Base-Alpha (7B) | stabilityai/stablelm-base-alpha-7b | 4096 |
| WizardLM | WizardLM v1.0 (70B) | WizardLM/WizardLM-70B-V1.0 | 4096 |
Image Models
| Organization | Model Name | Model String for API |
|---|---|---|
| Prompt Hero | Openjourney v4 | prompthero/openjourney |
| SG161222 | Realistic Vision 3.0 | SG161222/Realistic_Vision_V3.0_VAE |
| Runway ML | Stable Diffusion 1.5 | runwayml/stable-diffusion-v1-5 |
| Stability AI | Stable Diffusion 2.1 | stabilityai/stable-diffusion-2-1 |
| Stability AI | Stable Diffusion XL 1.0 | stabilityai/stable-diffusion-xl-base-1.0 |
| Wavymulder | Analog Diffusion | wavymulder/Analog-Diffusion |
Code Models
| Organization | Model Name | Model String for API | Max Seq Length |
|---|---|---|---|
| Meta | Code Llama (13B) | togethercomputer/CodeLlama-13b | 8192 |
| Meta | Code Llama (34B) | togethercomputer/CodeLlama-34b | 8192 |
| Meta | Code Llama (7B) | togethercomputer/CodeLlama-7b | 8192 |
| Meta | Code Llama Python (13B) | togethercomputer/CodeLlama-13b-Python | 8192 |
| Meta | Code Llama Python (34B) | togethercomputer/CodeLlama-34b-Python | 8192 |
| Meta | Code Llama Python (7B) | togethercomputer/CodeLlama-7b-Python | 8192 |
| Salesforce | CodeGen2 (16B) | togethercomputer/codegen2-16B | 2048 |
| Salesforce | CodeGen2 (7B) | togethercomputer/codegen2-7B | 2048 |
| Numbers Station | NSQL LLaMA-2 (7B) | NumbersStation/nsql-llama-2-7B | 4096 |
| BigCode | StarCoder (16B) | bigcode/starcoder | 8192 |
| WizardLM | WizardCoder Python v1.0 (34B) | WizardLM/WizardCoder-Python-34B-V1.0 | 8192 |
Updated 21 days ago