Run inference on your fine-tuned model
parameter-count
of 300 billion or less
Base models: Uploads currently work with the following base models
deepseek-ai/DeepSeek-R1-Distill-Llama-70B
google/gemma-2-27b-it
meta-llama/Llama-3.3-70B-Instruct-Turbo
meta-llama/Meta-Llama-3.1-70B-Instruct-Turbo
meta-llama/Meta-Llama-3.1-405B-Instruct-Turbo
meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo
meta-llama/Llama-3-8b-chat-hf
meta-llama/Llama-2-70b-hf
meta-llama/LlamaGuard-2-8b
mistralai/Mistral-7B-Instruct-v0.3
mistralai/Mixtral-8x7B-Instruct-v0.1
Qwen/Qwen2.5-72B-Instruct-Turbo
Qwen/Qwen2-VL-72B-Instruct
Qwen/Qwen2-72B-Instruct
Salesforce/Llama-Rank-V1