| Code | Cause | Solution |
|---|---|---|
| 400 - Invalid Request | Misconfigured request, or an unknown field on a dedicated endpoints management API request. | Ensure your request is a Valid JSON and your API Key is correct. Also ensure you’re using the right prompt format - which is different for Mistral and LLaMA models. For dedicated endpoints management requests, remove any field named in an unknown field "..." error (see Troubleshooting). |
| 401 - Authentication Error | Missing or Invalid API Key | Ensure you are using the correct API Key and supplying it correctly |
| 402 - Payment Required | The account associated with the API key has reached its maximum allowed monthly spending limit. | Adjust your billing settings or make a payment to resume service. |
| 403 - Bad Request | Input token count + max_tokens parameter must be less than the context length of the model being queried. | Set max_tokens to a lower number. If querying a chat model, you may set max_tokens to null and let the model decide when to stop generation. |
| 404 - Not Found | Invalid Endpoint URL or model name | Check your request is being made to the correct endpoint (see the API reference page for details) and that the model being queried is available |
| 429 - Too Many Requests | Serverless rate limit exceeded, or a dedicated endpoint deployment would exceed your project or organization GPU quota for a GPU type. | For rate limits, throttle requests (see rate limits). For GPU quota, lower the requested replica count, stop unused deployments on that GPU type, or contact support. Platform-wide capacity messages ask you to retry later. |
| 500 - Server Error | Unknown server error | This error is caused by a server-side issue. Try again after a brief wait. If the issue persists, contact support |
| 503 - Engine Overloaded | Servers are seeing high amounts of traffic | Try again after a brief wait. If the issue persists, contact support |
| 504 - Timeout | The request did not complete in time | Try again after a brief wait. If the issue persists, contact support |
| 524 - Cloudflare Timeout | The connection timed out at the network edge | Try again after a brief wait. If the issue persists, contact support |
| 529 - Server Error | Unknown server error | Try again after a brief wait. If the issue persists, contact support |
ERROR CODES
Error codes
An overview on error status codes, causes, and quick fix solutions.
If you are seeing other error codes or the solutions do not work, contact support for help.