Authorizations
Bearer authentication header of the form Bearer <token>
, where <token>
is your auth token.
Body
application/json
The endpoint to use for batch processing
Example:
"/v1/chat/completions"
ID of the uploaded input file containing batch requests
Example:
"file-abc123def456ghi789"
Time window for batch completion (optional)
Example:
"24h"
Priority for batch processing (optional)
Example:
1
Model to use for processing batch requests
Example:
"meta-llama/Meta-Llama-3.1-8B-Instruct-Turbo"