Asynchronous bulk inference at a discount, usually with higher latency.
A batch API accepts large jobs and returns results later, often within 24 hours. Many providers discount batch requests, commonly by around 50%, but eligibility and completion windows vary.
Offline summarization, classification, and evaluation jobs can be much cheaper through batch processing than real-time endpoints.