Skip to content
CodexPal
AI Tools & Comparisons · Beginner · 3 min read

Batch APIs and off-peak pricing: cheaper AI for work that can wait

Most major providers offer about half-price processing for jobs that don’t need an instant answer. What qualifies, how it works and what to watch for.

By CodexPal Editorial3 min read
A queue of request cards moving into a single batch job at half price.

Not every AI task needs a response in seconds. Classifying a backlog of support tickets, extracting fields from documents, translating a product catalogue or running an evaluation set can all wait. Providers reward that flexibility with lower prices.

What each provider offers

OpenAI lists Batch and Flex prices at about half its Standard rates. Anthropic’s Batch API gives a 50% discount on input and output tokens. Google lists a 50% cost reduction for the Gemini Batch API. Mistral lists batch processing at a 50% reduction.

DeepSeek uses time of day instead: off-peak rates are half the peak rates. Its peak hours are 01:00–04:00 and 06:00–10:00 UTC, Monday to Friday, excluding Chinese public holidays.

How a batch job works

You prepare a file or list of independent requests, submit it, and collect results when processing finishes. Each request is still a normal model call; only the scheduling changes.

Design for asynchronous results. Store each request’s identifier, check job status, and handle requests that fail inside an otherwise successful batch.

Batch processing flow

  1. 01CollectIndependent requests with your own IDs
  2. 02SubmitOne batch job
  3. 03WaitProcessing completes asynchronously
  4. 04ReconcileMatch results to IDs; retry failures
Each request is billed at the discounted batch rate.

Good and poor fits

Good fits are large, independent jobs where a delay is acceptable: tagging, summarising archives, data extraction, nightly reports and model evaluations. Poor fits are anything a person is waiting for, and chained steps where each call depends on the previous answer.

WorkloadBatch or off-peak?Why
Live chat or support repliesNoA person is waiting
Tagging 50,000 ticketsYesIndependent and not urgent
Nightly document summariesYesFixed schedule
Multi-step agentUsually noEach step needs the last result
Evaluation test suiteYesResults needed later, in bulk

Combine discounts carefully

Anthropic states that Batch API and prompt caching discounts can be combined. It also states that its faster output mode is not available with batch. Check each provider’s documentation for which features stack before assuming the lowest possible rate.

Open the AI API cost calculator →

The takeaway

Separate work that needs an instant answer from work that can wait. Moving the second group to batch or off-peak processing can roughly halve its cost with no change in model quality.

Go to the source

Sources & further reading

Primary references checked on November 12, 2026. Examples and diagrams are illustrative unless stated otherwise.

  1. OpenAI — API pricing
  2. Anthropic — Claude API pricing
  3. Google — Gemini API pricing
  4. DeepSeek — API models and pricing
  5. Mistral — pricing
  6. Anthropic — batch processing
Found this useful? Pass it along.