Anthropic Message Batches API and OpenAI Batch API offer ~50% cost reduction for async workloads Add BatchGenerator interface: SubmitBatch([]BatchRequest) (BatchID, error) + GetBatch(BatchID) ([]BatchResult, error)
Anthropic Message Batches API and OpenAI Batch API offer ~50% cost reduction for async workloads
Add BatchGenerator interface: SubmitBatch([]BatchRequest) (BatchID, error) + GetBatch(BatchID) ([]BatchResult, error)