|
| 1 | +--- |
| 2 | +navigation_title: Rate limits |
| 3 | +applies_to: |
| 4 | + stack: ga |
| 5 | + serverless: ga |
| 6 | +description: Learn about rate limits for Elastic Inference Service (EIS) models. |
| 7 | +--- |
| 8 | + |
| 9 | +# Rate limits [eis-rate-limits] |
| 10 | + |
| 11 | +This page lists the rate limits that apply to Elastic {{infer-cap}} Service (EIS) models. |
| 12 | + |
| 13 | +Exceeding a limit results in HTTP 429 responses from the server until the sliding window moves on further and parts of the limit resets. |
| 14 | + |
| 15 | +| Model | Request/minute | Tokens/minute (ingest) | Tokens/minute (search) | Notes | |
| 16 | +|---------------------------------------------------|-----------------|-------------------------|-------------------------|--------------------------| |
| 17 | +| Elastic Managed LLMs {applies_to}`stack: ga 9.3+` | 2000 | - | - | No rate limit on tokens | |
| 18 | +| ELSER {applies_to}`stack: ga 9.0+` | 6,000 | 6,000,000 | 600,000 | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. | |
| 19 | +| Jina Embeddings v5 Nano {applies_to}`stack: ga 9.3+` | 6,000 | 6,000,000 | 600,000 | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. | |
| 20 | +| Jina Embeddings v5 Small {applies_to}`stack: ga 9.3+` | 6,000 | 6,000,000 | 600,000 | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. | |
| 21 | +| Jina Embeddings v3 {applies_to}`stack: ga 9.3+` | 6,000 | 6,000,000 | 600,000 | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. | |
| 22 | +| Jina Embeddings v5 (Small) {applies_to}`stack: ga 9.3+` | 6,000 | 6,000,000 | 600,000 | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. | |
| 23 | +| Jina Embeddings v5 (Nano) {applies_to}`stack: ga 9.3+` | 6,000 | 6,000,000 | 600,000 | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. | |
| 24 | +| Jina Reranker v2 {applies_to}`stack: ga 9.3+` | 600 | - | 6,000,000 | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. | |
| 25 | +| Jina Reranker v3 {applies_to}`stack: ga 9.3+` | 600 | - | 6,000,000 | Limits are applied to both requests per minute and tokens per minute, whichever limit is reached first. | |
0 commit comments