Commit 1fa237f
Lever: drop limit=100 — was silently capping Mistral and Palantir
Lever's public postings API returns the full site list in a
single GET; passing `limit=100` was a soft hint that turned
out to be a hard truncation. Verified live:
Mistral: upstream 162, cached 100 (-62)
Palantir: upstream 226, cached 100 (-126)
Dnb: upstream 86, cached 86 (full, only because small)
Greenhouse and Ashby use the same "single GET, take everything"
pattern with no `limit` param — Databricks lands at 813 jobs
fine. The `limit=100` here was just an arbitrary value from
when the Lever provider was added; no specific reason. Drop it
and trust the API.
Memory is fine: the largest public Lever board we've measured
is in the low hundreds, and the worker chunks DB writes at 30
either way.
Co-Authored-By: Claude Opus 4.7 (1M context) <noreply@anthropic.com>1 parent 082c8cb commit 1fa237f
2 files changed
Lines changed: 9 additions & 2 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
323 | 323 | | |
324 | 324 | | |
325 | 325 | | |
| 326 | + | |
| 327 | + | |
| 328 | + | |
| 329 | + | |
| 330 | + | |
| 331 | + | |
| 332 | + | |
326 | 333 | | |
327 | 334 | | |
328 | | - | |
| 335 | + | |
329 | 336 | | |
330 | 337 | | |
331 | 338 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
65 | 65 | | |
66 | 66 | | |
67 | 67 | | |
68 | | - | |
| 68 | + | |
69 | 69 | | |
70 | 70 | | |
71 | 71 | | |
| |||
0 commit comments