Commit c01c1ec
chore: migrate to pnpm and enable minimum release age
Migrates actor-scraper from npm workspaces to pnpm workspaces and
adds a 1-day minimum release age supply-chain guard at the package
manager layer (pnpm-workspace.yaml) and at the Renovate layer.
Internal `@apify/*` and `@crawlee/*` packages are whitelisted at
both layers for immediate updates.
Notable changes:
- package.json: drop "workspaces" (moved to pnpm-workspace.yaml);
set packageManager to pnpm@10.24.0; add @isaacs/brace-expansion
as explicit root devDep (pnpm 10 doesn't pull it transitively
for minimatch@10 which actor-scraper-sitemap depends on)
- lerna.json: npmClient: "pnpm"
- .npmrc: node-linker=hoisted + link-workspace-packages=true +
prefer-workspace-packages=true (flat layout for debugging +
prefer workspace packages over registry)
- packages/actor-scraper/*/package.json: use "workspace:*" protocol
for @apify/scraper-tools so pnpm links the workspace copy instead
of fetching the identical version from npm (required for consistent
peer-dep resolution across workspace and registry types)
- packages/scraper-tools/src/browser_tools.ts: relax Page interface
exposeFunction return type from Promise<void> to Promise<unknown>
so it accepts both Puppeteer (Promise<void>) and newer Playwright
(Promise<Disposable>) page types. Return value is unused.
- New .github/actions/pnpm-install composite action adopts the
caching pattern from apify/apify-cli#1068 (pnpm store cache
keyed by year-month + lockfile hash)
- CI workflows: delegate install to the composite; drop the
separate npm cache config on setup-node
- renovate.json: minimumReleaseAge "1 day", internalChecksFilter
"strict", @apify/* and @crawlee/* whitelist; drop npm constraint
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>1 parent 3b0143c commit c01c1ec
20 files changed
Lines changed: 11998 additions & 19582 deletions
File tree
- .github
- actions/pnpm-install
- workflows
- packages
- actor-scraper
- camoufox-scraper
- cheerio-scraper
- jsdom-scraper
- playwright-scraper
- puppeteer-scraper
- sitemap-scraper
- web-scraper
- scraper-tools
- src
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
22 | 22 | | |
23 | 23 | | |
24 | 24 | | |
25 | | - | |
26 | | - | |
27 | 25 | | |
28 | | - | |
29 | | - | |
30 | | - | |
| 26 | + | |
| 27 | + | |
31 | 28 | | |
32 | 29 | | |
33 | | - | |
| 30 | + | |
34 | 31 | | |
35 | 32 | | |
36 | | - | |
| 33 | + | |
37 | 34 | | |
38 | 35 | | |
39 | 36 | | |
| |||
46 | 43 | | |
47 | 44 | | |
48 | 45 | | |
49 | | - | |
50 | | - | |
51 | 46 | | |
52 | | - | |
53 | | - | |
| 47 | + | |
| 48 | + | |
54 | 49 | | |
55 | 50 | | |
56 | | - | |
| 51 | + | |
57 | 52 | | |
58 | 53 | | |
59 | | - | |
| 54 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
10 | 10 | | |
11 | 11 | | |
12 | 12 | | |
13 | | - | |
14 | 13 | | |
15 | 14 | | |
16 | 15 | | |
| |||
28 | 27 | | |
29 | 28 | | |
30 | 29 | | |
31 | | - | |
32 | | - | |
33 | 30 | | |
34 | 31 | | |
35 | 32 | | |
| |||
40 | 37 | | |
41 | 38 | | |
42 | 39 | | |
43 | | - | |
44 | | - | |
| 40 | + | |
| 41 | + | |
45 | 42 | | |
46 | 43 | | |
47 | | - | |
| 44 | + | |
48 | 45 | | |
49 | 46 | | |
50 | | - | |
| 47 | + | |
51 | 48 | | |
52 | 49 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
| 15 | + | |
15 | 16 | | |
16 | 17 | | |
0 commit comments