Commit cbadbf4
chore: migrate to pnpm and enable minimum release age (#273)
* chore: migrate to pnpm and enable minimum release age
Migrates actor-scraper from npm workspaces to pnpm workspaces and
adds a 1-day minimum release age supply-chain guard at the package
manager layer (pnpm-workspace.yaml) and at the Renovate layer.
Internal `@apify/*` and `@crawlee/*` packages are whitelisted at
both layers for immediate updates.
Notable changes:
- package.json: drop "workspaces" (moved to pnpm-workspace.yaml);
set packageManager to pnpm@10.24.0; add @isaacs/brace-expansion
as explicit root devDep (pnpm 10 doesn't pull it transitively
for minimatch@10 which actor-scraper-sitemap depends on)
- lerna.json: npmClient: "pnpm"
- .npmrc: node-linker=hoisted + link-workspace-packages=true +
prefer-workspace-packages=true (flat layout for debugging +
prefer workspace packages over registry)
- packages/actor-scraper/*/package.json: use "workspace:*" protocol
for @apify/scraper-tools so pnpm links the workspace copy instead
of fetching the identical version from npm (required for consistent
peer-dep resolution across workspace and registry types)
- packages/scraper-tools/src/browser_tools.ts: relax Page interface
exposeFunction return type from Promise<void> to Promise<unknown>
so it accepts both Puppeteer (Promise<void>) and newer Playwright
(Promise<Disposable>) page types. Return value is unused.
- New .github/actions/pnpm-install composite action adopts the
caching pattern from apify/apify-cli#1068 (pnpm store cache
keyed by year-month + lockfile hash)
- CI workflows: delegate install to the composite; drop the
separate npm cache config on setup-node
- renovate.json: minimumReleaseAge "1 day", internalChecksFilter
"strict", @apify/* and @crawlee/* whitelist; drop npm constraint
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* chore: refresh pnpm-lock.yaml after rebase
* ci: approve build scripts for puppeteer/playwright/swc/esbuild/camoufox
pnpm 10 blocks install scripts by default; these are needed to download
the browser binaries for CI tests.
* ci: use shared apify/workflows/pnpm-install action
Replaces the local .github/actions/pnpm-install composite copy
with the shared one from apify/workflows@main. Identical behavior,
less duplication.
* chore: whitelist internal apify-client/apify/crawlee/got-scraping from release-age gate
* chore: move pnpm config from .npmrc to pnpm-workspace.yaml
Silences npm warnings about unknown options like node-linker; pnpm
reads the same keys from pnpm-workspace.yaml in camelCase form.
* chore: enforce pnpm via devEngines, switch husky hook to pnpm exec
npx invokes npm which now refuses to run because of devEngines.
* chore: normalize .gitignore — add yarn.lock and .yarn, drop .pnpm-store
* chore: remove stale .prettierignore entry and sync renovate allowlist with pnpm-workspace exclusions
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
* chore: replace devEngines with only-allow preinstall
devEngines.packageManager breaks pnpm commands that delegate to npm
(pnpm version, pnpm pkg set, etc). Use the battle-tested only-allow
approach instead (same as Vite, Vue, Astro).
---------
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com>1 parent 4e0a8bd commit cbadbf4
20 files changed
Lines changed: 11887 additions & 19552 deletions
File tree
- .github/workflows
- .husky
- packages
- actor-scraper
- camoufox-scraper
- cheerio-scraper
- jsdom-scraper
- playwright-scraper
- puppeteer-scraper
- sitemap-scraper
- web-scraper
- scraper-tools
- src
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
22 | 22 | | |
23 | 23 | | |
24 | 24 | | |
25 | | - | |
26 | | - | |
27 | 25 | | |
28 | | - | |
29 | | - | |
30 | | - | |
| 26 | + | |
| 27 | + | |
31 | 28 | | |
32 | 29 | | |
33 | | - | |
| 30 | + | |
34 | 31 | | |
35 | 32 | | |
36 | | - | |
| 33 | + | |
37 | 34 | | |
38 | 35 | | |
39 | 36 | | |
| |||
46 | 43 | | |
47 | 44 | | |
48 | 45 | | |
49 | | - | |
50 | | - | |
51 | 46 | | |
52 | | - | |
53 | | - | |
| 47 | + | |
| 48 | + | |
54 | 49 | | |
55 | 50 | | |
56 | | - | |
| 51 | + | |
57 | 52 | | |
58 | 53 | | |
59 | | - | |
| 54 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
10 | 10 | | |
11 | 11 | | |
12 | 12 | | |
13 | | - | |
14 | 13 | | |
15 | 14 | | |
16 | 15 | | |
| |||
28 | 27 | | |
29 | 28 | | |
30 | 29 | | |
31 | | - | |
32 | | - | |
33 | 30 | | |
34 | 31 | | |
35 | 32 | | |
| |||
40 | 37 | | |
41 | 38 | | |
42 | 39 | | |
43 | | - | |
44 | | - | |
| 40 | + | |
| 41 | + | |
45 | 42 | | |
46 | 43 | | |
47 | | - | |
| 44 | + | |
48 | 45 | | |
49 | 46 | | |
50 | | - | |
| 47 | + | |
51 | 48 | | |
52 | 49 | | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
17 | 17 | | |
18 | 18 | | |
19 | 19 | | |
| 20 | + | |
20 | 21 | | |
21 | 22 | | |
22 | 23 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | | - | |
| 1 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
12 | 12 | | |
13 | 13 | | |
14 | 14 | | |
| 15 | + | |
15 | 16 | | |
16 | 17 | | |
0 commit comments