Skip to content

chore: migrate to pnpm and enable minimum release age #3581

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
B4nan merged 9 commits into from
Apr 20, 2026
Merged

chore: migrate to pnpm and enable minimum release age #3581

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
9 commits
Select commit Hold shift + click to select a range
8641cbd
chore: migrate to pnpm and enable minimum release age
B4nan Apr 17, 2026
cf9f737
fix: scope root turbo commands to packages, pin theme-mermaid
B4nan Apr 17, 2026
3050ef6
fix: add http-client + got-scraping-client to docs deps
B4nan Apr 17, 2026
3cc4130
test: abort pending nock requests in afterEach
B4nan Apr 17, 2026
b03ff2d
chore: revert docusaurus config reformat, add packageManager + volta …
B4nan Apr 20, 2026
53ad0d9
fix: scope lint-staged to formatted dirs, revert website config churn
B4nan Apr 20, 2026
d56cb5a
ci: rebase before pushing release commit to avoid non-fast-forward
B4nan Apr 20, 2026
cfae3a1
fix: drop nested-readmes cleanup and simplify website build scripts
B4nan Apr 20, 2026
0db4cd2
fix: remove cheerio from renovate ignoreDeps
B4nan Apr 20, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 4 additions & 13 deletions .github/workflows/docs.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -25,35 +25,26 @@ jobs:
node-version: 24
package-manager-cache: false

- name: Enable corepack
run: |
corepack enable
corepack prepare yarn@stable --activate
- uses: apify/workflows/pnpm-install@main

- name: Build & deploy docs
run: |
# install project deps
yarn
# go to website dir
cd website
# install website deps
yarn
# build the docs
yarn build
pnpm build
env:
APIFY_SIGNING_TOKEN: ${{ secrets.APIFY_SIGNING_TOKEN }}
SEGMENT_TOKEN: ${{ secrets.SEGMENT_TOKEN }}

- name: Set up GitHub Pages
uses: actions/configure-pages@v5
uses: actions/configure-pages@v6

- name: Upload GitHub Pages artifact
uses: actions/upload-pages-artifact@v4
with:
path: ./website/build

- name: Deploy artifact to GitHub Pages
uses: actions/deploy-pages@v4
uses: actions/deploy-pages@v5

- name: Invalidate CloudFront cache
run: |
Expand Down
27 changes: 8 additions & 19 deletions .github/workflows/publish-to-npm.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -49,16 +49,6 @@ jobs:
node-version: 24
package-manager-cache: false

- name: Enable corepack
run: |
corepack enable
corepack prepare yarn@stable --activate

- name: Activate cache for Node.js 24
uses: actions/setup-node@v6
with:
cache: 'yarn'

- name: Turbo cache
id: turbo-cache
uses: actions/cache@v5
Expand All @@ -68,20 +58,19 @@ jobs:
restore-keys: |
turbo-${{ github.job }}-${{ github.ref_name }}-

- name: Install dependencies
run: yarn
- uses: apify/workflows/pnpm-install@main

- name: Build packages
run: yarn ci:build
run: pnpm ci:build

- name: Bump canary versions
if: inputs.dist-tag == 'next'
run: |
yarn turbo copy --force -- --canary=major --preid=beta
pnpm turbo copy --force -- --canary=major --preid=beta

- name: Commit changes
if: inputs.dist-tag == 'next'
uses: EndBug/add-and-commit@v9
uses: EndBug/add-and-commit@v10
id: commit
with:
author_name: Apify Release Bot
Expand All @@ -91,22 +80,22 @@ jobs:

- name: Publish to NPM (@latest)
if: inputs.dist-tag == 'prod'
uses: nick-fields/retry@v3
uses: nick-fields/retry@v4
with:
timeout_minutes: 10
max_attempts: 5
retry_wait_seconds: 30
command: git checkout . && yarn publish:prod --yes
command: git checkout . && pnpm publish:prod -- --yes
env:
GH_TOKEN: ${{ secrets.APIFY_SERVICE_ACCOUNT_GITHUB_TOKEN }}

- name: Publish to NPM (@next)
if: inputs.dist-tag == 'next'
uses: nick-fields/retry@v3
uses: nick-fields/retry@v4
with:
timeout_minutes: 10
max_attempts: 5
retry_wait_seconds: 30
command: git checkout . && yarn publish:next --yes
command: git checkout . && pnpm publish:next -- --yes
env:
GH_TOKEN: ${{ secrets.APIFY_SERVICE_ACCOUNT_GITHUB_TOKEN }}
71 changes: 17 additions & 54 deletions .github/workflows/release.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -1,7 +1,6 @@
name: Release @latest

env:
YARN_IGNORE_NODE: 1
RETRY_TESTS: 1

on:
Expand Down Expand Up @@ -52,16 +51,6 @@ jobs:
node-version: ${{ matrix.node-version }}
package-manager-cache: false

- name: Enable corepack
run: |
corepack enable
corepack prepare yarn@stable --activate

- name: Activate cache for Node.js ${{ matrix.node-version }}
uses: actions/setup-node@v6
with:
cache: 'yarn'

- name: Turbo cache
id: turbo-cache
uses: actions/cache@v5
Expand All @@ -71,16 +60,16 @@ jobs:
restore-keys: |
turbo-${{ github.job }}-${{ github.ref_name }}-

- name: Install Dependencies
run: |
yarn
yarn playwright install --with-deps
- uses: apify/workflows/pnpm-install@main

- name: Install Playwright browsers
run: pnpm exec playwright install --with-deps

- name: Build
run: yarn ci:build
run: pnpm ci:build

- name: Tests
run: yarn test
run: pnpm test

release:
name: "Bump Crawlee: ${{ inputs.version }} version (${{ inputs.custom_version || 'n/a' }} custom version)"
Expand All @@ -101,16 +90,6 @@ jobs:
node-version: 24
package-manager-cache: false

- name: Enable corepack
run: |
corepack enable
corepack prepare yarn@stable --activate

- name: Activate cache for Node.js 24
uses: actions/setup-node@v6
with:
cache: 'yarn'

- name: Turbo cache
id: turbo-cache
uses: actions/cache@v5
Expand All @@ -120,15 +99,14 @@ jobs:
restore-keys: |
turbo-${{ github.job }}-${{ github.ref_name }}-

- name: Install Dependencies
run: yarn
- uses: apify/workflows/pnpm-install@main

- name: Build
run: yarn ci:build
run: pnpm ci:build

- name: Bump version to custom version
if: ${{ github.event.inputs.version == 'custom' && github.event.inputs.custom_version != '' }}
run: yarn lerna version ${{ github.event.inputs.custom_version }} --force-publish --yes
run: pnpm exec lerna version ${{ github.event.inputs.custom_version }} --force-publish --yes
env:
GH_TOKEN: ${{ secrets.APIFY_SERVICE_ACCOUNT_GITHUB_TOKEN }}
GIT_AUTHOR_NAME: Apify Release Bot
Expand All @@ -138,7 +116,7 @@ jobs:

- name: Bump version to ${{ github.event.inputs.version }} version
if: ${{ github.event.inputs.version != 'custom' }}
run: yarn lerna version ${{ github.event.inputs.version }} --force-publish --yes
run: pnpm exec lerna version ${{ github.event.inputs.version }} --force-publish --yes
env:
GH_TOKEN: ${{ secrets.APIFY_SERVICE_ACCOUNT_GITHUB_TOKEN }}
GIT_AUTHOR_NAME: Apify Release Bot
Expand All @@ -148,16 +126,17 @@ jobs:

- name: Pin versions in internal dependencies and update lockfile
run: |
yarn release:pin-versions
yarn install --no-immutable
pnpm release:pin-versions
pnpm install --no-frozen-lockfile

- name: Commit changes
id: commit
uses: EndBug/add-and-commit@v9
uses: EndBug/add-and-commit@v10
with:
author_name: Apify Release Bot
author_email: noreply@apify.com
message: 'chore(release): update internal dependencies [skip ci]'
pull: '--rebase --autostash'

- name: Publish packages
uses: apify/workflows/execute-workflow@main
Expand Down Expand Up @@ -198,23 +177,7 @@ jobs:
- name: Install jq
run: sudo apt-get install jq

- name: Enable corepack
run: |
corepack enable
corepack prepare yarn@stable --activate

- name: Activate cache for Node.js 24
uses: actions/setup-node@v6
with:
cache: 'yarn'

- name: Install dependencies
run: |
# install project deps
yarn
# install website deps
cd website
yarn
- uses: apify/workflows/pnpm-install@main

- name: Snapshot the current version
run: |
Expand All @@ -225,8 +188,8 @@ jobs:
exit 1
fi
MAJOR_MINOR=$(echo $VERSION | cut -d. -f1,2)
yarn docusaurus docs:version $MAJOR_MINOR
yarn docusaurus api:version $MAJOR_MINOR
pnpm docusaurus docs:version $MAJOR_MINOR
pnpm docusaurus api:version $MAJOR_MINOR

- name: Commit and push the version snapshot
run: |
Expand Down
Loading
Loading