Skip to content

[SPARK-57782][INFRA][DOC] Make pages.yml reuse the doc image #56393

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Draft
zhengruifeng wants to merge 3 commits into
base: master
Choose a base branch
from
+13 −23
Draft

[SPARK-57782][INFRA][DOC] Make pages.yml reuse the doc image #56393

Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
8d0c138
[INFRA] Make pages.yml reuse the documentation image used in build_an…
zhengruifeng Jun 9, 2026
6ee4b60
[TEMP][DO NOT MERGE] Trigger pages.yml on the fork branch for validation
zhengruifeng Jun 12, 2026
e2854b1
Revert "[TEMP][DO NOT MERGE] Trigger pages.yml on the fork branch for…
zhengruifeng Jun 12, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
36 changes: 13 additions & 23 deletions .github/workflows/pages.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -37,47 +37,37 @@ jobs:
pages: write
environment:
name: github-pages # https://github.com/actions/deploy-pages/issues/271
container:
image: ghcr.io/apache/spark/apache-spark-github-action-image-docs-cache:master-static
env:
SPARK_TESTING: 1 # Reduce some noise in the logs
RELEASE_VERSION: 'In-Progress'
LC_ALL: C.UTF-8
LANG: C.UTF-8
if: github.repository == 'apache/spark'
steps:
- name: Checkout Spark repository
uses: actions/checkout@v6
with:
repository: apache/spark
ref: 'master'
- name: Add GITHUB_WORKSPACE to git trust safe.directory
run: |
git config --global --add safe.directory ${GITHUB_WORKSPACE}
- name: Free up disk space
run: ./dev/free_disk_space_container
- name: Install Java 17
uses: actions/setup-java@v5
with:
distribution: zulu
java-version: 17
- name: Install Python 3.11
uses: actions/setup-python@v6
with:
python-version: '3.11'
architecture: x64
cache: 'pip'
- name: Install Python dependencies
run: |
pip install 'sphinx==4.5.0' mkdocs 'pydata_sphinx_theme>=0.13' sphinx-copybutton nbsphinx numpydoc jinja2 markupsafe 'pyzmq<24.0.0' \
ipython ipython_genutils sphinx_plotly_directive 'numpy>=1.23.2' pyarrow 'pandas==2.3.3' 'plotly>=4.8' 'docutils<0.18.0' \
'flake8==3.9.0' 'mypy==1.8.0' 'pytest==7.1.3' 'pytest-mypy-plugins==1.9.3' 'ruff==0.14.8' \
'pandas-stubs==1.2.0.53' 'grpcio==1.76.0' 'grpcio-status==1.76.0' 'protobuf==6.33.5' 'grpc-stubs==1.24.11' 'googleapis-common-protos-stubs==2.2.0' \
'sphinxcontrib-applehelp==1.0.4' 'sphinxcontrib-devhelp==1.0.2' 'sphinxcontrib-htmlhelp==2.0.1' 'sphinxcontrib-qthelp==1.0.3' 'sphinxcontrib-serializinghtml==1.1.5'
- name: Install Ruby for documentation generation
uses: ruby/setup-ruby@4dc28cf14d77b0afa6832d9765ac422dbf0dfedd # v1
with:
ruby-version: '3.3'
bundler-cache: true
- name: Install Pandoc
run: |
sudo apt-get update -y
sudo apt-get install pandoc
- name: Install dependencies for documentation generation
run: |
# Keep the version of Bundler here in sync with the following locations:
# - dev/create-release/spark-rm/Dockerfile
# - docs/README.md
gem install bundler -v 2.4.22
cd docs
gem install bundler -v 2.4.22 -n /usr/local/bin
bundle install --retry=100
- name: Run documentation build
run: |
Expand Down