Include MPI to prevent precompilation output capture#5559
Open
navidcy wants to merge 4 commits into
Open
Conversation
Added MPI usage to avoid capturing precompilation output.
navidcy
added
documentation 📜
Collaborator
|
In the linked example the package being precompiled is Oceananigans, not MPI, I'm not sure I follow how this would fix that |
Member
Author
|
Gotca. So perhaps there is no solution then, right? Shall I close this? |
Collaborator
|
I'm pretty sure this is solvable, but needs to understand why Oceananigans is being precompiled again. Setting the env var |
Collaborator
In fact it did not: https://clima.github.io/OceananigansDocumentation/previews/PR5559/grids#Distributed-grids. I'd need to see the flow of where Oceananigans is last precompiled in the CI process and then how exactly it's called in the example, but what I suggested above should hopefully shed some light on this. |
Member
Author
|
Suggested "hack": We can put the whole example in a hidden eval cell previously so that would trigger the precompilation then? |
Member
Author
|
Where should I put that Oceananigans.jl/.buildkite/pipeline.yml Line 68 in a84e8e6 ? |
Collaborator
I don't think this should be worked around, but rather properly solved.
That'd affect everything, it'd be unnecessarily overly verbose. I set it right in the offending MPI script with 19f56f6 |
Collaborator
|
https://clima.github.io/OceananigansDocumentation/previews/PR5559/grids#Distributed-grids Different check bounds and optimisation options, that should be easy to fix 🙂 |
giordano
force-pushed
the
ncc/mpi-precompilation
branch
from
0ffed82 to
4d21673
Compare
giordano
reviewed
May 4, 2026
| # from the terminal. | ||
| using MPI | ||
| run(`$(mpiexec()) -n 2 $(Base.julia_cmd()) --project distributed_arch_example.jl`) | ||
| run(`$(mpiexec()) -n 2 $(Base.julia_cmd()) -O0 --check-bounds=yes --project distributed_arch_example.jl`) |
Collaborator
There was a problem hiding this comment.
I believe this comes from
Oceananigans.jl/.buildkite/pipeline.yml
Line 29 in 9b5766c
-O0 is right there, and --check-bounds=yes is implicit in Pkg.test.
Honestly, I'm not convinced the documentation job should use the same precompiled environment as the tests, they do different things, the environments are even technically completely different.
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
2 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Added MPI usage to avoid capturing precompilation output.
E.g. see output from example at https://clima.github.io/OceananigansDocumentation/stable/grids#Distributed-grids