Skip to content

fallback to Scheduler if the GRID is not available on runtime#1473

Merged
rvhonorato merged 6 commits into
mainfrom
grid-fallback
Feb 23, 2026
Merged

fallback to Scheduler if the GRID is not available on runtime#1473
rvhonorato merged 6 commits into
mainfrom
grid-fallback

Conversation

@rvhonorato

@rvhonorato rvhonorato commented Feb 20, 2026

Copy link
Copy Markdown
Member

Checklist

Summary of the Pull Request

This PR adds a fallback to get_engine to check if the GRID connection is possible before returning GRIDScheduler.

The fallback logic is to call libgrid.ping_dirac that will check if the necessary commands are available in the PATH and also run dirac-proxy-info that will return a non-zero code if the connection has not been made.

The behavior is then: if an user sets mode=grid but the grid is not available, it will use the local processors instead of the grid, inhering whatever ncores was defined in the configuration file and also display a warning in the logs.

The check will be done per-module, so it should capture the scenario in which one module can finish with the grid but for some reason it becomes unavailable, the following will then use the multiprocessing scheduler. This should give is a higher execution fault tolerance.

Related Issue

#1472

@rvhonorato rvhonorato self-assigned this Feb 20, 2026
@rvhonorato rvhonorato added the execution Related to execution modes, such as GRID, HPC, local, etc. label Feb 20, 2026
@rvhonorato rvhonorato added the enhancement Improving something in the codebase label Feb 20, 2026
@rvhonorato
rvhonorato marked this pull request as ready for review February 20, 2026 15:44
@rvhonorato rvhonorato linked an issue Feb 20, 2026 that may be closed by this pull request

@VGPReys VGPReys left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Seems good

@rvhonorato
rvhonorato merged commit 13016fd into main Feb 23, 2026
16 checks passed
@rvhonorato
rvhonorato deleted the grid-fallback branch February 23, 2026 17:28
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

enhancement Improving something in the codebase execution Related to execution modes, such as GRID, HPC, local, etc.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

add fallback to when GRID execution is not available

2 participants