File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -253,6 +253,41 @@ To run a case anyway (testing code correctness on CPU fallback), invoke
253253` pre_process ` and ` simulation ` directly from their install paths, bypassing
254254the ` ./mfc.sh run ` wrapper that calls ` syscheck ` first.
255255
256+ ### Multi-node MPI with Intel MPI 2021.x
257+
258+ Intel MPI 2021.x expects a bundled ` ssh ` binary at ` $I_MPI_ROOT/bin/ssh ` that
259+ understands an ` --external-launcher ` flag used by hydra bootstrap. This binary
260+ is missing from some oneAPI installations, causing SSH bootstrap to fail with
261+ ` unknown option -- - ` .
262+
263+ Workaround: create a wrapper that strips the Intel-specific flag:
264+
265+ ``` bash
266+ mkdir -p ~ /bin
267+ cat > ~ /bin/ssh << 'EOF '
268+ #!/bin/bash
269+ args=(-q -o StrictHostKeyChecking=yes -o BatchMode=yes)
270+ for arg in "$@"; do
271+ [[ "$arg" == "--external-launcher" ]] && continue
272+ [[ "$arg" == "--" ]] && break
273+ args+=("$arg")
274+ done
275+ exec /usr/bin/ssh "${args[@]}"
276+ EOF
277+ chmod +x ~ /bin/ssh
278+ ```
279+
280+ Then run with:
281+ ``` bash
282+ PATH=$HOME /bin:$PATH \
283+ I_MPI_HYDRA_BOOTSTRAP=rsh \
284+ I_MPI_HYDRA_BOOTSTRAP_EXEC=$HOME /bin/ssh \
285+ mpirun -n < ranks> -hosts < node1> ,< node2> ./simulation
286+ ```
287+
288+ Nodes must have passwordless SSH from the launch node and no ` pam_slurm_adopt `
289+ blocking. Suppress the SSH login banner on remote nodes with ` touch ~/.hushlogin ` .
290+
256291### ` libumf.so.1 ` not found at runtime
257292The 2026.0 Level Zero and OpenCL UR adapters link against ` libumf.so.1 ` .
258293If not in ` LD_LIBRARY_PATH ` , all adapters fail silently and sycl-ls reports
You can’t perform that action at this time.
0 commit comments