Describe the bug
There is an all reduce sum in the centorid offset calculation that was missed before merging the local-aware ib patch refactor. This means that only ranks that see the IB will participate in the summation, and so some ranks block trying to sum while others never attempt to sum in the first place. This causes stalls.
To Reproduce
Steps to reproduce the behavior:
- Place either an airfoil or STL IB on the side of a domain, far-left or far-right.
- Run with enought ranks that some ranks will not see the IB in question
Expected behavior
We need to refactor this so that all IBs reduce the IB centroids correctly.
Environment
Additional context
Add any other context about the problem here.
Describe the bug
There is an all reduce sum in the centorid offset calculation that was missed before merging the local-aware ib patch refactor. This means that only ranks that see the IB will participate in the summation, and so some ranks block trying to sum while others never attempt to sum in the first place. This causes stalls.
To Reproduce
Steps to reproduce the behavior:
Expected behavior
We need to refactor this so that all IBs reduce the IB centroids correctly.
Environment
Additional context
Add any other context about the problem here.