Skip to content

CI memory shortage#243

Merged
spossann merged 21 commits into
develfrom
242-github-ci-runs-out-of-memory
May 13, 2026
Merged

CI memory shortage#243
spossann merged 21 commits into
develfrom
242-github-ci-runs-out-of-memory

Conversation

@spossann

@spossann spossann commented May 11, 2026

Copy link
Copy Markdown
Member

Solves the following issue(s):

Closes #242

I guess this is because Github changed memory limits? Is there any source for this?

The reason is most like the new garbage collector introduced in Python 3.14. It can cause problems in large pytest runs, since packages like numpy, pandas etc have not yet adopted it. Actually, the new GC has been rolled back in Python 3.14.5, see https://www.igorslab.de/en/python-3-14-5-released-maintenance-update-old-garbage-collector/

Implemented solution:

Pin Python to 3.13 in the docker image ubunte-latest-with-struphy. The other imageubuntu-with-reqs still has the newest Python version and can be used for scheduled testing.

Other changes:

Implemented sharding of unit tests (4 shards) to have quicker concurrent workflows.

@spossann spossann linked an issue May 11, 2026 that may be closed by this pull request
@spossann spossann requested a review from max-models May 11, 2026 13:58
@spossann spossann marked this pull request as ready for review May 11, 2026 13:58
@spossann

Copy link
Copy Markdown
Member Author

Hi @max-models - this is now indeed ready for review! The reason for the memory overflow was a change in the garbage collection in Python 3.14 (see description above).

@max-models max-models left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This solution looks a bit like a hack, but maybe it's the best way to solve it for now. :)

@spossann spossann merged commit bb4d79b into devel May 13, 2026
22 checks passed
@spossann spossann deleted the 242-github-ci-runs-out-of-memory branch May 13, 2026 07:52
spossann added a commit that referenced this pull request Jun 9, 2026
**Solves the following issue(s):**

Closes #242 

I guess this is because Github changed memory limits? Is there any
source for this?

The reason is most like the new garbage collector introduced in Python
3.14. It can cause problems in large pytest runs, since packages like
numpy, pandas etc have not yet adopted it. Actually, the new GC has been
rolled back in Python 3.14.5, see
https://www.igorslab.de/en/python-3-14-5-released-maintenance-update-old-garbage-collector/

**Implemented solution:**

Pin Python to 3.13 in the docker image `ubunte-latest-with-struphy`. The
other image`ubuntu-with-reqs` still has the newest Python version and
can be used for scheduled testing.

**Other changes:**

Implemented sharding of unit tests (4 shards) to have quicker concurrent
workflows.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Github CI runs out of memory

2 participants