Skip to content

Lower max RSS value on low memory systems #88

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
vchuravy merged 3 commits into from
Feb 11, 2026
Merged

Lower max RSS value on low memory systems #88

Changes from 2 commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
c76ceae
Lower max rss value on low memory systems
christiangnrd Feb 10, 2026
164f0b4
make `max_worker_rss` configurable
christiangnrd Feb 10, 2026
e817170
Make max rss a kwarg
christiangnrd Feb 10, 2026
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
25 changes: 19 additions & 6 deletions src/ParallelTestRunner.jl
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -45,16 +45,29 @@ Malt.isrunning(wrkr::PTRWorker) = Malt.isrunning(wrkr.w)
Malt.stop(wrkr::PTRWorker) = Malt.stop(wrkr.w)

#Always set the max rss so that if tests add large global variables (which they do) we don't make the GC's life too hard
if Sys.WORD_SIZE == 64
const JULIA_TEST_MAXRSS_MB = 3800
_get_julia_test_maxrss_mb() = if haskey(ENV, "JULIA_TEST_MAXRSS_MB")
parse(Int, ENV["JULIA_TEST_MAXRSS_MB"])
elseif Sys.WORD_SIZE == 64
Sys.total_memory() > 8*2^30 ? 3800 : 3000
else
# Assume that we only have 3.5GB available to a single process, and that a single
# test can take up to 2GB of RSS. This means that we should instruct the test
# framework to restart any worker that comes into a test set with 1.5GB of RSS.
const JULIA_TEST_MAXRSS_MB = 1536
1536
end
@static if isdefined(Base, :OncePerProcess) # VERSION >= v"1.12.0-DEV.1421"
const max_worker_rss = OncePerProcess{Int}() do
_get_julia_test_maxrss_mb() * 2^20
end
else
const _max_worker_rss::Ref{Int} = Ref{Int}(0)
function max_worker_rss()
if _max_worker_rss[] == 0
_max_worker_rss[] = _get_julia_test_maxrss_mb() * 2^20
end
_max_worker_rss[]
end
end

Comment thread
giordano marked this conversation as resolved.
const max_worker_rss = JULIA_TEST_MAXRSS_MB * 2^20

function with_testset(f, testset)
@static if VERSION >= v"1.13.0-DEV.1044"
Expand Down Expand Up @@ -1037,7 +1050,7 @@ function runtests(mod::Module, args::ParsedArgs;
break
end

if memory_usage(result) > max_worker_rss
if memory_usage(result) > max_worker_rss()
# the worker has reached the max-rss limit, recycle it
# so future tests start with a smaller working set
Malt.stop(wrkr)
Expand Down