Full Scale Performance: Single Process, Sharrow Off

[jpn--]

This is the issue to report on memory usage and runtime performance...

• data_dir: "data-full" full scale skims (24333 MAZs)
• households_sample_size: 0 (full scale 100% sample of households)
• sharrow: false
• multiprocess: false single process

[dhensle]

Run completed in about 26 hours on a 1TB machine with 2.79 GHz processor. Memory peak was about 540GB and occurred in trip destination:

logs_no_sh_full.zip

[dhensle]

Ran again with the following code and using blosc2 skims
ActivitySim/activitysim#867
#15

Run took 23.8 hours and peaked at about 536 GB of RAM. This is just a bit faster than before and the memory profile looks pretty much the same.

log_no_sh_full_v2.zip