Add low_cpu_mem_usage=True to from_pretrained for ~2x faster cold starts#355

Merged

Ingvarstep merged 4 commits into

urchade:mainfrom

maxwbuckley:add-low-cpu-mem-usage

Apr 29, 2026

Commits on Apr 27, 2026

Add low_cpu_mem_usage=True to from_pretrained for ~2x faster cold starts

maxwbuckley
and
claude
committed
Auto-fallback for unrecognized non-persistent buffers

maxwbuckley
and
claude
committed
Fall back when assign-load leaves meta parameters

maxwbuckley
and
claude
committed

Commits on Apr 28, 2026

Merge origin/main into add-low-cpu-mem-usage

maxwbuckley
and
claude
committed