Commit 5fc3cf4
committed
tooling(probe): report torch-CUDA peak + mamba3 chunk flag in fwd/bwd mem probe
The MLX get_peak_memory metric is blind to the torch-CUDA allocator that owns
the Path-B mamba3 bwd scratch (the dominant seq=4096 term). Add torch.cuda.
max_memory_allocated and surface the CPPMEGA_MAMBA3_BWD_SEQ_CHUNK setting so the
probe shows the real unified-memory breakdown.1 parent 7f32db4 commit 5fc3cf4
1 file changed
Lines changed: 14 additions & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
108 | 108 | | |
109 | 109 | | |
110 | 110 | | |
| 111 | + | |
| 112 | + | |
| 113 | + | |
| 114 | + | |
| 115 | + | |
| 116 | + | |
| 117 | + | |
| 118 | + | |
| 119 | + | |
| 120 | + | |
| 121 | + | |
111 | 122 | | |
112 | 123 | | |
| 124 | + | |
113 | 125 | | |
114 | 126 | | |
115 | 127 | | |
116 | 128 | | |
117 | 129 | | |
118 | 130 | | |
119 | 131 | | |
120 | | - | |
| 132 | + | |
| 133 | + | |
121 | 134 | | |
122 | 135 | | |
123 | 136 | | |
| |||
0 commit comments