You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
perf: optimize general path for mixed fixed/variable-length columns
Pre-compute variable-length column indices once per batch instead of
calling is_variable_length() for every column in every row. In pass 2,
only iterate over variable-length columns using the pre-computed indices.
Also skip writing placeholder values for variable-length columns in pass 1,
since they will be overwritten in pass 2.
Performance improvement for primitive types (mixed with strings):
- Before: 131ms (0.8X of Spark)
- After: ~114ms (0.9X of Spark)
Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
0 commit comments