Commit 5fa3fdf
refactor: simplify PhasedCodecPipeline — remove layout abstraction, use codec chain directly
Remove ~840 lines of ChunkLayout hierarchy (ShardIndex, SimpleChunkLayout,
ShardedChunkLayout, fetch_chunks_sync/async, decode_chunks_from_index,
merge_and_encode_from_index). The pipeline now uses ChunkTransform directly
for sync decode/encode and falls back to the async codec API otherwise.
Also fix ShardingCodec._encode_sync to respect write_empty_chunks config
by skipping inner chunks that are all fill_value.
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>1 parent ed2e230 commit 5fa3fdf
3 files changed
Lines changed: 269 additions & 1097 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
536 | 536 | | |
537 | 537 | | |
538 | 538 | | |
| 539 | + | |
| 540 | + | |
| 541 | + | |
| 542 | + | |
| 543 | + | |
| 544 | + | |
539 | 545 | | |
540 | 546 | | |
541 | | - | |
542 | | - | |
| 547 | + | |
| 548 | + | |
| 549 | + | |
| 550 | + | |
| 551 | + | |
543 | 552 | | |
544 | 553 | | |
545 | 554 | | |
| |||
0 commit comments