Skip to content

Reviewed parallel merge#4381

Open
klirichek wants to merge 14 commits into
masterfrom
reviewed_parallel_merge
Open

Reviewed parallel merge#4381
klirichek wants to merge 14 commits into
masterfrom
reviewed_parallel_merge

Conversation

@klirichek
Copy link
Copy Markdown
Contributor

#4091
reviewed

N-way merge picked 'as is'
removed 'standard' optimize (left only progressive).
reworked parallel (multi-threading) merge

klirichek and others added 14 commits March 16, 2026 18:43
Only progressive is in game from now
route MergeTwoChunks to MergeNChunks
with batch = 32 and having 40 chunks - it optimized to 40-32+1=9
despite cutoff.
Now it decrease batch size on the edge pass to obey cutoff
two threads can't simultaneously start optimize same set of chunks; one
will always see if they were occupied even if it is happened 'right now'
.
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant