fix: guard sort() with shuffle check so --shuffle is not silently ignored#5639
Merged
DavertMik merged 1 commit intoJun 15, 2026
Merged
Conversation
…ored sort() added in codeceptjs#5438 was unconditional — it ran after loadTests() applied shuffle(), overwriting the randomised order every time. Guard the sort with !this.opts.shuffle so alphabetical order is used for normal runs and the shuffled order is preserved when --shuffle is requested. Fixes codeceptjs#5605
Contributor
Author
|
Hi! Could a maintainer approve the workflows to run CI on this? The fix is a single guard condition in |
Contributor
Author
|
All relevant checks passing. appium failures are pre-existing, saucelabs infrastructure issues, unrelated to this change. |
Contributor
|
Thank you for catching it! |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Fixes #5605
What
run()callsthis.testFiles.sort()unconditionally afterloadTests()has already appliedshuffle()when--shuffleis set. The sort overwrites the randomised order every time, making--shufflesilently have no effect.Fix
Guard the sort with
!this.opts.shuffle:Normal runs continue to get alphabetical order.
--shuffleruns now keep their randomised order.Why this happened
The
sort()was introduced in #5438 to fix worker suite distribution — a correct fix for that issue, but it introduced this regression for--shuffleusers.Change
Single guard condition in
lib/codecept.js— no other behaviour changed.