Skip to content

Commit 188fb69

Browse files
Ubuntuclaude
andcommitted
fix: sort test class names for ConsoleLauncher and rebuild runtime JAR
Sort class names in _get_test_class_names() to match Maven Surefire's alphabetical execution order. Without sorting, iteration_id collisions across test classes resolve differently between Maven (original) and direct JVM (candidate) runs, causing spurious "DIFFERENT" comparisons. Also rebuild the codeflash-runtime JAR to include the Comparator$TestResult inner class needed for stdout comparison support. Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
1 parent 8028174 commit 188fb69

2 files changed

Lines changed: 4 additions & 1 deletion

File tree

1.2 KB
Binary file not shown.

codeflash/languages/java/test_runner.py

Lines changed: 4 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -845,7 +845,10 @@ def _get_test_class_names(test_paths: Any, mode: str = "performance") -> list[st
845845
elif isinstance(path, str):
846846
class_names.append(path)
847847

848-
return class_names
848+
# Sort to match Maven Surefire's alphabetical execution order.
849+
# Without sorting, iteration_id collisions across test classes resolve
850+
# differently between Maven (original) and direct JVM (candidate) runs.
851+
return sorted(class_names)
849852

850853

851854
def _get_empty_result(maven_root: Path, test_module: str | None) -> tuple[Path, Any]:

0 commit comments

Comments
 (0)