Test: org.apache.jackrabbit.oak.security.authentication.ldap.LdapLoginStandaloneTest#testSyncCreateGroup
Flakiness introduced at commit: 9ceb99d04b8a57769628b35e1c47265d2168928a
Investigation details:
- Version 1.36: Build fails with ConcurrentModificationException
- Commit 9ceb99d04b: Build succeeds, flakiness introduced
- Version 1.38.0 through 1.86: Flakiness persists
note that for the build to succeed, it's necessary to do a fresh build (i.e. mvn clean install -DskipTests -pl oak-auth-ldap -am in order to avoid cache corruption)
The test passes under normal execution but fails consistently when execution order
is randomized by NonDex. The failure manifests as:
javax.security.auth.login.LoginException: Login Failure: all modules ignored
This indicates the test has a dependency on HashMap/HashSet iteration order or
similar non-deterministic behavior introduced during code changes between v1.36 and v1.38.
Verified using NonDex 2.1.7 with multiple seeds (933178, 974622, 1016066).
Attached logs show that the build fails due to a concurrency exception at the commit just before 9ceb99d04b8a57769628b35e1c47265d2168928a, then at that commit, the build succeeds, the first test passes, but once nondex starts shuffling, tests fail.
build-succeeds-nondex.txt
build-fails-nondex.txt
Test: org.apache.jackrabbit.oak.security.authentication.ldap.LdapLoginStandaloneTest#testSyncCreateGroup
Flakiness introduced at commit: 9ceb99d04b8a57769628b35e1c47265d2168928a
Investigation details:
note that for the build to succeed, it's necessary to do a fresh build (i.e. mvn clean install -DskipTests -pl oak-auth-ldap -am in order to avoid cache corruption)
The test passes under normal execution but fails consistently when execution order
is randomized by NonDex. The failure manifests as:
javax.security.auth.login.LoginException: Login Failure: all modules ignored
This indicates the test has a dependency on HashMap/HashSet iteration order or
similar non-deterministic behavior introduced during code changes between v1.36 and v1.38.
Verified using NonDex 2.1.7 with multiple seeds (933178, 974622, 1016066).
Attached logs show that the build fails due to a concurrency exception at the commit just before 9ceb99d04b8a57769628b35e1c47265d2168928a, then at that commit, the build succeeds, the first test passes, but once nondex starts shuffling, tests fail.
build-succeeds-nondex.txt
build-fails-nondex.txt