Skip to content

Chaos Tests#433

Merged
devhawk merged 10 commits into
mainfrom
devhawk/chaos-tests
Jun 17, 2026
Merged

Chaos Tests#433
devhawk merged 10 commits into
mainfrom
devhawk/chaos-tests

Conversation

@devhawk

@devhawk devhawk commented Jun 12, 2026

Copy link
Copy Markdown
Collaborator

This PR is not ready for review. I've opened a draft PR for CI coverage

This PR updates dbRetry to make it retry in more situations:

  • isConnectionFailure returns true for exceptions w/o a SQL state code but that have a message related to closed connection.
  • isTransientState returns for all SQL State codes that start with 53 instead of just 53300 to cover all insufficient resource errors
  • removes 20 retry cap
  • unified retry backoff starting at 1s and maxing at 60s

Enables chaosTest and adds a new toxiproxy based test to simulate more failure scenarios. Both tests run 5 times but only in CI environments by default

Updates StaticQueuesTest and TimeoutTest to reduce flakyness.

@devhawk devhawk marked this pull request as ready for review June 15, 2026 23:54
@devhawk devhawk linked an issue Jun 17, 2026 that may be closed by this pull request
@devhawk devhawk merged commit f371b6f into main Jun 17, 2026
18 checks passed
@devhawk devhawk deleted the devhawk/chaos-tests branch June 17, 2026 18:11
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Chaos Tests

2 participants