Test coverage gaps

[jf-x-dev]

Test coverage gaps

Cases that are not covered, but could be fairly easily:

• Import issues
• Removing parent-child relationships from an import
• Editing a vaccination to given?
  • Also, editing every field of a vaccination

Cases that cannot be covered easily (but could be with major changes):

• Most PDS functionality (import checks, cascading search)
  • These features are intentionally disabled on qa as they would break performance tests
  • Would need to try if using the int PDS environment could work in all relevant cases
• SMS and email checks
  • qa would need to be configured to send emails/texts
  • Email checks could be done by allowing the automated tests to access a notify inbox
  • SMS could be quite challenging (unless there is an easy way to do it with notify)
  • Alternative approach - allowing emails/SMS message content to be viewed in the application somehow (or retrieved by API call?)
• Anything that can't be covered with a single fresh organisation
  • Anything related to expired vaccination batches
  • Anything related to session dates in the past
  • Anything requiring multiple organisations/teams to test
  • Playwright allows us to set the time/date in tests, though we'd have to see if this could be used at all
  • Alternative - onboard some old data when starting tests
• Checking exact numbers of patients/consent responses etc.
  • We create fresh organisations to run tests in, but not every test is guaranteed to run in a completely fresh environment
  • e.g. session dates can't be deleted if a patient was vaccinated in the session
  • Could be solved by resetting environment after each test (currently only done after each module i.e. each set of tests)
• Using more realistic data
  • e.g. by anonymizing real data
  • An easier step could be to add some known "quirky" data cases to the current E2E tests (e.g. twins)

[thomasleese]

@jf-x-dev @zoltan-antal Do you think it's worth raising individual issues for each of these (perhaps grouped in some way) so we can track the work separately?