Skip to content

Temporarily disable Java FFE evaluation tests#7276

Draft
leoromanovsky wants to merge 1 commit into
mainfrom
leo.romanovsky/temporarily-disable-java-ffe-evp-tests
Draft

Temporarily disable Java FFE evaluation tests#7276
leoromanovsky wants to merge 1 commit into
mainfrom
leo.romanovsky/temporarily-disable-java-ffe-evp-tests

Conversation

@leoromanovsky

@leoromanovsky leoromanovsky commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

Motivation

Java FFE evaluation metrics system tests exercise flag allocations that include ISO8601 startAt/endAt window dates. The current Java tracer mainline still has a date-model/parsing mismatch for those allocation windows: system-tests provides ISO8601 strings, while Java needs the Instant allocation-window parsing/model change in DataDog/dd-trace-java#11535. Until that Java tracer PR lands, these evaluation metrics tests fail for a known tracer-side Instant mismatch rather than a system-tests regression.

This PR temporarily disables the Java evaluation metrics manifest entry so system-tests does not gate on that pending Java tracer fix. We will re-enable the entry once DataDog/dd-trace-java#11535 lands on main.

Changes and Decisions

This PR changes the Java manifest entry for tests/ffe/test_flag_eval_metrics.py from the spring-boot version gate to bug (FFL-2339). The file-level manifest rule matches all tests in test_flag_eval_metrics.py, including the metric-count child test, so this keeps the disablement scoped to Java FFE evaluation metrics and leaves the EVP manifest entry unchanged.

Validation

  • ./format.sh progressed through mypy, ruff, whitespace, yamlfmt, yamllint, manifest parser, and shellcheck checks; local Docker failed at the later Node lint stage with a containerd input/output error.
  • ./venv/bin/yamlfmt -lint manifests/
  • ./venv/bin/yamllint -s manifests/
  • ./venv/bin/python utils/manifest/validate.py
  • git diff --check
  • Manifest behavior check confirmed Java spring-boot eval-metrics nodeids resolve to bug (FFL-2339).

@github-actions

github-actions Bot commented Jul 7, 2026

Copy link
Copy Markdown
Contributor

CODEOWNERS have been resolved as:

manifests/java.yml                                                      @DataDog/asm-java @DataDog/apm-java

@leoromanovsky leoromanovsky force-pushed the leo.romanovsky/temporarily-disable-java-ffe-evp-tests branch from 9b58fef to b6ccfa1 Compare July 7, 2026 18:53
@leoromanovsky leoromanovsky force-pushed the leo.romanovsky/temporarily-disable-java-ffe-evp-tests branch from b6ccfa1 to f03668a Compare July 7, 2026 19:13
@leoromanovsky leoromanovsky changed the title Temporarily disable Java EVP flagevaluation tests Temporarily disable Java FFE evaluation tests Jul 7, 2026
@leoromanovsky leoromanovsky changed the base branch from leo.romanovsky/ffe-evp-flagevaluation-enable-java-clean to main July 7, 2026 19:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant