Skip to content

Commit 5a723a7

Browse files
committed
feat(java): activate flag eval metrics system tests
Enable tests/ffe/test_flag_eval_metrics.py for the Java SDK. 10 of 17 tests pass. 7 tests annotated as bug (FFL-1972) for known DDEvaluator gaps: - 2x reason mapping (targeting_match instead of static/split) - 2x type mismatch (silent coercion instead of error) - 2x parse error (invalid regex, variant type mismatch) - 1x metric count (OTLP delta temporality points format) Also adds opentelemetry-sdk-metrics and opentelemetry-exporter-otlp to the Java Spring Boot weblog pom.xml, required for the dd-openfeature provider's eval metrics OTel counter.
1 parent c4b7257 commit 5a723a7

2 files changed

Lines changed: 18 additions & 1 deletion

File tree

manifests/java.yml

Lines changed: 8 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -3067,7 +3067,14 @@ manifest:
30673067
"*": irrelevant
30683068
spring-boot: v1.56.0
30693069
tests/ffe/test_exposures.py::Test_FFE_EXP_5_Missing_Targeting_Key: bug (FFL-1729)
3070-
tests/ffe/test_flag_eval_metrics.py: missing_feature
3070+
tests/ffe/test_flag_eval_metrics.py: v1.60.0
3071+
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Metric_Count::test_ffe_eval_metric_count: bug (FFL-1972)
3072+
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Metric_Basic::test_ffe_eval_metric_basic: bug (FFL-1972)
3073+
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Reason_Split::test_ffe_eval_reason_split: bug (FFL-1972)
3074+
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Metric_Type_Mismatch::test_ffe_eval_metric_type_mismatch: bug (FFL-1972)
3075+
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Metric_Numeric_To_Integer::test_ffe_eval_metric_numeric_to_integer: bug (FFL-1972)
3076+
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Metric_Parse_Error_Invalid_Regex::test_ffe_eval_metric_parse_error_invalid_regex: bug (FFL-1972)
3077+
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Metric_Parse_Error_Variant_Type_Mismatch::test_ffe_eval_metric_parse_error_variant_type_mismatch: bug (FFL-1972)
30713078
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_error: bug (MLOB-1234)
30723079
tests/integration_frameworks/llm/openai/test_openai_apm.py: v1.61.0
30733080
tests/integration_frameworks/llm/openai/test_openai_llmobs.py: v1.61.0

utils/build/docker/java/spring-boot/pom.xml

Lines changed: 10 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -60,6 +60,16 @@
6060
<artifactId>opentelemetry-api</artifactId>
6161
<version>1.41.0</version>
6262
</dependency>
63+
<dependency>
64+
<groupId>io.opentelemetry</groupId>
65+
<artifactId>opentelemetry-sdk-metrics</artifactId>
66+
<version>1.41.0</version>
67+
</dependency>
68+
<dependency>
69+
<groupId>io.opentelemetry</groupId>
70+
<artifactId>opentelemetry-exporter-otlp</artifactId>
71+
<version>1.41.0</version>
72+
</dependency>
6373
<dependency>
6474
<groupId>io.opentracing</groupId>
6575
<artifactId>opentracing-api</artifactId>

0 commit comments

Comments
 (0)