Skip to content

Commit 4c27f97

Browse files
chore: activate easy wins for @DataDog/ml-observability
Co-authored-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
1 parent 0cca57d commit 4c27f97

1 file changed

Lines changed: 29 additions & 7 deletions

File tree

manifests/nodejs.yml

Lines changed: 29 additions & 7 deletions
Original file line numberDiff line numberDiff line change
@@ -1672,14 +1672,34 @@ manifest:
16721672
tests/ffe/test_flag_eval_metrics.py::Test_FFE_Eval_Targeting_Key_Optional: irrelevant (JS SDK requires targeting key)
16731673
tests/integration_frameworks/llm/anthropic/test_anthropic_apm.py::TestAnthropicApmMessages: *ref_5_71_0
16741674
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages: *ref_5_71_0
1675-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create: missing_feature # ephemeral cache TTL metrics not yet released
1676-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_content_block: missing_feature # ephemeral cache TTL metrics not yet released
1675+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create: # ephemeral cache TTL metrics not yet released
1676+
- weblog_declaration:
1677+
'*': missing_feature
1678+
anthropic-js@0.71.0: '>=5.103.0'
1679+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_content_block: # ephemeral cache TTL metrics not yet released
1680+
- weblog_declaration:
1681+
'*': missing_feature
1682+
anthropic-js@0.71.0: '>=5.103.0'
16771683
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_error: bug (MLOB-1234)
16781684
? tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_multiple_system_prompts
1679-
: missing_feature # ephemeral cache TTL metrics not yet released
1680-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_redact_image_input: missing_feature # ephemeral cache TTL metrics not yet released
1681-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_stream_method: missing_feature # ephemeral cache TTL metrics not yet released
1682-
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_tool_result: bug (MLOB-1234)
1685+
: # ephemeral cache TTL metrics not yet released
1686+
- weblog_declaration:
1687+
'*': missing_feature
1688+
anthropic-js@0.71.0: '>=5.103.0'
1689+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_redact_image_input: # ephemeral cache TTL metrics not yet released
1690+
- weblog_declaration:
1691+
'*': missing_feature
1692+
anthropic-js@0.71.0: '>=5.103.0'
1693+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_stream_method: # ephemeral cache TTL metrics not yet released
1694+
- weblog_declaration:
1695+
'*': missing_feature
1696+
anthropic-js@0.71.0: '>=5.103.0'
1697+
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_tool_result: # TODO: a lower version might be supported
1698+
- declaration: bug (MLOB-1234)
1699+
component_version: <5.103.0
1700+
weblog: [anthropic-js@0.71.0]
1701+
- declaration: bug (MLOB-1234)
1702+
excluded_weblog: [anthropic-js@0.71.0]
16831703
tests/integration_frameworks/llm/anthropic/test_anthropic_llmobs.py::TestAnthropicLlmObsMessages::test_create_with_tools: missing_feature (Node.js LLM Observability Anthropic integration does not submit tool definitions)
16841704
tests/integration_frameworks/llm/google_genai/test_google_genai_apm.py::TestGoogleGenAiEmbedContent: *ref_5_81_0
16851705
tests/integration_frameworks/llm/google_genai/test_google_genai_apm.py::TestGoogleGenAiGenerateContent: *ref_5_81_0
@@ -2045,7 +2065,9 @@ manifest:
20452065
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_sample_rate_0_TS007: missing_feature (nodejs has not implemented stats computation yet)
20462066
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_successes_errors_recorded_separately_TS006: missing_feature (nodejs has not implemented stats computation yet)
20472067
tests/parametric/test_library_tracestats.py::Test_Library_Tracestats::test_top_level_TS005: missing_feature (nodejs has not implemented stats computation yet)
2048-
tests/parametric/test_llm_observability/test_llm_observability.py::Test_CostTags: missing_feature (cost_tags not yet supported in Node.js LLMObs SDK)
2068+
tests/parametric/test_llm_observability/test_llm_observability.py::Test_CostTags: # TODO: a lower version might be supported
2069+
- declaration: missing_feature (cost_tags not yet supported in Node.js LLMObs SDK)
2070+
component_version: <5.103.0
20492071
tests/parametric/test_llm_observability/test_llm_observability.py::Test_Enablement: *ref_5_66_0
20502072
tests/parametric/test_llm_observability/test_llm_observability.py::Test_Prompts: *ref_5_83_0
20512073
tests/parametric/test_llm_observability/test_llm_observability_dne.py::Test_Dataset: missing_feature

0 commit comments

Comments
 (0)