Skip to content

Commit 8524807

Browse files
author
Robertson
committed
feat: add test cases for live model
1 parent b104372 commit 8524807

53 files changed

Lines changed: 716 additions & 2 deletions

File tree

Some content is hidden

Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.

.gitattributes

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,2 +1,3 @@
11
src/resolver_athena_client/generated/* linguist-generated=true
22
tests/functional/e2e/testcases/**/*.jpg filter=lfs diff=lfs merge=lfs -text
3+
tests/functional/e2e/testcases/**/*.png filter=lfs diff=lfs merge=lfs -text

tests/functional/e2e/test_classify_single.py

Lines changed: 3 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -14,7 +14,7 @@
1414
load_test_cases,
1515
)
1616

17-
TEST_CASES = load_test_cases("benign_model")
17+
TEST_CASES = load_test_cases("live_model")
1818

1919
FP_ERROR_TOLERANCE = 1e-4
2020

@@ -30,7 +30,7 @@ async def test_classify_single(
3030
"""Functional test for ClassifySingle endpoint and API methods.
3131
3232
This test creates a unique test image for each iteration and classifies it.
33-
The test runs multiple iterations to ensure consistent behavior.
33+
3434
"""
3535

3636
# Create gRPC channel with credentials
@@ -57,6 +57,7 @@ async def test_classify_single(
5757
"Expected output to contain labels: ",
5858
f"{test_case.expected_output.keys() - actual_output.keys()}",
5959
)
60+
actual_output = {k: actual_output[k] for k in test_case.expected_output}
6061

6162
max_diff = max(
6263
abs(test_case.expected_output[label] - actual_output[label])

0 commit comments

Comments
 (0)