Skip to content

[Evaluation] Fix RedTeam.scan() decoding encoded attack prompts in stored results #212

[Evaluation] Fix RedTeam.scan() decoding encoded attack prompts in stored results

[Evaluation] Fix RedTeam.scan() decoding encoded attack prompts in stored results #212

Triggered via pull request June 16, 2026 23:59
Status Failure
Total duration 2m 50s
Artifacts

api-consistency.yml

on: pull_request
Fit to window
Zoom out
Zoom in

Annotations

1 error
consistency
Unhandled error: Error: Command failed: node .github/workflows/src/api-md-consistency/regenerate.js 2026-06-17 00:00:29,445 [INFO] azure-sdk-tools: Installing from feed: https://pkgs.dev.azure.com/azure-sdk/public/_packaging/azure-sdk-for-python/pypi/simple/ 2026-06-17 00:00:29,445 [INFO] azure-sdk-tools: Running apistub check... 2026-06-17 00:00:29,460 [INFO] azure-sdk-tools: Processing azure-ai-evaluation for apistub check 2026-06-17 00:00:30,082 [INFO] azure-sdk-tools: Flag to skip install whl is passed. Skipping package installation 2026-06-17 00:00:30,091 [INFO] root: No whl is found in directory /home/runner/work/azure-sdk-for-python/azure-sdk-for-python/sdk/evaluation/azure-ai-evaluation with package name format azure_ai_evaluation-1.17.0*.whl 2026-06-17 00:00:30,092 [INFO] root: List of whls in directory: [] 2026-06-17 00:00:30,092 [INFO] azure-sdk-tools: Running apistub ['-m', 'apistub', '--pkg-path', '/home/runner/work/azure-sdk-for-python/azure-sdk-for-python/sdk/evaluation/azure-ai-evaluation', '--out-path', '/home/runner/work/azure-sdk-for-python/azure-sdk-for-python/sdk/evaluation/azure-ai-evaluation', '--skip-pylint']. [notice] A new release of pip is available: 24.0 -> 26.1.2 [notice] To update, run: pip install --upgrade pip [notice] A new release of pip is available: 24.0 -> 26.1.2 [notice] To update, run: pip install --upgrade pip Traceback (most recent call last): File "/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/site-packages/apistub/_stub_generator.py", line 213, in generate_tokens apiview = self._generate_tokens( ^^^^^^^^^^^^^^^^^^^^^^ File "/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/site-packages/apistub/_stub_generator.py", line 362, in _generate_tokens module_obj = importlib.import_module(m) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/importlib/__init__.py", line 90, in import_module return _bootstrap._gcd_import(name[level:], package, level) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "<frozen importlib._bootstrap>", line 1387, in _gcd_import File "<frozen importlib._bootstrap>", line 1360, in _find_and_load File "<frozen importlib._bootstrap>", line 1310, in _find_and_load_unlocked File "<frozen importlib._bootstrap>", line 488, in _call_with_frames_removed File "<frozen importlib._bootstrap>", line 1387, in _gcd_import File "<frozen importlib._bootstrap>", line 1360, in _find_and_load File "<frozen importlib._bootstrap>", line 1324, in _find_and_load_unlocked ModuleNotFoundError: No module named 'azure.ai.evaluation.autogen' During handling of the above exception, another exception occurred: Traceback (most recent call last): File "<frozen runpy>", line 198, in _run_module_as_main File "<frozen runpy>", line 88, in _run_code File "/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/site-packages/apistub/__main__.py", line 4, in <module> console_entry_point() File "/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/site-packages/apistub/__init__.py", line 30, in console_entry_point apiview = stub_generator.generate_tokens() ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/site-packages/apistub/_stub_generator.py", line 220, in generate_tokens apiview = self._generate_tokens( ^^^^^^^^^^^^^^^^^^^^^^ File "/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/site-packages/apistub/_stub_generator.py", line 362, in _generate_tokens module_obj = importlib.import_module(m) ^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/opt/hostedtoolcache/Python/3.12.13/x64/lib/python3.12/importlib/__init__.py", line 90, in import_module return _bootstrap._gcd_import(name[level:], package, level) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "<frozen importlib._bootstrap>", line 1387, in _gcd_import File "<frozen importlib._bootstrap>", line 1360, in _find_and_load File "<frozen importlib._bootstrap>", line 1310, i