Skip to content

fix: enable skipped failure_memory tests and fix assertion bugs#128

Closed
acailic wants to merge 1 commit into
mainfrom
fix/failure-memory-tests-skipped
Closed

fix: enable skipped failure_memory tests and fix assertion bugs#128
acailic wants to merge 1 commit into
mainfrom
fix/failure-memory-tests-skipped

Conversation

@acailic
Copy link
Copy Markdown
Owner

@acailic acailic commented Mar 31, 2026

Summary

  • Removes pytestmark = pytest.mark.skip from tests/test_feature_2_failure_memory.py — the feature is fully implemented in collector/failure_memory.py; all 12 tests were silently not running
  • Removes local placeholder class definitions (EmbeddingGenerationError, FailureSignature, SimilarFailureMatch) that duplicated the real implementations; imports the real classes so isinstance assertions work correctly
  • Fixes assertion key name bugs: add_args[1]["metadata"]add_args[1]["metadatas"][0] and update_args[1]["metadata"]update_args[1]["metadatas"][0] to match the implementation's kwarg metadatas (plural)

Closes #127

Test plan

  • All 12 test_feature_2_failure_memory.py tests now pass
  • ruff check . clean
  • No regressions in test_baseline.py or other targeted suites

🤖 Generated with Claude Code

The test suite for collector/failure_memory.py was entirely skipped
with 'Feature 2 not yet implemented', but the feature has been
implemented. This commit:

- Removes the pytestmark skip decorator so all 12 tests now run
- Removes local placeholder class definitions (EmbeddingGenerationError,
  FailureSignature, SimilarFailureMatch) and imports the real ones from
  collector.failure_memory, so isinstance assertions work correctly
- Fixes add_args[1]["metadata"] -> add_args[1]["metadatas"][0] to match
  the implementation's keyword argument name (plural "metadatas")
- Fixes update_args[1]["metadata"] -> update_args[1]["metadatas"][0]
  for the same reason

Closes #127

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
@acailic
Copy link
Copy Markdown
Owner Author

acailic commented Mar 31, 2026

Superseded — main deleted tests/test_feature_2_failure_memory.py in 0d4c5e3 (refactor: remove dead ranking module and unused feature tests). This PR modifies a file that no longer exists.

@acailic acailic closed this Mar 31, 2026
@acailic acailic deleted the fix/failure-memory-tests-skipped branch March 31, 2026 23:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

bug: failure_memory tests incorrectly skipped; feature is implemented

1 participant