Skip to content

Add compare command to diff two agents side by side#49

Merged
that-github-user merged 1 commit into
mainfrom
issue-29-compare-command
Mar 28, 2026
Merged

Add compare command to diff two agents side by side#49
that-github-user merged 1 commit into
mainfrom
issue-29-compare-command

Conversation

@that-github-user

Copy link
Copy Markdown
Owner

Summary

  • New thinktank compare <agentA> <agentB> command
  • Shows agent summaries, Jaccard similarity bar, file overlap, and added line breakdown
  • Reuses existing diff-parser infrastructure

Change type

  • Bug fix
  • New feature
  • Refactor
  • Documentation
  • CI / infrastructure
  • Chore

Related issue

Closes #29

How to test

# After a thinktank run with 3+ agents:
thinktank compare 1 2
thinktank compare 1 3

Breaking changes

  • This PR introduces breaking changes

🤖 Generated with Claude Code

- `thinktank compare 1 3` shows detailed comparison
- Displays: agent summaries, Jaccard similarity score with bar chart,
  file overlap (both/only-A/only-B), added line breakdown
- Uses existing diff-parser infrastructure for analysis

Closes #29

Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@that-github-user

Copy link
Copy Markdown
Owner Author

Self-review: Validates both agent IDs exist. Similarity uses same Jaccard from diff-parser.ts. File overlap correctly categorizes both/A-only/B-only. 56 tests pass, lint clean.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Add --compare flag to diff two agents' results side-by-side

1 participant