Skip to content

ci(github): update integration test for CLI file editing#52

Merged
remarkablemark merged 1 commit into
masterfrom
ci/test
May 10, 2026
Merged

ci(github): update integration test for CLI file editing#52
remarkablemark merged 1 commit into
masterfrom
ci/test

Conversation

@remarkablemark
Copy link
Copy Markdown
Member

@remarkablemark remarkablemark commented May 10, 2026

What is the motivation for this pull request?

Enhance the E2E integration test to verify the CLI's tool execution capabilities with a model that reliably supports tool calling.

What is the new behavior?

The integration test now validates that the CLI can:

  • Read a file (LICENSE)
  • Use the AI to determine what changes to make (change year 2025 → 2026)
  • Execute the editFile tool to modify the file
  • Complete the task successfully

Model: Using gemma4:e2b (the 2B variant of Gemma 4) with 300s timeout for reliable tool calling.

Prompt: Simplified to "Change 2025 to 2026 in ./LICENSE" for clearer instruction.

Checklist:

@remarkablemark remarkablemark self-assigned this May 10, 2026
@codecov
Copy link
Copy Markdown

codecov Bot commented May 10, 2026

Codecov Report

✅ All modified and coverable lines are covered by tests.

🚀 New features to boost your workflow:
  • ❄️ Test Analytics: Detect flaky tests, report on failures, and find test suite problems.
  • 📦 JS Bundle Analysis: Save yourself from yourself by tracking and limiting bundle sizes in JS merges.

@remarkablemark remarkablemark force-pushed the ci/test branch 9 times, most recently from 7dd4f62 to 0542c54 Compare May 10, 2026 21:38
@remarkablemark remarkablemark merged commit c19d644 into master May 10, 2026
15 checks passed
@remarkablemark remarkablemark deleted the ci/test branch May 10, 2026 21:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant