Skip to content

fix: Benchmarker best score graph no longer empty#1636

Merged
triceo merged 9 commits into
TimefoldAI:mainfrom
triceo:bench
Jun 9, 2025
Merged

fix: Benchmarker best score graph no longer empty#1636
triceo merged 9 commits into
TimefoldAI:mainfrom
triceo:bench

Conversation

@triceo

@triceo triceo commented Jun 9, 2025

Copy link
Copy Markdown
Collaborator

During the init score removal (cf87aa7), we did not notice that this impacts metrics as well. Benchmarker reads its data from metrics, and therefore lost the information on what score is or is not initialized. As a result, the default value was always false, resulting in empty score graph.

This commit fixes that issue by registering a metric for the unassigned count, which will be reused by benchmarker to provide the correct initialization state.

@triceo triceo self-assigned this Jun 9, 2025
@triceo triceo added this to the v1.23.0 milestone Jun 9, 2025
@triceo triceo linked an issue Jun 9, 2025 that may be closed by this pull request
@triceo triceo had a problem deploying to documentation (preview) June 9, 2025 09:00 — with GitHub Actions Failure
@triceo triceo removed this from the v1.23.0 milestone Jun 9, 2025
@triceo triceo had a problem deploying to documentation (preview) June 9, 2025 09:18 — with GitHub Actions Failure
@triceo triceo had a problem deploying to documentation (preview) June 9, 2025 09:20 — with GitHub Actions Failure
@triceo triceo had a problem deploying to documentation (preview) June 9, 2025 09:24 — with GitHub Actions Failure
@triceo triceo requested review from zepfred and removed request for Christopher-Chianelli June 9, 2025 11:25
@triceo triceo had a problem deploying to documentation (preview) June 9, 2025 13:36 — with GitHub Actions Failure

@zepfred zepfred left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've confirmed that it works with some quick-start modules. There are a few minor comments, but overall, it looks great to me!

@triceo triceo had a problem deploying to documentation (preview) June 9, 2025 15:04 — with GitHub Actions Failure
@sonarqubecloud

sonarqubecloud Bot commented Jun 9, 2025

Copy link
Copy Markdown

Quality Gate Failed Quality Gate failed

Failed conditions
51.2% Coverage on New Code (required ≥ 70%)

See analysis details on SonarQube Cloud

@triceo triceo merged commit a3f7862 into TimefoldAI:main Jun 9, 2025
39 of 43 checks passed
@triceo triceo deleted the bench branch June 9, 2025 15:27
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Benchmark - Best Score Graph is empty

2 participants