The JSON field evaluator playground has several issues:
- Adding or removing fields is not reflected when rerunning, and committing changes can fail or ignore the updated fields.
- After creating an evaluator, it can become uneditable.
- The evaluator configuration and the test interface are not synchronised, so changes are not reflected consistently.
- The Select from database button no longer auto-populates fields from the correct answer.
- The test evaluator UX should preserve the selected app and test set, and keeping the panel open by default would make the flow easier to use.
CleanShot 2026-04-16 at 20.10.54.mp4
The JSON field evaluator playground has several issues:
CleanShot 2026-04-16 at 20.10.54.mp4