Skip to content

JSON field evaluator playground is broken and unsynced #4165

@mmabrouk

Description

@mmabrouk

The JSON field evaluator playground has several issues:

  • Adding or removing fields is not reflected when rerunning, and committing changes can fail or ignore the updated fields.
  • After creating an evaluator, it can become uneditable.
  • The evaluator configuration and the test interface are not synchronised, so changes are not reflected consistently.
  • The Select from database button no longer auto-populates fields from the correct answer.
  • The test evaluator UX should preserve the selected app and test set, and keeping the panel open by default would make the flow easier to use.

CleanShot 2026-04-16 at 20.10.54.mp4

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions