Skip to content

Use typed configuration for local Experiments#892

Draft
cvolkcvolk wants to merge 5 commits into
cvolk/refactor/eval-runner-yaml-integrationfrom
cvolk/refactor/local-experiment-execution
Draft

Use typed configuration for local Experiments#892
cvolkcvolk wants to merge 5 commits into
cvolk/refactor/eval-runner-yaml-integrationfrom
cvolk/refactor/local-experiment-execution

Conversation

@cvolkcvolk

@cvolkcvolk cvolkcvolk commented Jul 10, 2026

Copy link
Copy Markdown
Collaborator

Summary

Use typed configuration for local Experiment execution

Detailed description

  • Depends on Run typed YAML experiments from eval_runner.py #876 and should merge after it; this draft is stacked on the Run typed YAML experiments from eval_runner.py #876 branch that introduces typed YAML execution through eval_runner.py.
  • Prepares eval_runner.py to become the single entry point for both local execution and OSMO submission by replacing the Namespace flow with EvalRunnerCfg and typed AppLauncher values; explicit routing remains a later PR.
  • Keeps local execution in eval_runner.py until the non-local path exists, avoiding a premature execution-module abstraction.
  • Preserves native Hydra overrides, legacy JSON and chunk behavior, and existing camera semantics; camera preflight and OSMO behavior are intentionally excluded.

Keep eval_runner.py as the sole entry point while moving local orchestration behind typed configuration. This establishes the local half of a future local/OSMO router without changing existing camera or legacy JSON behavior.

Signed-off-by: Clemens Volk <cvolk@nvidia.com>
Comment thread isaaclab_arena/evaluation/local_evaluation.py Outdated
Comment thread isaaclab_arena/evaluation/local_evaluation.py Outdated
Comment thread isaaclab_arena/utils/isaaclab_utils/simulation_app.py Outdated
Signed-off-by: Clemens Volk <cvolk@nvidia.com>
@cvolkcvolk cvolkcvolk changed the title Extract local Experiment execution Use typed configuration for local Experiments Jul 10, 2026
Signed-off-by: Clemens Volk <cvolk@nvidia.com>
"--experiment-config",
"--experiment_config",
"--eval-jobs-config",
"--eval_jobs_config",

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Let's stick with only the underscore version

help="Path to a typed YAML Experiment or deprecated JSON evaluation config.",
)
parser.add_argument(
"--record-viewport-video",

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Lets keep the underscore version, here and for all other flags

Signed-off-by: Clemens Volk <cvolk@nvidia.com>
Signed-off-by: Clemens Volk <cvolk@nvidia.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant