Skip to content

Relation solver places robot#880

Draft
qianl-nv wants to merge 1 commit into
mainfrom
qianl/dev/robot_placement
Draft

Relation solver places robot#880
qianl-nv wants to merge 1 commit into
mainfrom
qianl/dev/robot_placement

Conversation

@qianl-nv

@qianl-nv qianl-nv commented Jul 9, 2026

Copy link
Copy Markdown
Collaborator

Summary

Let the relation solver place robot embodiments

Detailed description

  • Introduce a shared PlacementEntity protocol so the relation solver, object
    placer, and overlap checks operate on both scene objects and embodiments;
    EmbodimentBase and Object now implement it.
  • Add USD-derived embodiment placement footprints (embodiment_placement.py)
    and wire Droid so its pose can be solved from spatial relations (e.g. on
    floor, next_to counter) instead of a hardcoded initial pose.
  • Expand the relation solver / object placer to write solved poses back to the
    correct Isaac Lab scene entity (robot for embodiments), and expand graph
    conversion to attach embodiment relations.
  • Defer the pxr-importing usd_prim_tree import in the pass-2 resolver so
    importing the generation agent no longer pulls in pxr before SimulationApp.
  • Add DummyEmbodiment/DummyObject test doubles plus tests for embodiment
    bbox, graph conversion, and solver placement; add example graph YAMLs
    (kitchen_droid_placement_only, kitchen_embodiment_placement,
    kitchen_pick_and_place).

@qianl-nv qianl-nv force-pushed the qianl/dev/object_reference_v4 branch from 7e62316 to 1494c10 Compare July 10, 2026 09:35
Base automatically changed from qianl/dev/object_reference_v4 to main July 13, 2026 15:29
@qianl-nv qianl-nv force-pushed the qianl/dev/robot_placement branch from 94a0fe3 to 731d2ab Compare July 13, 2026 16:00
@qianl-nv qianl-nv force-pushed the qianl/dev/robot_placement branch from 731d2ab to 91dc6e1 Compare July 15, 2026 03:21
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant