Skip to content

Tutorial for integrating Depth AI model with Nav2#920

Merged
SteveMacenski merged 15 commits into
ros-navigation:masterfrom
sachinkum0009:feat/depth-ai-integration
Jun 29, 2026
Merged

Tutorial for integrating Depth AI model with Nav2#920
SteveMacenski merged 15 commits into
ros-navigation:masterfrom
sachinkum0009:feat/depth-ai-integration

Conversation

@sachinkum0009

Copy link
Copy Markdown
Contributor

Basic Info

Info Please fill out this column
Ticket(s) this addresses ros-navigation/navigation2.ai#1
Does this PR contain AI-generated software? No

Description of contribution in a few bullet points

  • Added a new tutorial for integrating AI-based Depth Estimation (Depth Anything V3) with Nav2 Costmap for obstacle avoidance and path planning.
  • Enables cost-effective navigation using a monocular USB camera as a depth sensor, eliminating the need for expensive LiDAR or stereo/RGB-D cameras.
  • Provides step-by-step instructions for:
    • Setting up dependencies (ROS 2 perception packages, TensorRT-accelerated Depth Anything V3).
    • Configuring parameters for USB Cam, Crop Decimate, Resize, Depth Anything V3, and Point Cloud nodes.
    • Integrating the PointCloud2 output with Nav2's Voxel Costmap Layer.

Signed-off-by: Sachin Kumar <sachinkum123567@gmail.com>
Signed-off-by: Sachin Kumar <sachinkum123567@gmail.com>
Signed-off-by: Sachin Kumar <sachinkum123567@gmail.com>
Signed-off-by: Sachin Kumar <sachinkum123567@gmail.com>
Signed-off-by: Sachin Kumar <sachinkum123567@gmail.com>
@sachinkum0009 sachinkum0009 force-pushed the feat/depth-ai-integration branch from 0bd252d to 770d60e Compare May 20, 2026 21:35
Signed-off-by: Sachin Kumar <sachinkum123567@gmail.com>
@sachinkum0009 sachinkum0009 marked this pull request as ready for review May 21, 2026 12:56
Signed-off-by: Sachin Kumar <sachinkum123567@gmail.com>
Signed-off-by: Sachin Kumar <sachinkum123567@gmail.com>
@mergify

mergify Bot commented Jun 26, 2026

Copy link
Copy Markdown

Tick the box to add this pull request to the merge queue (same as @mergifyio queue).

  • Queue this pull request

@SteveMacenski SteveMacenski left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Can you replace any "DAV3" with Depth Anything V3?

Comment thread tutorials/docs/depth_ai_integration.rst Outdated
Comment thread tutorials/docs/depth_ai_integration.rst Outdated
Comment thread tutorials/docs/depth_ai_integration.rst Outdated
Comment thread tutorials/docs/depth_ai_integration.rst Outdated
Comment thread tutorials/docs/depth_ai_integration.rst
Comment thread tutorials/docs/depth_ai_integration.rst
@SteveMacenski

Copy link
Copy Markdown
Member

Otherwise, LGTM, these are all small nitpicks

sachinkum0009 and others added 5 commits June 27, 2026 16:56
Co-authored-by: Steve Macenski <stevenmacenski@gmail.com>
Signed-off-by: Sachin Kumar <sachinkum123567@gmail.com>
Co-authored-by: Steve Macenski <stevenmacenski@gmail.com>
Signed-off-by: Sachin Kumar <sachinkum123567@gmail.com>
Signed-off-by: Sachin Kumar <sachinkum123567@gmail.com>
Signed-off-by: Sachin Kumar <sachinkum123567@gmail.com>
Signed-off-by: Sachin Kumar <sachinkum123567@gmail.com>
@sachinkum0009 sachinkum0009 force-pushed the feat/depth-ai-integration branch from a5db5fb to 2c73677 Compare June 27, 2026 16:04
@sachinkum0009

Copy link
Copy Markdown
Contributor Author

Thanks for the review. I have updated the code.

@SteveMacenski SteveMacenski left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Otherwise LGTM and can merge!

Comment thread tutorials/docs/depth_ai_integration.rst Outdated
@SteveMacenski SteveMacenski merged commit 83d088d into ros-navigation:master Jun 29, 2026
6 of 7 checks passed
@sachinkum0009 sachinkum0009 deleted the feat/depth-ai-integration branch July 2, 2026 08:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants