Skip to content

[DOCS] Add NVIDIA provider to Rust ADK provider docs #343

Description

@inference-gateway-maintainer

The Rust ADK (inference-gateway/rust-adk) now supports NVIDIA as a first-class LLM provider, propagating the ecosystem-wide provider addition (gateway -> schemas -> SDKs -> ADKs).

What changed (user-facing):

  • A2A_AGENT_CLIENT_PROVIDER=nvidia is now accepted by the Rust ADK (mapped to the SDK Provider::Nvidia variant after bumping inference-gateway-sdk to 0.14.1).
  • Example model id: nvidia/meta/llama-3.1-8b-instruct (NVIDIA NIM via the build.nvidia.com API catalog).
  • NVIDIA_API_KEY was added to the example .env files and to the inference-gateway service passthrough in the example docker-compose files.

Docs to update:

  • Any provider matrix / supported-providers list that enumerates Rust ADK (or ecosystem) providers should include NVIDIA.
  • If there is a per-provider setup page, add NVIDIA (bearer auth, base URL https://integrate.api.nvidia.com/v1, supports_vision: true).

Reference PR: inference-gateway/rust-adk#86 (Closes inference-gateway/rust-adk#84).

Metadata

Metadata

Assignees

No one assigned

    Labels

    documentationImprovements or additions to documentationreleased

    Type

    Fields

    No fields configured for Task.

    Projects

    Status
    Done

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions