Skip to content

Commit c4ccdc9

Browse files
committed
docs: define Resources/Agent/Model Server in the glossary
Add Resources Server / Agent Server / Model Server entries to the Architecture Terms glossary. Per review: do not equate the resources server with "the environment" (in Gym an environment is a resources server + agent + dataset(s), see environments/), and surface multiple built-in agent harnesses (simple_agent, aviary_agent, ...) rather than featuring simple_agent alone. Signed-off-by: Wojciech Prazuch <wprazuch@nvidia.com>
1 parent f378fee commit c4ccdc9

2 files changed

Lines changed: 24 additions & 0 deletions

File tree

fern/versions/latest/pages/about/concepts/key-terminology.mdx

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -57,6 +57,18 @@ Training data format for DPO consisting of the same prompt with two different re
5757

5858
The primary LLM being trained or evaluated - the "decision-making brain" you want to improve.
5959

60+
**Resources Server**
61+
62+
The FastAPI service (under `resources_servers/`) that holds per-task state, exposes the environment's tools, and implements `verify()` to score a rollout into a reward — the verifier-and-state component of an environment. (In Gym an *environment* is a resources server together with an agent and dataset(s); see the `environments/` directory.) Every environment has exactly one resources server.
63+
64+
**Agent Server (Responses API Agent)**
65+
66+
The FastAPI service (under `responses_api_agents/`) that drives the model through a task — the harness that runs the multi-step / tool-calling loop against a resources server. Gym ships several built-in harnesses (e.g. `simple_agent`, `aviary_agent`, and others under `responses_api_agents/`); pick whichever fits your control flow, or bring your own.
67+
68+
**Model Server (Responses API Model)**
69+
70+
The FastAPI service (under `responses_api_models/`) that wraps an LLM endpoint (vLLM, OpenAI, etc.) behind NeMo Gym's Responses API and manages the token IDs needed for training. Agents refer to it by name (commonly `policy_model`).
71+
6072
**Orchestration**
6173

6274
Coordination logic that manages when to call models, which tools to use, and how to sequence multi-step operations.

fern/versions/v0.3.0/pages/about/concepts/key-terminology.mdx

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -57,6 +57,18 @@ Training data format for DPO consisting of the same prompt with two different re
5757

5858
The primary LLM being trained or evaluated - the "decision-making brain" you want to improve.
5959

60+
**Resources Server**
61+
62+
The FastAPI service (under `resources_servers/`) that holds per-task state, exposes the environment's tools, and implements `verify()` to score a rollout into a reward — the verifier-and-state component of an environment. (In Gym an *environment* is a resources server together with an agent and dataset(s); see the `environments/` directory.) Every environment has exactly one resources server.
63+
64+
**Agent Server (Responses API Agent)**
65+
66+
The FastAPI service (under `responses_api_agents/`) that drives the model through a task — the harness that runs the multi-step / tool-calling loop against a resources server. Gym ships several built-in harnesses (e.g. `simple_agent`, `aviary_agent`, and others under `responses_api_agents/`); pick whichever fits your control flow, or bring your own.
67+
68+
**Model Server (Responses API Model)**
69+
70+
The FastAPI service (under `responses_api_models/`) that wraps an LLM endpoint (vLLM, OpenAI, etc.) behind NeMo Gym's Responses API and manages the token IDs needed for training. Agents refer to it by name (commonly `policy_model`).
71+
6072
**Orchestration**
6173

6274
Coordination logic that manages when to call models, which tools to use, and how to sequence multi-step operations.

0 commit comments

Comments
 (0)