Skip to content

Commit 3329bf2

Browse files
adding summary and faq and then tweaking with skills
1 parent 72dd2bc commit 3329bf2

1 file changed

Lines changed: 47 additions & 1 deletion

File tree

  • content/learning-paths/cross-platform/ai-agent-cpu-orchestration

content/learning-paths/cross-platform/ai-agent-cpu-orchestration/_index.md

Lines changed: 47 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -17,9 +17,54 @@ prerequisites:
1717
- An Arm-based computer running Linux or macOS, such as an Apple silicon MacBook or an NVIDIA DGX Spark
1818
- Familiarity with running Python scripts from the terminal
1919

20+
# START generated_summary_faq
21+
generated_summary_faq:
22+
template_version: summary-faq-v3
23+
generated_at: '2026-07-10T21:49:51Z'
24+
generator: ai
25+
ai_assisted: true
26+
ai_review_required: true
27+
model: gpt-5
28+
prompt_template: summary-faq-v3
29+
source_hash: 59eaec53e94f78a294d2d04f28d81bd885d0d47f30e88d3c87230145bac77980
30+
summary_generated_at: '2026-07-10T21:49:51Z'
31+
summary_source_hash: 59eaec53e94f78a294d2d04f28d81bd885d0d47f30e88d3c87230145bac77980
32+
faq_generated_at: '2026-07-10T21:49:51Z'
33+
faq_source_hash: 59eaec53e94f78a294d2d04f28d81bd885d0d47f30e88d3c87230145bac77980
34+
summary: >-
35+
You'll run a local concierge agent on an Arm machine and examine how the workload
36+
splits between CPU orchestration and GPU-backed model inference. You'll set up a
37+
Python environment, configure a Serper web search API key, and serve Gemma 3 locally
38+
with Ollama. As the agent answers your research-style questions, you'll use its per-query
39+
timeline to see how much of web search, scraping, ranking, deduplication, and extraction runs
40+
on the CPU.
41+
faqs:
42+
- question: How do I know Ollama is ready before running the agent?
43+
answer: >-
44+
Confirm Ollama is running and serving the `gemma3:4b` model. The local API at `http://localhost:11434`
45+
should be available before starting the script.
46+
- question: What do I need in the terminal environment when I start the script?
47+
answer: >-
48+
Activate your Python virtual environment and set `SERPER_API_KEY` in the same terminal session.
49+
The agent reads this variable at runtime for web search.
50+
- question: What result should I expect when the agent starts correctly?
51+
answer: >-
52+
You should see a greeting that explains the agent browses websites in real time and a prompt
53+
asking for your question. Type `quit` or `exit` to end the session.
54+
- question: How do I read the CPU and GPU timeline the agent prints?
55+
answer: >-
56+
CPU entries in the timeline correspond to tools (web search, scraping) and the orchestration pipeline (query expansion,
57+
ranking, deduplication, extraction). GPU entries correspond to the Gemma model running through
58+
Ollama. The agentic chain interleaves these steps.
59+
- question: Where can I see how the workflow is organized in the code?
60+
answer: >-
61+
Open `concierge_agent.py`. It groups the tools, the LLM "brain," the orchestration pipeline,
62+
and the agentic chain, and indicates which components run on the CPU or GPU.
63+
# END generated_summary_faq
64+
2065
author: Jaidev Singh Chadha
2166

22-
generate_summary_faq: true
67+
generate_summary_faq: false
2368
rerun_summary: false
2469
rerun_faqs: false
2570

@@ -67,3 +112,4 @@ weight: 1 # _index.md always has weight of 1 to order corr
67112
layout: "learningpathall" # All files under learning paths have this same wrapper
68113
learning_path_main_page: "yes" # This should be surfaced when looking for related content. Only set for _index.md of learning path content.
69114
---
115+

0 commit comments

Comments
 (0)