@@ -17,9 +17,54 @@ prerequisites:
1717 - An Arm-based computer running Linux or macOS, such as an Apple silicon MacBook or an NVIDIA DGX Spark
1818 - Familiarity with running Python scripts from the terminal
1919
20+ # START generated_summary_faq
21+ generated_summary_faq :
22+ template_version : summary-faq-v3
23+ generated_at : ' 2026-07-10T21:49:51Z'
24+ generator : ai
25+ ai_assisted : true
26+ ai_review_required : true
27+ model : gpt-5
28+ prompt_template : summary-faq-v3
29+ source_hash : 59eaec53e94f78a294d2d04f28d81bd885d0d47f30e88d3c87230145bac77980
30+ summary_generated_at : ' 2026-07-10T21:49:51Z'
31+ summary_source_hash : 59eaec53e94f78a294d2d04f28d81bd885d0d47f30e88d3c87230145bac77980
32+ faq_generated_at : ' 2026-07-10T21:49:51Z'
33+ faq_source_hash : 59eaec53e94f78a294d2d04f28d81bd885d0d47f30e88d3c87230145bac77980
34+ summary : >-
35+ You'll run a local concierge agent on an Arm machine and examine how the workload
36+ splits between CPU orchestration and GPU-backed model inference. You'll set up a
37+ Python environment, configure a Serper web search API key, and serve Gemma 3 locally
38+ with Ollama. As the agent answers your research-style questions, you'll use its per-query
39+ timeline to see how much of web search, scraping, ranking, deduplication, and extraction runs
40+ on the CPU.
41+ faqs :
42+ - question : How do I know Ollama is ready before running the agent?
43+ answer : >-
44+ Confirm Ollama is running and serving the `gemma3:4b` model. The local API at `http://localhost:11434`
45+ should be available before starting the script.
46+ - question : What do I need in the terminal environment when I start the script?
47+ answer : >-
48+ Activate your Python virtual environment and set `SERPER_API_KEY` in the same terminal session.
49+ The agent reads this variable at runtime for web search.
50+ - question : What result should I expect when the agent starts correctly?
51+ answer : >-
52+ You should see a greeting that explains the agent browses websites in real time and a prompt
53+ asking for your question. Type `quit` or `exit` to end the session.
54+ - question : How do I read the CPU and GPU timeline the agent prints?
55+ answer : >-
56+ CPU entries in the timeline correspond to tools (web search, scraping) and the orchestration pipeline (query expansion,
57+ ranking, deduplication, extraction). GPU entries correspond to the Gemma model running through
58+ Ollama. The agentic chain interleaves these steps.
59+ - question : Where can I see how the workflow is organized in the code?
60+ answer : >-
61+ Open `concierge_agent.py`. It groups the tools, the LLM "brain," the orchestration pipeline,
62+ and the agentic chain, and indicates which components run on the CPU or GPU.
63+ # END generated_summary_faq
64+
2065author : Jaidev Singh Chadha
2166
22- generate_summary_faq : true
67+ generate_summary_faq : false
2368rerun_summary : false
2469rerun_faqs : false
2570
@@ -67,3 +112,4 @@ weight: 1 # _index.md always has weight of 1 to order corr
67112layout : " learningpathall" # All files under learning paths have this same wrapper
68113learning_path_main_page : " yes" # This should be surfaced when looking for related content. Only set for _index.md of learning path content.
69114---
115+
0 commit comments