Skip to content

Latest commit

 

History

History
60 lines (44 loc) · 3 KB

File metadata and controls

60 lines (44 loc) · 3 KB

Foundry Local

Part 13: Workshop Complete

Congratulations! You have completed the full Foundry Local Workshop.

You have gone from installing the CLI to building chat applications, RAG pipelines, multi-agent systems, speech-to-text transcription, compiling your own custom models, enabling tool calling, and wiring up a live web UI for your multi-agent application. All of it running entirely on your device.


What You Built

Part What You Built
1 Installed Foundry Local, explored models via the CLI
2 Mastered the Foundry Local SDK API for service, catalogue, cache, and model management
3 Connected from Python, JavaScript, and C# using the SDK with OpenAI
4 Built a RAG pipeline with local knowledge retrieval
5 Created AI agents with personas and structured output
6 Orchestrated multi-agent pipelines with feedback loops
7 Explored a production capstone application, the Zava Creative Writer
8 Built evaluation-led development workflows for agents
9 Transcribed audio with Whisper, speech-to-text on-device
10 Compiled and ran a custom Hugging Face model with ONNX Runtime GenAI
11 Enabled local models to call external functions with tool calling
12 Built a browser-based UI for the Zava Creative Writer with real-time streaming

Further Ideas

  • Combine tool calling with agents to build autonomous workflows
  • Query a local database or call internal REST APIs from your tools
  • Try different models (phi-4-mini, deepseek-r1-7b) to compare quality and speed
  • Add authentication or rate limiting to your Zava Writer web server
  • Create your own multi-agent application for a domain you care about
  • Deploy to the cloud by swapping Foundry Local for Azure AI Foundry, same code, different endpoint

Resources

Resource Link
Foundry Local website foundrylocal.ai
Model catalogue foundrylocal.ai/models
Foundry Local GitHub github.com/microsoft/foundry-local
Getting started guide Microsoft Learn: Foundry Local
Foundry Local SDK Reference Microsoft Learn: SDK Reference
Microsoft Agent Framework Microsoft Learn: Agent Framework
OpenAI Whisper github.com/openai/whisper
ONNX Runtime GenAI github.com/microsoft/onnxruntime-genai

Go back to the workshop overview to review what you have covered and explore the further reading resources.


← Part 12: Building a Web UI for the Zava Creative Writer | Back to Workshop Home