You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: src/content/blog/how-i-build-with-llms.md
+4-4Lines changed: 4 additions & 4 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -14,7 +14,7 @@ author: Zack Siri
14
14
featured: true
15
15
---
16
16
17
-
Building things with Large Language Models (LLMs) can feel complex, and I recently found myself navigating that complexity firsthand. I've been developing a new project, and through that experience, I've uncovered some really helpful patterns and techniques. In this post, I want to share those learnings with you, focusing on the key components and how they fit together. Details about the specific project are still coming soon, but the insights I’ll be sharing are broadly applicable to anyone looking to build LLM-powered applications. Let’s dive into what I’ve learned!
17
+
Building things with Large Language Models (LLMs) can feel complex, and I recently found myself navigating that complexity firsthand. I've been developing a new LLM powered project, and through that experience, I've uncovered some really helpful patterns and techniques. In this post, I want to share those learnings with you, focusing on the key components and how they fit together. Details about the specific project are still coming soon, but the insights I’ll be sharing are broadly applicable to anyone looking to build LLM-powered applications. Let’s dive into what I’ve learned!
18
18
19
19
## Open WebUI
20
20
@@ -76,7 +76,7 @@ Once you add the adapter to your Open WebUI instance you can apply it by adding
Once you added the connection, you will also need to add a model name.
79
+
Once you added the connection, you will also need to add a model name. If you're curious about what I'm using for the url it's simply a tailscale url. I can expose my dev server on `localhost:4000` over my tailnet by running `tailscale serve localhost:4000`
@@ -239,8 +239,8 @@ This should be able to parse streaming message from any LLM using OpenAI compati
239
239
240
240
## The Power of Elixir
241
241
242
-
The patterns and techniques used in this project felt remarkably intuitive, largely thanks to Elixir's inherent concurrency model. Elixir's ability to handle numerous concurrent connections allows developers to maintain open connections without concern for resource limitations – a significant advantage for LLM powered applications. Phoenix, leveraging websockets through LiveView, already demonstrates this capability.
242
+
The patterns and techniques used in this project felt remarkably intuitive, largely thanks to Elixir's inherent concurrency model. Elixir's ability to handle numerous concurrent connections allows developers to maintain open connections without concern for resource limitations – a significant advantage for LLM powered applications. Phoenix, leveraging websockets through LiveView, already demonstrates this natural capability.
243
243
244
-
Key to this ease of development were components like `Plug`, `Req`, and `Agent`. For instance, using an `Agent` to buffer streaming output, can be implemented with just a few lines of code. This, combined with Elixir's comprehensive tooling, makes building and maintaining LLM powered applications remarkably straightforward, allowing clear and logical reasoning about the application’s structure and behavior.
244
+
Key to this ease of development were components like `Phoenix.PubSub`, `Plug`, `Req`, and `Agent`. For instance, using an `Agent` to buffer streaming output, can be implemented with just a few lines of code. This, combined with Elixir's comprehensive tooling, makes building and maintaining LLM powered applications remarkably straightforward, allowing clear and logical reasoning about the application’s structure and behavior.
245
245
246
246
If you are curious to learn more or would like to ask me questions feel free to join [my discord](https://discord.gg/RgZZxcGF). I've also drawn a diagram that you can access to see how the [entire flow coming together](https://app.eraser.io/workspace/3nkX8mUbiLlfJKqsdoeA?origin=share).
0 commit comments