You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
<strong>FlowLLM: Simplifying LLM-based HTTP/MCP Service Development</strong><br>
7
+
<em><sub>If you find it useful, please give us a ⭐ Star. Your support drives our continuous improvement.</sub></em>
8
8
</p>
9
9
10
10
<palign="center">
@@ -15,59 +15,58 @@
15
15
</p>
16
16
17
17
<palign="center">
18
-
<ahref="./README_EN.md">English</a> | 简体中文
18
+
English | <ahref="./README_ZH.md">简体中文</a>
19
19
</p>
20
20
21
21
---
22
22
23
-
## 📖 简介
23
+
## 📖 Introduction
24
24
25
-
FlowLLM 将 LLM/Embedding/vector_store 能力封装为 HTTP/MCP 服务,适用于 AI 对话助手、RAG 应用、工作流服务等场景,并可集成到支持
26
-
MCP 的客户端工具中。
25
+
FlowLLM encapsulates LLM, Embedding, and vector_store capabilities as HTTP/MCP services. It is suitable for AI assistants, RAG applications, and workflow services, and can be integrated into MCP-compatible client tools.
| 2025-11-15 |Added[File Tool Op](docs/zh/guide/file_tool_op_guide.md)feature with 13 file operation tools, supporting file reading, writing, editing, searching, directory operations, system command execution, and task management|
44
+
| 2025-11-14 |Added Token counting capability, supporting accurate calculation of token counts for messages and tools via `self.token_count()`method, with support for multiple backends (base, openai, hf). See configuration examples in[default.yaml](flowllm/config/default.yaml)|
46
45
47
-
### 📚 学习资料分享
46
+
### 📚 Learning Resources
48
47
49
-
项目开发者会在这里分享最近的学习资料。
48
+
Project developers will share their latest learning materials here.
-**Simple Op Development**: Inherit from `BaseOp` or `BaseAsyncOp` and implement your business logic. FlowLLM provides lazy-initialized LLM, Embedding models, and vector stores accessible via `self.llm`, `self.embedding_model`, and `self.vector_store`. It also offers prompt template management through `prompt_format()`and`get_prompt()`methods. Additionally, FlowLLM includes built-in token counting capabilities. Use `self.token_count()`to accurately calculate token counts for messages and tools, supporting multiple backends (base, openai, hf, etc.).
-**Flexible Flow Orchestration**: Compose Ops into Flows via YAML configuration. `>>`denotes serial composition; `|`denotes parallel composition. For example, `SearchOp() >> (AnalyzeOp() | TranslateOp()) >> FormatOp()`builds complex workflows. Define input/output schemas and start the service with `flowllm config=your_config`.
-**Automatic Service Generation**: FlowLLM automatically generates HTTP, MCP, and CMD services. The HTTP service provides RESTful APIs with synchronous JSON and HTTP Stream responses. The MCP service registers as Model Context Protocol tools for MCP-compatible clients. The CMD service executes a single Op in command-line mode for quick testing and debugging.
详细内容请参考 [简单 Op 指南](docs/zh/guide/async_op_minimal_guide.md)、[LLM Op 指南](docs/zh/guide/async_op_llm_guide.md) 和 [高级 Op 指南](docs/zh/guide/async_op_advance_guide.md)(包含 Embedding、VectorStore 和并发执行等高级功能)。
128
+
For details, refer to the [Simple Op Guide](docs/zh/guide/async_op_minimal_guide.md), [LLM Op Guide](docs/zh/guide/async_op_llm_guide.md), and [Advanced Op Guide](docs/zh/guide/async_op_advance_guide.md) (including Embedding, VectorStore, and concurrent execution).
After the service starts, refer to the [Client Guide](docs/zh/guide/client_guide.md) to use the service and obtain the tool_call required by the model.
0 commit comments