📢 Q4 2025 Roadmap Discussion

[lsy357]

Hi all!

We have exciting plans for 2025 Q4 and hope to hear your thoughts in this thread! This thread is open for feedback, suggestions, and contributions — your ideas can directly influence what we build next.

Throughout Q4, we’ll post progress updates so you can follow along and get involved at any stage.

---

🎯 Roadmap Themes

Theme 1: Project Deployment Optimization

• Platform-based Model Management: Build platform-based model management, replacing configuration-based management.

Theme 2: Coze Ecosystem Integration

• Coze Studio Agent Integration with Trace: Achieve the integration of Coze Studio Agent and Loop Trace.

💡 Call for Contributors:

We’re inviting passionate community developers to join us in building this integration!

If you have experience with Coze Studio coding and are interested in contributing, please comment below or open a issue/discussion - we’ll provide detailed API docs, integration guidelines, and mentorship to help you get started.

Theme 3: SDK Capabilities

• Provide Java Version SDK: Offer developers the Java version of the SDK to expand the language support scope.

💡 Call for Contributors:

We’re inviting passionate community developers to help us build the Java version of our SDK!

If you’re interested and have experience with Java and SDK design, please comment below or open a issue/discussion — we’ll provide detailed API docs, integration guidelines, and mentorship to help you get started.

Theme 4: Prompt Feature Iteration

• Supports Prompt Category Management: Allows unified management of multiple prompts within the same category.
• Supports GoTemplate Syntax: Adds support for GoTemplate syntax in prompt templates.
• Supports Draft Editing In Diff Mode: Enable editing Prompt drafts in the view that shows the difference from a specified version.
• Support Batch Debugging: Support batch debugging of Prompt drafts using partial data from the evaluation set to quickly verify the effects.
• Supports Model Features: Allows input of video multimodal data and supports disabling the deep thinking mode of the reasoning model.

Theme 5: Evaluation Feature Iteration

• Support Code Evaluator: Support writing python/js code on the platform as evaluators.
• Expand the Output Forms of Evaluators: Support evaluators in various forms such as classification evaluator.
• Supports Schema-Based Drill-Down of Evaluation Target Output: Allow users to evaluate a specific field in the output of the evaluation target instead of the entire structured output content.
• Supports Experiment Pause: Allows ongoing experiments to be stopped, and enables rerunning after resumption.
• Support OpenAPI: Provide OpenAPI to support operations such as importing evaluation sets and initiating experiments.

Theme 6: Observation Feature Iteration

• Open Source the Automated Task Module: Open source the Trace-based Automated Task module.
• Open Source the Trace Feedback Module: Open source the Trace Feedback module, which allows annotation and filtering of Traces.
• Open Source the Statistics Module: Open source the observation statistics module.
• Trace Supports Import into Evaluation Set/Prompt Playground: Trace can be directly imported as evaluation set data, or imported into the playground for debugging.
• Trace Supports Gantt Chart Display and Sharing: Trace can be displayed in Gantt chart format, and supports sharing for public visibility.

---

🤝 How to Get Involved

We welcome contributors of all experience levels! Steps to start contributing:

1. Comment below or open an issue/discussion to express interest.
2. We’ll connect with you to discuss details and provide onboarding guidance.

Your contributions will be credited in release notes and the official contributor list.

---

Let’s build Q4 together 🚀

[sp1cae]

Support MCP

[lsy357]

Support for MCP will be introduced in the commercial release first, with open-sourcing to be considered at a later stage.

[18368720238]

你好 开源版本的coze-loop 数据集不支持多模态的参数吗

[lsy357]

是的，当前的开源版本还不支持多模态；我们了解到有许多关于多模态的需求，Q4 不会支持，具体时间规划还在讨论中

[hello-lx-83]

支持第三方文档处理库、如MinerU，增强知识库功能

[wsx864321]

Achieve the integration of Coze Studio Agent and Loop Trace.Can you provide corresponding detailed requirements and guidance documents？

[lsy357]

Yes, we will provide the relevant documentation and guidelines. If you are interested in contributing code, we can create an issue to follow up on the discussion.

[fuxiaoai]

请问基于上报Trace进行自动化的评测这个咱们12月内会上线吗

[lsy357]

We will try our best to complete the open-sourcing of this module in Q4.

[joe200631]

请问基于上报Trace进行自动化的评测这个咱们12月内会上线吗

Is this feature available now? @lsy357