Skip to content

Add Future AGI products to Observability / Evaluation / Context Mgmt / Platform Stacks#64

Open
SuhaniNagpal7 wants to merge 1 commit into
Meirtz:mainfrom
SuhaniNagpal7:add-future-agi-products
Open

Add Future AGI products to Observability / Evaluation / Context Mgmt / Platform Stacks#64
SuhaniNagpal7 wants to merge 1 commit into
Meirtz:mainfrom
SuhaniNagpal7:add-future-agi-products

Conversation

@SuhaniNagpal7
Copy link
Copy Markdown

This PR adds four Future AGI open-source projects to their most relevant sections in the list.

Added:

  • Agent Observability and TelemetrytraceAI. OpenTelemetry-native tracing that auto-instruments 50+ AI frameworks across Python, TypeScript, Java, and C#. Captures prompts, tool calls, retrieval steps, and tokens with no vendor lock-in.
  • RAG and Generation Evaluationai-evaluation. 50+ metrics, LLM-as-judge, and guardrail scanners (jailbreak, PII, prompt-injection); includes dedicated RAG metrics (context recall, context precision, answer relevancy, faithfulness).
  • Context Optimization Enginesagent-opt. Six prompt-optimization algorithms (Random, Bayesian, ProTeGi, Meta-Prompt, PromptWizard, GEPA) for evaluation-driven tuning against any LiteLLM-supported model.
  • Platform Stacks and Hosted Agent RuntimesFuture AGI. Open-source self-hostable end-to-end agent engineering and optimization platform unifying tracing, evaluation, simulation, datasets, gateway, and guardrails.

All entries placed in the production / observability subsections matching the existing tooling pattern (Entroly, LangSmith, OpenTelemetry semconv, Puppyone). No paper-style entries.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant