Contact Details
No response
📦 Package Version
0.4.14
🎞️ Framework Version
1.72.0
🔎 Describe the Bug
Neither normal instrumentation with LiteLLM or using the success_callback arg are working properly for LiteLLM for litellm.response (they work for litellm.completions).
Success callback not working (see docs https://docs.litellm.ai/docs/observability/agentops_integration):
In [1]: import agentops
i
In [2]: import litellm
In [3]: litellm.success_callback = ["agentops"]
In [4]: agentops.init(auto_start_session=False)
...:
In [5]:
...:
...: # Non-streaming response
...: response = litellm.responses(
...: model="openai/gpt-4o",
...: input="Tell me a three sentence bedtime story about a unicorn.",
...: max_output_tokens=100
...: )
...:
...: print(response)
-> No trace detected in AgentOps dashboard
As well as normal instrumentation:
In [3]: agentops.init()
🖇 AgentOps: Session Replay for default trace: https://app.agentops.ai/sessions?trace_id=24108c993e0f3b8b4d20b3e0b7e96c06
Out[3]: <agentops.legacy.Session at 0x1233f8cb0>
In [4]: import litellm
In [5]:
...: # Non-streaming response
...: response = litellm.responses(
...: model="openai/gpt-4o",
...: input="Tell me a three sentence bedtime story about a unicorn.",
...: max_output_tokens=100
...: )
...:
...: print(response)
TODO:
- Fix instrumentation
- Update AgentOps docs if required
- Raise a PR and update LiteLLM's AgentOps docs if required
🤝 Contribution
Contact Details
No response
📦 Package Version
0.4.14
🎞️ Framework Version
1.72.0
🔎 Describe the Bug
Neither normal instrumentation with LiteLLM or using the success_callback arg are working properly for LiteLLM for
litellm.response(they work forlitellm.completions).Success callback not working (see docs https://docs.litellm.ai/docs/observability/agentops_integration):
-> No trace detected in AgentOps dashboard
As well as normal instrumentation:
TODO:
🤝 Contribution