Merge branch 'release-please--branches--main--changes--next' of github.com:openlayer-ai/openlayer-python into release-please--branches--main--changes--next

Author: viniciusdsmello

CHANGELOG.md

@@ -5,34 +5,42 @@ All notable changes to this project will be documented in this file.
 The format is based on [Keep a Changelog](http://keepachangelog.com/en/1.0.0/)
 and this project adheres to [Semantic Versioning](http://semver.org/spec/v2.0.0.html).
 
-## 0.12.0 (2025-12-17)
+## 0.12.0 (2025-12-26)
 
 Full Changelog: [v0.11.4...v0.12.0](https://github.com/openlayer-ai/openlayer-python/compare/v0.11.4...v0.12.0)
 
 ### Features
 
-* **api:** api update ([f53fab3](https://github.com/openlayer-ai/openlayer-python/commit/f53fab30c1d6404e144e2c862a66f9e08086480a))
-* **api:** api update ([7a554fd](https://github.com/openlayer-ai/openlayer-python/commit/7a554fd1301aba3f8c58039780414b86f835d06a))
+* **api:** api update ([f117723](https://github.com/openlayer-ai/openlayer-python/commit/f11772338f2da872ca49f0a658c45109b9507800))
+* **api:** api update ([9f22b46](https://github.com/openlayer-ai/openlayer-python/commit/9f22b4660e4b37a786a6ff3999847936577c8a23))
+* enhance LiteLLM metadata extraction by adding cost retrieval from response headers ([43a7d2e](https://github.com/openlayer-ai/openlayer-python/commit/43a7d2e44b788586a3e4e3e484e9a7967f3631af))
+* prevent multiple patching in trace_litellm function to avoid duplicate traces ([#568](https://github.com/openlayer-ai/openlayer-python/issues/568)) ([a1619e7](https://github.com/openlayer-ai/openlayer-python/commit/a1619e793878720b5719ca7e2a580e9990b88f96))
 
 
 ### Bug Fixes
 
-* **client:** close streams without requiring full consumption ([178a48f](https://github.com/openlayer-ai/openlayer-python/commit/178a48fc44b1bc35d11ffb72f81e5b6a2c761c89))
-* compat with Python 3.14 ([9a18d6e](https://github.com/openlayer-ai/openlayer-python/commit/9a18d6ee1df7d00210243b81643d05a509d94a96))
+* **client:** close streams without requiring full consumption ([c1458b7](https://github.com/openlayer-ai/openlayer-python/commit/c1458b7487946db5d4a2037852ee0acd31cc5672))
+* compat with Python 3.14 ([c2d9681](https://github.com/openlayer-ai/openlayer-python/commit/c2d9681e556118e9f6f91de46f1662b7a794ee2c))
 
 
 ### Chores
 
-* bump `httpx-aiohttp` version to 0.1.9 ([a8d04ae](https://github.com/openlayer-ai/openlayer-python/commit/a8d04ae6242bdaad9651ffbaa537b217f4eeaba8))
-* do not install brew dependencies in ./scripts/bootstrap by default ([053b9e4](https://github.com/openlayer-ai/openlayer-python/commit/053b9e409d5bb48aafb1641d292d4105eccd0e76))
-* **internal/tests:** avoid race condition with implicit client cleanup ([41ae1b6](https://github.com/openlayer-ai/openlayer-python/commit/41ae1b64f85a1ff8878e43bb872904b93acfd23d))
-* **internal:** detect missing future annotations with ruff ([b778406](https://github.com/openlayer-ai/openlayer-python/commit/b778406f38812d00cd770717fdf518725c935582))
-* **internal:** grammar fix (it's -> its) ([65edc47](https://github.com/openlayer-ai/openlayer-python/commit/65edc47c162f3e545c463f24ce5bb75769a69aae))
-* **internal:** update pydantic dependency ([9e14c8a](https://github.com/openlayer-ai/openlayer-python/commit/9e14c8a69c179bc43c417856455db3854065ccdf))
-* **internal:** version bump ([c10fa5d](https://github.com/openlayer-ai/openlayer-python/commit/c10fa5d7d549b2c23865e1c22ff08760ceab6324))
-* **internal:** version bump ([ff91ea8](https://github.com/openlayer-ai/openlayer-python/commit/ff91ea81a82a9ffb96946ecfe78c7177783dbaa7))
-* **package:** drop Python 3.8 support ([d3d0f8f](https://github.com/openlayer-ai/openlayer-python/commit/d3d0f8fd5d001bac3c6db1cb87a02030049c7fec))
-* **types:** change optional parameter type from NotGiven to Omit ([acd07c4](https://github.com/openlayer-ai/openlayer-python/commit/acd07c48b6414194749c13fbe79162bd438c31e2))
+* bump `httpx-aiohttp` version to 0.1.9 ([3f895de](https://github.com/openlayer-ai/openlayer-python/commit/3f895ded9e56ca11c4aafc093502726a14afedf6))
+* do not install brew dependencies in ./scripts/bootstrap by default ([45badc5](https://github.com/openlayer-ai/openlayer-python/commit/45badc57d4e30a195407e5b733a7327356685c69))
+* **internal/tests:** avoid race condition with implicit client cleanup ([3d05ccc](https://github.com/openlayer-ai/openlayer-python/commit/3d05ccc4ee73fe8f5c3de50d4a7dcbdcb3551674))
+* **internal:** detect missing future annotations with ruff ([d2887ba](https://github.com/openlayer-ai/openlayer-python/commit/d2887ba77f441518ca7e8ae1b690cee42794596a))
+* **internal:** grammar fix (it's -> its) ([4af20e1](https://github.com/openlayer-ai/openlayer-python/commit/4af20e1d560be01fb7eaa9dd050398fe23f1e4bb))
+* **internal:** update pydantic dependency ([0af11ac](https://github.com/openlayer-ai/openlayer-python/commit/0af11ac1a28176380247bf3e3b5db00fe6349593))
+* **internal:** version bump ([55f6ab0](https://github.com/openlayer-ai/openlayer-python/commit/55f6ab040221d31a154ef21c71a1957b77043f79))
+* **internal:** version bump ([3a5c286](https://github.com/openlayer-ai/openlayer-python/commit/3a5c2869c16c0f00e871042af29da29063a70c07))
+* **internal:** version bump ([d5dc8c0](https://github.com/openlayer-ai/openlayer-python/commit/d5dc8c0fd5b792e4a81f6445df0091f1cf9f8e36))
+* **internal:** version bump ([61324d6](https://github.com/openlayer-ai/openlayer-python/commit/61324d655921bbe613cd2542feba4a758d591293))
+* **internal:** version bump ([9db5997](https://github.com/openlayer-ai/openlayer-python/commit/9db5997e6d7648e00c37277ea87b2d5f7e79aa4f))
+* **internal:** version bump ([4659537](https://github.com/openlayer-ai/openlayer-python/commit/465953753d902fd2345cac72e0ed87131668b0f4))
+* **internal:** version bump ([199356c](https://github.com/openlayer-ai/openlayer-python/commit/199356ca1ce8eae57a6557c17d8c173486132fc2))
+* **internal:** version bump ([e63dee5](https://github.com/openlayer-ai/openlayer-python/commit/e63dee5ac27bfc396ec709188a54c3045e1e3698))
+* **package:** drop Python 3.8 support ([4c48617](https://github.com/openlayer-ai/openlayer-python/commit/4c48617ef7c34e0db601617a3b30d3bb540eeea5))
+* **types:** change optional parameter type from NotGiven to Omit ([54c1533](https://github.com/openlayer-ai/openlayer-python/commit/54c1533b6810fcf9323c23f39dc008405fd0a36e))
 
 ## 0.11.4 (2025-12-17)
 

examples/tracing/openai/openai_agents_tracing.ipynb

@@ -177,6 +177,9 @@
    "metadata": {},
    "outputs": [],
    "source": [
+    "from __future__ import annotations\n",
+    "\n",
+    "\n",
     "class AirlineAgentContext(BaseModel):\n",
     "    \"\"\"Context model to maintain conversation state across agents.\"\"\"\n",
     "    passenger_name: str | None = None\n",

examples/tracing/openai/openai_tracing.ipynb

@@ -121,6 +121,8 @@
    "metadata": {},
    "outputs": [],
    "source": [
+    "from __future__ import annotations\n",
+    "\n",
     "from pydantic import BaseModel\n",
     "\n",
     "\n",

src/openlayer/lib/integrations/litellm_tracer.py

@@ -19,6 +19,9 @@
 
 logger = logging.getLogger(__name__)
 
+# Flag to prevent multiple patching
+_litellm_traced = False
+
 
 def trace_litellm() -> None:
     """Patch the litellm.completion function to trace completions.
@@ -57,11 +60,18 @@ def trace_litellm() -> None:
     ...     inference_id="custom-id-123"  # Optional Openlayer parameter
     ... )
     """
+    global _litellm_traced
+    
     if not HAVE_LITELLM:
         raise ImportError(
             "LiteLLM library is not installed. Please install it with: pip install litellm"
         )
 
+    # Prevent multiple patching - this avoids duplicate traces
+    if _litellm_traced:
+        logger.debug("trace_litellm() already called - skipping to prevent duplicate traces")
+        return
+    
     original_completion = litellm.completion
 
     @wraps(original_completion)
@@ -84,6 +94,8 @@ def traced_completion(*args, **kwargs):
         )
 
     litellm.completion = traced_completion
+    _litellm_traced = True
+    logger.debug("litellm.completion has been patched for Openlayer tracing")
 
 
 def handle_streaming_completion(
@@ -661,6 +673,7 @@ def extract_usage_from_chunk(chunk: Any) -> Dict[str, Optional[int]]:
 def extract_litellm_metadata(response: Any, model_name: str) -> Dict[str, Any]:
     """Extract LiteLLM-specific metadata from response."""
     metadata = {}
+    response_headers = {}
 
     try:
         # Extract hidden parameters
@@ -689,6 +702,7 @@ def extract_litellm_metadata(response: Any, model_name: str) -> Dict[str, Any]:
             if 'additional_headers' in hidden_params:
                 headers = hidden_params['additional_headers']
                 if headers:
+                    response_headers = headers
                     metadata['response_headers'] = headers
 
         # Extract system fingerprint if available
@@ -697,9 +711,48 @@ def extract_litellm_metadata(response: Any, model_name: str) -> Dict[str, Any]:
 
         # Extract response headers if available
         if hasattr(response, '_response_headers'):
-            metadata['response_headers'] = dict(response._response_headers)
+            response_headers = dict(response._response_headers)
+            metadata['response_headers'] = response_headers
+        
+        # Fallback: Extract cost from x-litellm-response-cost header if cost is missing or zero
+        if not metadata.get('cost') and response_headers:
+            cost_from_header = _extract_cost_from_headers(response_headers)
+            if cost_from_header is not None:
+                metadata['cost'] = cost_from_header
 
     except Exception as e:
         logger.debug("Error extracting LiteLLM metadata: %s", e)
 
     return metadata
+
+
+def _extract_cost_from_headers(headers: Dict[str, Any]) -> Optional[float]:
+    """Extract cost from LiteLLM response headers."""
+    try:
+        # Try to get cost from x-litellm-response-cost header
+        cost_str = headers.get('x-litellm-response-cost')
+        if cost_str is not None:
+            # Handle string values (headers are often strings)
+            if isinstance(cost_str, str):
+                cost = float(cost_str)
+            else:
+                cost = float(cost_str)
+            
+            if cost > 0:
+                return cost
+        
+        # Fallback to x-litellm-response-cost-original if primary is zero/missing
+        cost_original_str = headers.get('x-litellm-response-cost-original')
+        if cost_original_str is not None:
+            if isinstance(cost_original_str, str):
+                cost = float(cost_original_str)
+            else:
+                cost = float(cost_original_str)
+            
+            if cost > 0:
+                return cost
+                
+    except (ValueError, TypeError) as e:
+        logger.debug("Error parsing cost from headers: %s", e)
+    
+    return None