Skip to content

Commit 1f55765

Browse files
committed
fix(oci): stop sending logprobs — not supported on OCI on-demand
logprobs is not a valid parameter for OCI Generative AI on-demand inference. Sending it causes a 400 error. Removed from request transformation.
1 parent 8f40152 commit 1f55765

1 file changed

Lines changed: 1 addition & 2 deletions

File tree

src/cohere/oci_client.py

Lines changed: 1 addition & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -780,8 +780,7 @@ def transform_request_to_oci(
780780
chat_request["responseFormat"] = cohere_body["response_format"]
781781
if "safety_mode" in cohere_body:
782782
chat_request["safetyMode"] = cohere_body["safety_mode"].upper()
783-
if "logprobs" in cohere_body:
784-
chat_request["logprobs"] = cohere_body["logprobs"]
783+
# Note: logprobs is not supported on OCI on-demand inference
785784
if "tool_choice" in cohere_body:
786785
chat_request["toolChoice"] = cohere_body["tool_choice"]
787786
if "priority" in cohere_body:

0 commit comments

Comments
 (0)