Hyperbolic problems

[tommasocarraro-sony]

Hi Frankie, just to be sure the issue is related to Hyperbolic.

Did you ever get this issue?

Hyperbolic SDK error (using provided key): Extra data: line 1 column 194 (char 193)

I went checking the source of the problem and I found this stacktrace in the logs:

2025-05-29 16:04:51,796 - ERROR - /app/api/entities_api/inference/hypherbolic/hyperbolic_deepseek_v3.py:346 - Run run_YkfzL4A3yIX63J48h6SO6K: Hyperbolic SDK error (using provided key): Extra data: line 1 column 194 (char 193)

Traceback (most recent call last):

File "/app/api/entities_api/inference/hypherbolic/hyperbolic_deepseek_v3.py", line 138, in stream

for token in response:

File "/usr/local/lib/python3.11/site-packages/openai/_streaming.py", line 46, in iter

for item in self._iterator:

File "/usr/local/lib/python3.11/site-packages/openai/_streaming.py", line 63, in stream

data = sse.json()

       ^^^^^^^^^^

File "/usr/local/lib/python3.11/site-packages/openai/_streaming.py", line 262, in json

return json.loads(self.data)

       ^^^^^^^^^^^^^^^^^^^^^

File "/usr/local/lib/python3.11/json/init.py", line 346, in loads

return _default_decoder.decode(s)

       ^^^^^^^^^^^^^^^^^^^^^^^^^^

File "/usr/local/lib/python3.11/json/decoder.py", line 340, in decode

raise JSONDecodeError("Extra data", s, end)

json.decoder.JSONDecodeError: Extra data: line 1 column 194 (char 193)

I went deeper and I discovered that self.data inside openai._streaming.py contains this when the error appears:

{"object":"error","message":"Stream processing error: Cannot connect to host 34.221.27.144:40071 ssl:default [Connect call failed ('34.221.27.144', 40071)]","type":"","param":null,"code":50001}data: [DONE]

[tommasocarraro-sony]

I append a new error here!

{"object":"error","message":"Invalid Request: Error code: 400 - {'error': {'message': 'Provider returned error', 'code': 400, 'metadata': {'raw': '{"message":"API error","type":"API_ERROR"}\n', 'provider_name': 'Novita'}}, 'user_id': 'user_2lhZcVwpVQyA9RSNdRiUhI8I8kK'}","type":"","param":null,"code":400}data: [DONE]