How to change socket proxy address?

[dudziakl]

Is there a way to overwrite the hardcoded OpenAI socket address with my custom proxy address?

I'm referring tothe constructor of OpenAISettingsInfo

BaseWebSocketUrlFormat = $"{WSS}{OpenAIDomain}{BaseRequest}{{0}}";

[StephenHodgson]

No, I intentionally send all websocket traffic directly, there wasn't an easy way to proxy it.

[dudziakl]

@StephenHodgson, what kind of issue did you face? I would like to know more because my customer has wss://api.openai.com blocked by company policy, and I thought I could route it through my own server. I made a proxy for HTTPS, and it works fine, but I cannot try WebSockets because BaseWebSocketUrlFormat is hardcoded.

[StephenHodgson]

It is hardcoded bc the OpenAI-DotNet package doesn't handle the websockets it'll throw as not implemented.

If you think you have time/effort to update that package to use websocket proxy, be my guest. It ended up being too much time and effort so I just use the rest proxy to get ephemeral api key then use that to make the websocket connection directly.

[dudziakl]

I see. Many thanks!

[dudziakl]

@StephenHodgson, would you consider replacing {OpenAIDomain} with {domain} or making BaseWebSocketUrlFormat customizable to allow setting the WebSocket endpoint domain? I have a custom proxy (I'm not using OpenAI-DotNet proxy) that is able to pass both https/wss and it would be very helpful to have it supported.

My case is very simple. One of our customers has a strict security rule that blocks all api.openai.com traffic, but as you mentioned in the documentation, it can be solved with a proxy. I made a test by replacing

BaseWebSocketUrlFormat = $"{WSS}{OpenAIDomain}{BaseRequest}{{0}}";
//with
BaseWebSocketUrlFormat = $"{WSS}{domain}{BaseRequest}{{0}}";

and it works fine! I know it won't work with the OpenAI-DotNet proxy, but at least allowing us to change this domain gives us more options than hardcoding it.

[StephenHodgson]

Let me do some research and get back to you.

Can you do me a favor and make a new ticket as an enhancement?

I think it's possible I just also need to figure out how to make sure it works correctly for anyone using my proxy service