The library now uses OpenAI Java SDK which should support Azure natively, but it was not working for me in the past.
Check if it works with latest version of SDK.
If it does, OpenAiModelService has to be changed, so it uses deploy names instead of model names (somehow define a map using Azure code).
The library now uses OpenAI Java SDK which should support Azure natively, but it was not working for me in the past.
Check if it works with latest version of SDK.
If it does,
OpenAiModelServicehas to be changed, so it uses deploy names instead of model names (somehow define a map using Azure code).