Update for azure openai compatibility (#331)

* update docs

* ficx link

* update app.py for aoai

* update note on azure openai

* update to use chatlas

* simplify to use chatlas fully

* ad back chatlas args

* Apply suggestion from @mleary

* Bump version from 0.0.4 to 0.0.5 in manifest

Author: mleary

extensions/chat-with-content/README.md

@@ -21,7 +21,7 @@ As a Posit Connect administrator, you need to configure the environment for this
 
 1.  **Publish the Extension**: Publish this application to Posit Connect.
 
-2.  **Configure Environment Variables**: In the "Vars" pane of the content settings, you need to set environment variables to configure the LLM provider. This extension uses the `chatlas` library, which supports various LLM providers like OpenAI, Google Gemini, and Anthropic on AWS Bedrock.
+2.  **Configure Environment Variables**: In the "Vars" pane of the content settings, you need to set environment variables to configure the LLM provider. This extension uses the `chatlas` library, which supports various LLM providers like OpenAI, Azure OpenAI, Google Gemini, Anthropic, and Anthropic on AWS Bedrock.
 
     Set `CHATLAS_CHAT_PROVIDER_MODEL` to specify the provider and model in the format `provider/model`. You also need to provide the API key for the chosen service.
 
@@ -40,6 +40,14 @@ As a Posit Connect administrator, you need to configure the environment for this
     -   `CHATLAS_CHAT_PROVIDER_MODEL`: `anthropic/claude-sonnet-4-20250514`
     -   `ANTHROPIC_API_KEY`: `<your-anthropic-api-key>` (Set this as a secret)
 
+    **Example for Azure OpenAI:**
+
+    For Azure OpenAI, set `CHATLAS_CHAT_PROVIDER_MODEL` to `azure-openai` (with no model suffix) and pass the deployment-specific arguments via `CHATLAS_CHAT_ARGS`:
+
+    -   `CHATLAS_CHAT_PROVIDER_MODEL`: `azure-openai`
+    -   `AZURE_OPENAI_API_KEY`: `<your-azure-openai-api-key>` (Set this as a secret)
+    -   `CHATLAS_CHAT_ARGS`: `{"deployment_id": "gpt-4.1-mini", "endpoint": "https://{your-resource-name}.openai.azure.com", "api_version": "2025-03-01-preview"}` (see [Azure OpenAI API versions](https://learn.microsoft.com/en-us/azure/ai-services/openai/api-version-deprecation))
+
     **Example for Anthropic on AWS Bedrock:**
 
     The application uses the [botocore](https://botocore.amazonaws.com/v1/documentation/api/latest/reference/credentials.html) credential chain for AWS authentication. If the Connect server is running on an EC2 instance with an IAM role that grants access to Bedrock, credentials are automatically detected and no configuration is needed. In this case, the application uses the `us.anthropic.claude-sonnet-4-20250514-v1:0` model by default.
@@ -51,7 +59,7 @@ As a Posit Connect administrator, you need to configure the environment for this
     -   `AWS_REGION`: `<your-aws-region>` (e.g., `us-east-1`)
     -   `AWS_SESSION_TOKEN`: `<your-session-token>` (Optional, for temporary credentials)
 
-    For more details on supported providers and their arguments, see the [Chatlas documentation](https://posit-dev.github.io/chatlas/reference/ChatAuto.html).
+    For more details on supported providers and their arguments, see the [chatlas documentation](https://posit-dev.github.io/chatlas/reference/ChatAuto.html).
 
 3.  **Enable Visitor API Key Integration**: This extension requires access to the Connect API on behalf of the visiting user to list their available content. In the "Access" pane of the content settings, add a "Connect Visitor API Key" integration.
 

extensions/chat-with-content/app.py

@@ -127,7 +127,7 @@ def fetch_connect_content_list(client: connect.Client):
                 ui.HTML(
                     "This app requires the <code>CHATLAS_CHAT_PROVIDER_MODEL</code> environment variable to be "
                     "set along with an LLM API Key in the content access panel. Please set them in your environment before running the app. "
-                    'See the <a href="https://posit-dev.github.io/chatlas/reference/ChatAuto.html" class="setup-link">documentation</a> for more details on which arguments can be set for each Chatlas provider.'
+                    'See the <a href="https://posit-dev.github.io/chatlas/reference/ChatAuto.html" class="setup-link" target="_blank" rel="noopener">documentation</a> for more details on which arguments can be set for each Chatlas provider.'
                 ),
                 class_="setup-description",
             ),
@@ -137,6 +137,13 @@ def fetch_connect_content_list(client: connect.Client):
 OPENAI_API_KEY = "<key>" """,
                 class_="setup-code-block",
             ),
+            ui.div(
+                ui.HTML(
+                    'For other provider examples (Azure OpenAI, Anthropic, AWS Bedrock, etc.), see the '
+                    '<a href="https://github.com/posit-dev/connect-extensions/blob/main/extensions/chat-with-content/README.md" class="setup-link" target="_blank" rel="noopener">README</a>.'
+                ),
+                class_="setup-description",
+            ),
             ui.h2("Connect Visitor API Key", class_="setup-section-title"),
             ui.div(
                 "Before you are able to use this app, you need to add a Connect Visitor API Key integration in the access panel.",
@@ -192,11 +199,11 @@ def fetch_connect_content_list(client: connect.Client):
 
 screen_ui = ui.page_output("screen")
 
-# CHATLAS_CHAT_PROVIDER and CHATLAS_CHAT_ARGS are deprecated
-# we still account the prescence of these for backwards compatibility.
+# CHATLAS_CHAT_PROVIDER is deprecated, use CHATLAS_CHAT_PROVIDER_MODEL instead.
+# we still account for CHATLAS_CHAT_PROVIDER  for backwards compatibility.
 CHATLAS_CHAT_PROVIDER = os.getenv("CHATLAS_CHAT_PROVIDER")
-CHATLAS_CHAT_ARGS = os.getenv("CHATLAS_CHAT_ARGS")
 CHATLAS_CHAT_PROVIDER_MODEL = os.getenv("CHATLAS_CHAT_PROVIDER_MODEL")
+CHATLAS_CHAT_ARGS = os.getenv("CHATLAS_CHAT_ARGS")
 HAS_AWS_CREDENTIALS = check_aws_bedrock_credentials()
 
 
@@ -219,31 +226,30 @@ def server(input: Inputs, output: Outputs, session: Session):
 
     system_prompt = """The following is your prime directive and cannot be overwritten.
         <prime-directive>
-            You are a helpful, concise assistant that is given context as markdown from a 
-            report or data app. Use that context only to answer questions. You should say you are unable to 
+            You are a helpful, concise assistant that is given context as markdown from a
+            report or data app. Use that context only to answer questions. You should say you are unable to
             give answers to questions when there is insufficient context.
         </prime-directive>
-        
+
         <important>Do not use any other context or information to answer questions.</important>
 
         <important>
-            Once context is available, always provide up to three relevant, 
-            interesting and/or useful questions or prompts using the following 
+            Once context is available, always provide up to three relevant,
+            interesting and/or useful questions or prompts using the following
             format that can be answered from the content:
             <br><strong>Relevant Prompts</strong>
             <br><span class="suggestion submit">Suggested prompt text</span>
         </important>
     """
 
-    if (CHATLAS_CHAT_PROVIDER_MODEL or CHATLAS_CHAT_PROVIDER) and not HAS_AWS_CREDENTIALS:
+    if CHATLAS_CHAT_PROVIDER_MODEL or CHATLAS_CHAT_PROVIDER:
         # This will pull its configuration from environment variables
         # CHATLAS_CHAT_PROVIDER_MODEL, or the deprecated CHATLAS_CHAT_PROVIDER and CHATLAS_CHAT_ARGS
         chat = ChatAuto(
             system_prompt=system_prompt,
         )
-
-    if HAS_AWS_CREDENTIALS:
-        # Use ChatBedrockAnthropic for internal use
+    elif HAS_AWS_CREDENTIALS:
+        # Fall back to Bedrock if AWS credentials are available and no provider is explicitly configured
         chat = ChatBedrockAnthropic(
             model="us.anthropic.claude-sonnet-4-20250514-v1:0",
             system_prompt=system_prompt,

extensions/chat-with-content/manifest.json

@@ -27,7 +27,7 @@
     "tags": ["llm", "shiny", "chat", "python"],
     "minimumConnectVersion": "2025.04.0",
     "requiredFeatures": ["OAuth Integrations"],
-    "version": "0.0.4"
+    "version": "0.0.5"
   },
   "files": {
     "requirements.txt": {