Skip to content
Merged

Dev #700

Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
@@ -1,6 +1,6 @@
# Conversation knowledge mining solution accelerator

Gain actionable insights from large volumes of conversational data by identifying key themes, patterns, and relationships. Using Azure AI Foundry, Azure AI Content Understanding, Azure OpenAI Service, and Azure AI Search, this solution analyzes unstructured dialogue and maps it to meaningful, structured insights.
Gain actionable insights from large volumes of conversational data by identifying key themes, patterns, and relationships. Using Microsoft Foundry, Azure Content Understanding, Azure OpenAI Service, and Foundry IQ, this solution analyzes unstructured dialogue and maps it to meaningful, structured insights.

Capabilities such as topic modeling, key phrase extraction, speech-to-text transcription, and interactive chat enable users to explore data naturally and make faster, more informed decisions.

Expand All @@ -22,7 +22,7 @@ Analysts working with large volumes of conversational data can use this solution
Solution overview
</h2>

Leverages Azure AI Content Understanding, Azure AI Search, Azure OpenAI Service, Semantic Kernel, Azure SQL Database, and Cosmos DB to process large volumes of conversational data. Audio and text inputs are analyzed through event-driven pipelines to extract and vectorize key information, orchestrate intelligent responses, and power an interactive web front-end for exploring insights using natural language.
Leverages Azure Content Understanding, Foundry IQ, Azure OpenAI Service, Semantic Kernel, Azure SQL Database, and Cosmos DB to process large volumes of conversational data. Audio and text inputs are analyzed through event-driven pipelines to extract and vectorize key information, orchestrate intelligent responses, and power an interactive web front-end for exploring insights using natural language.

### Solution architecture
|![image](./documents/Images/ReadMe/solution-architecture.png)|
Expand All @@ -39,7 +39,7 @@ Leverages Azure AI Content Understanding, Azure AI Search, Azure OpenAI Service,
<summary>Click to learn more about the key features this solution enables</summary>

- **Mined entities and relationships** <br/>
Azure AI Content Understanding and Azure OpenAI Service extract entities and relationships from unstructured data to create a knowledge base.
Azure Content Understanding and Azure OpenAI Service extract entities and relationships from unstructured data to create a knowledge base.

- **Processed data at scale** <br/>
Microsoft Fabric processes conversation data at scale, generating vector embeddings for efficient retrieval using the RAG (Retrieval-Augmented Generation) pattern.
Expand Down Expand Up @@ -98,8 +98,8 @@ _Note: This is not meant to outline all costs as selected SKUs, scaled use, cust

| Product | Description | Tier / Expected Usage Notes | Cost |
|---|---|---|---|
| [Azure AI Foundry](https://learn.microsoft.com/en-us/azure/ai-foundry) | Used to orchestrate and build AI workflows that combine Azure AI services. | Free Tier | [Pricing](https://azure.microsoft.com/pricing/details/ai-studio/) |
| [Azure AI Search](https://learn.microsoft.com/en-us/azure/search/search-what-is-azure-search) | Powers vector-based semantic search for retrieving indexed conversation data. | Standard S1; costs scale with document count and replica/partition settings. | [Pricing](https://azure.microsoft.com/pricing/details/search/) |
| [Microsoft Foundry](https://learn.microsoft.com/en-us/azure/ai-foundry) | Used to orchestrate and build AI workflows that combine Azure AI services. | Free Tier | [Pricing](https://azure.microsoft.com/pricing/details/ai-studio/) |
| [Foundry IQ](https://learn.microsoft.com/en-us/azure/search/search-what-is-azure-search) | Powers vector-based semantic search for retrieving indexed conversation data. | Standard S1; costs scale with document count and replica/partition settings. | [Pricing](https://azure.microsoft.com/pricing/details/search/) |
| [Azure Storage Account](https://learn.microsoft.com/en-us/azure/storage/common/storage-account-overview) | Stores transcripts, intermediate outputs, and application assets. | Standard LRS; usage-based cost by storage/operations. | [Pricing](https://azure.microsoft.com/pricing/details/storage/blobs/) |
| [Azure Key Vault](https://learn.microsoft.com/en-us/azure/key-vault/general/overview) | Secures secrets, credentials, and keys used across the application. | Standard Tier; cost per operation (e.g., secret retrieval). | [Pricing](https://azure.microsoft.com/pricing/details/key-vault/) |
| [Azure AI Services (OpenAI)](https://learn.microsoft.com/en-us/azure/cognitive-services/openai/overview) | Enables language understanding, summarization, entity extraction, and chat capabilities using GPT models. | S0 Tier; pricing depends on token volume and model used (e.g., GPT-4o-mini). | [Pricing](https://azure.microsoft.com/pricing/details/cognitive-services/) |
Expand Down
10 changes: 5 additions & 5 deletions documents/DeploymentGuide.md
Original file line number Diff line number Diff line change
Expand Up @@ -176,8 +176,8 @@ When you start the deployment, most parameters will have **default values**, but
| ------------------------------------------- | --------------------------------------------------------------------------------------------------------- | ---------------------- |
| **Azure Region** | The region where resources will be created. | *(empty)* |
| **Environment Name** | A **3–20 character alphanumeric value** used to generate a unique ID to prefix the resources. | env\_name |
| **Azure AI Content Understanding Location** | Region for content understanding resources. | swedencentral |
| **Use Case** | Industry use case: **Contact-center** or **IT_helpdesk**. | (empty) |
| **Azure Content Understanding Location** | Region for content understanding resources. | swedencentral |
| **Use Case** | Industry use case: **telecom** or **IT_helpdesk**. | (empty) |
| **Secondary Location** | A **less busy** region for **Azure SQL and Azure Cosmos DB**, useful in case of availability constraints. | eastus2 |
| **Deployment Type** | Select from a drop-down list (allowed: `Standard`, `GlobalStandard`). | GlobalStandard |
| **GPT Model** | Choose from **gpt-4, gpt-4o, gpt-4o-mini**. | gpt-4o-mini |
Expand All @@ -189,7 +189,7 @@ When you start the deployment, most parameters will have **default values**, but
| **Image Tag** | Docker image tag to deploy. Common values: `latest_waf`, `dev`, `hotfix`. | latest_waf |
| **Use Local Build** | Boolean flag to determine if local container builds should be used. | false |
| **Existing Log Analytics Workspace** | To reuse an existing Log Analytics Workspace ID. | *(empty)* |
| **Existing Azure AI Foundry Project** | To reuse an existing Azure AI Foundry Project ID instead of creating a new one. | *(empty)* |
| **Existing Microsoft Foundry Project** | To reuse an existing Microsoft Foundry Project ID instead of creating a new one. | *(empty)* |



Expand All @@ -216,7 +216,7 @@ Depending on your subscription quota and capacity, you can [adjust quota setting
</details>
<details>

<summary><b>Reusing an Existing Azure AI Foundry Project</b></summary>
<summary><b>Reusing an Existing Microsoft Foundry Project</b></summary>

Guide to get your [Existing Project ID](/documents/re-use-foundry-project.md)

Expand Down Expand Up @@ -247,7 +247,7 @@ Once you've opened the project in [Codespaces](#github-codespaces), [Dev Contain
3. Provide an `azd` environment name (e.g., "ckmapp").
4. Select a subscription from your Azure account and choose a location that has quota for all the resources.
5. Choose the use case:
- **Contact-center**
- **telecom**
- **IT_helpdesk**

- This deployment generally takes **7-10 minutes** to provision the resources in your account and set up the solution.
Expand Down
4 changes: 2 additions & 2 deletions documents/TechnicalArchitecture.md
Original file line number Diff line number Diff line change
Expand Up @@ -13,13 +13,13 @@ Stores uploaded call transcripts and audio files. Serves as the initial staging
### Azure AI Content Understanding
Processes the audio and text files to extract conversation details, including speaker turns, timestamps, and semantic structure.

### Azure AI Search
### Foundry IQ
Indexes the vectorized transcripts for semantic search. Enables rapid retrieval of relevant conversation snippets and contextual fragments using vector search and keyword matching.

### SQL Database
Stores structured output including extracted entities, mapped concepts, and additional metadata.

### Azure AI Services
### Microsoft Foundry
Performs topic modeling on enriched transcript data, uncovering themes and conversation patterns using pre-trained models.

### Azure OpenAI Service
Expand Down
8 changes: 4 additions & 4 deletions documents/re-use-foundry-project.md
Original file line number Diff line number Diff line change
@@ -1,13 +1,13 @@
[← Back to *DEPLOYMENT* guide](/documents/DeploymentGuide.md#deployment-options--steps)

# Reusing an Existing Azure AI Foundry Project
To configure your environment to use an existing Azure AI Foundry Project, follow these steps:
# Reusing an Existing Microsoft Foundry Project
To configure your environment to use an existing Microsoft Foundry Project, follow these steps:
---
### 1. Go to Azure Portal
Go to https://portal.azure.com

### 2. Search for Azure AI Foundry
In the search bar at the top, type "Azure AI Foundry" and click on it. Then select the Foundry service instance where your project exists.
### 2. Search for Microsoft Foundry
In the search bar at the top, type "Microsoft Foundry" and click on it. Then select the Foundry service instance where your project exists.

![alt text](../documents/Images/re_use_foundry_project/azure_ai_foundry_list.png)

Expand Down
3 changes: 0 additions & 3 deletions infra/scripts/process_sample_data.sh
Original file line number Diff line number Diff line change
Expand Up @@ -348,9 +348,6 @@ get_values_from_azd_env() {
return 0
}

if [ "$usecase" == "Contact_center" ]; then
usecase="telecom"
fi

# Check if user is logged in to Azure
echo "Checking Azure authentication..."
Expand Down
Loading