Skip to content

[draft][VoiceLive] Add support for built-in web search and file search tools#46723

Open
xitzhang wants to merge 13 commits intomainfrom
xitzhang/1.2.0change
Open

[draft][VoiceLive] Add support for built-in web search and file search tools#46723
xitzhang wants to merge 13 commits intomainfrom
xitzhang/1.2.0change

Conversation

@xitzhang
Copy link
Copy Markdown
Member

@xitzhang xitzhang commented May 5, 2026

Description

This PR promotes azure-ai-voicelive to 1.2.0 GA, consolidating all features from 1.2.0b1–b5
and adding new capabilities for API version 2026-04-10.

All SDK Contribution checklist:

  • The pull request does not introduce [breaking changes]
  • CHANGELOG is updated for new features, bug fixes or other significant changes.
  • I have read the contribution guidelines.

General Guidelines and Best Practices

  • Title of the pull request is clear and informative.
  • There are a small number of commits, each of which have an informative message. This means that previously merged commits do not appear in the history of the PR. For more information on cleaning up the commits in your PR, see this page.

Testing Guidelines

  • Pull request includes test coverage for the included changes.

Xiting Zhang added 2 commits May 5, 2026 11:09
…w features

- Web Search & File Search support (ResponseWebSearchCallItem, ResponseFileSearchCallItem)
- Avatar enhancements (voice sync, idle/speaking states, video delta, output buffer)
- Transcription improvements (TranscriptionPhrase, TranscriptionWord, new models)
- New SessionIncludeOption enum
- Personal voice model updates (DragonHDOmniLatestNeural, MAI-Voice-1)
- Fix ServerEvent.deserialize -> _deserialize for new model_base
- Update tests for new models, enums, and breaking changes
- Consolidate CHANGELOG for 1.2.0 GA release
Copilot AI review requested due to automatic review settings May 5, 2026 18:18
@xitzhang
Copy link
Copy Markdown
Member Author

xitzhang commented May 5, 2026

/azp run
python - azure-ai-voicelive - tests

@azure-pipelines
Copy link
Copy Markdown

Azure Pipelines successfully started running 1 pipeline(s).

Copy link
Copy Markdown
Contributor

Copilot AI left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

This PR updates azure-ai-voicelive for the 1.2.0 GA release aligned to API version 2026-04-10, adding new VoiceLive models/enums (web/file search, avatar enhancements, transcription, telemetry) and adjusting tests/samples accordingly.

Changes:

  • Expanded the public model surface (new action/search models, new item/event types, new transcription/voice options) and updated exports/tests to match.
  • Updated package metadata/documentation for the 1.2.0 release (CHANGELOG, API version metadata, ApiView mappings).
  • Refactored/normalized telemetry + async client code paths and formatting in tests/samples.

Reviewed changes

Copilot reviewed 23 out of 24 changed files in this pull request and generated 10 comments.

Show a summary per file
File Description
sdk/voicelive/azure-ai-voicelive/tests/test_unit_voice_config.py Updates unit tests to reflect new/removed personal voice model enums.
sdk/voicelive/azure-ai-voicelive/tests/test_unit_telemetry.py Adds pylint suppression and formatting tweaks in telemetry unit tests.
sdk/voicelive/azure-ai-voicelive/tests/test_unit_smoke_validation.py Extends import smoke test to include newly added enums/models.
sdk/voicelive/azure-ai-voicelive/tests/test_unit_models.py Adds unit tests covering newly introduced action/search/transcription models.
sdk/voicelive/azure-ai-voicelive/tests/test_unit_enums.py Adds assertions for newly added enum values and enums.
sdk/voicelive/azure-ai-voicelive/tests/test_live_realtime_service.py Formatting-only changes in live async tests (no functional change indicated).
sdk/voicelive/azure-ai-voicelive/samples/basic_voice_assistant_async.py Minor formatting/spacing tweaks in the sample.
sdk/voicelive/azure-ai-voicelive/pyproject.toml Updates packaging metadata (dynamic version source, package discovery excludes, pytest config removal).
sdk/voicelive/azure-ai-voicelive/MANIFEST.in Changes which py.typed marker is included in the sdist.
sdk/voicelive/azure-ai-voicelive/CHANGELOG.md Promotes release section to 1.2.0 (Unreleased) and documents new features/breaking changes.
sdk/voicelive/azure-ai-voicelive/azure/py.typed Adds a top-level azure/py.typed marker file.
sdk/voicelive/azure-ai-voicelive/azure/ai/voicelive/telemetry/_voicelive_instrumentor.py Formatting-only changes (line wrapping) in telemetry implementation.
sdk/voicelive/azure-ai-voicelive/azure/ai/voicelive/models/_enums.py Adds new enums/enum values (voice type, event/item types, include options) and updates voice model enum set.
sdk/voicelive/azure-ai-voicelive/azure/ai/voicelive/models/init.py Re-exports newly added models/enums in the public models namespace.
sdk/voicelive/azure-ai-voicelive/azure/ai/voicelive/aio/_patch.py Updates server event deserialization call path.
sdk/voicelive/azure-ai-voicelive/azure/ai/voicelive/_version.py Bumps library version to 1.2.0.
sdk/voicelive/azure-ai-voicelive/azure/_version.py Introduces a new top-level azure._version module (currently not aligned with 1.2.0).
sdk/voicelive/azure-ai-voicelive/azure/_utils/serialization.py Adds generated serialization helper under azure._utils (appears duplicative).
sdk/voicelive/azure-ai-voicelive/azure/_utils/model_base.py Adds generated model base helper under azure._utils (appears duplicative).
sdk/voicelive/azure-ai-voicelive/azure/_utils/init.py Adds package init for the new azure._utils namespace.
sdk/voicelive/azure-ai-voicelive/azure/_types.py Adds type aliases under top-level azure._types.
sdk/voicelive/azure-ai-voicelive/apiview-properties.json Updates ApiView cross-language mappings for newly added types and enum entries.
sdk/voicelive/azure-ai-voicelive/_metadata.json Updates default API version metadata to 2026-04-10.
Comments suppressed due to low confidence (1)

sdk/voicelive/azure-ai-voicelive/azure/_version.py:10

  • azure/_version.py defines VERSION = "1.0.0b1", which does not match the package’s actual version (azure.ai.voicelive._version.VERSION is 1.2.0) and the PR’s GA release intent. If azure._version is used for packaging metadata, update it to the correct version; otherwise, remove it and avoid introducing a shared azure._version module into the global azure namespace.

VERSION = "1.0.0b1"

Comment thread sdk/voicelive/azure-ai-voicelive/pyproject.toml Outdated
Comment thread sdk/voicelive/azure-ai-voicelive/pyproject.toml
Comment thread sdk/voicelive/azure-ai-voicelive/pyproject.toml
Comment thread sdk/voicelive/azure-ai-voicelive/pyproject.toml
Comment thread sdk/voicelive/azure-ai-voicelive/MANIFEST.in
Comment thread sdk/voicelive/azure-ai-voicelive/azure/_utils/serialization.py
Comment thread sdk/voicelive/azure-ai-voicelive/azure/_utils/model_base.py
Comment thread sdk/voicelive/azure-ai-voicelive/azure/_types.py
Comment thread sdk/voicelive/azure-ai-voicelive/apiview-properties.json
Comment thread sdk/voicelive/azure-ai-voicelive/CHANGELOG.md Outdated
xitzhang and others added 3 commits May 5, 2026 11:36
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
Co-authored-by: Copilot Autofix powered by AI <175728472+Copilot@users.noreply.github.com>
@Azure Azure deleted a comment from azure-pipelines Bot May 5, 2026
@xitzhang
Copy link
Copy Markdown
Member Author

xitzhang commented May 5, 2026

/azp run python - azure-ai-voicelive - tests

@azure-pipelines
Copy link
Copy Markdown

Azure Pipelines successfully started running 1 pipeline(s).

@xitzhang xitzhang changed the title [draft][VoiceLive] azure-ai-voicelive 1.2.0 GA release — API version 2026-04-10 [draft][VoiceLive] Added support for built-in web search and file search tools May 5, 2026
@xitzhang xitzhang changed the title [draft][VoiceLive] Added support for built-in web search and file search tools [draft][VoiceLive] Add support for built-in web search and file search tools May 5, 2026
@xitzhang
Copy link
Copy Markdown
Member Author

xitzhang commented May 6, 2026

/azp run python - azure-ai-voicelive - tests

@azure-pipelines
Copy link
Copy Markdown

Azure Pipelines successfully started running 1 pipeline(s).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants