Skip to content

[Storage] Simplify Encoder seek, fix SM streaming retry#46564

Merged
jalauzon-msft merged 4 commits into
Azure:feature/storage/content-validation-102from
jalauzon-msft:cv-streaming-retry
Apr 28, 2026
Merged

[Storage] Simplify Encoder seek, fix SM streaming retry#46564
jalauzon-msft merged 4 commits into
Azure:feature/storage/content-validation-102from
jalauzon-msft:cv-streaming-retry

Conversation

@jalauzon-msft

Copy link
Copy Markdown
Member

This change simplifies the StructuredMessageEncodeStream.seek method to only support seeking to position zero with SEEK_SET. This also simplified read a bit as we no longer need to track the checksum offset, checksums will just be re-computed. This was done because this stream is not exposed to users and seek is only used internally for retry where it will always use SEEK_SET to 0. The previous logic, while correct, while quite complex and difficult to maintain.

Additionally, this adds a test for and fixes an issue with crc64 streaming retry in async by making the close method a no-op. The close method is automatically called by aiohttp so retries would break.

@github-actions github-actions Bot added the Storage Storage Service (Queues, Blobs, Files) label Apr 27, 2026
@jalauzon-msft
jalauzon-msft merged commit 6ae8592 into Azure:feature/storage/content-validation-102 Apr 28, 2026
26 checks passed
@jalauzon-msft
jalauzon-msft deleted the cv-streaming-retry branch April 28, 2026 23:44
kashifkhan pushed a commit that referenced this pull request May 20, 2026
* [Storage] [STG 102] Create File with Data (#44901)

* [Storage][102] CRC64 content validation - part 1 (#45096)

* [Storage][102] CRC64 content validation - part 2 (#45567)

* [Storage][102] CRC64 content validation - part 3 (#45861)

* [Storage][102] CRC64 content validation - part 4 (#45949)

* [Storage] [STG 102] Added Support for IPv6 Accounts + Data Lake Tag Tests (#45766)

* Fixed test collection bug

* [Storage][102] CRC64 content validation - part 5 - datalake (#46034)

* [Storage][102] CRC64 content validation - part 6 - file-share (#46262)

* [Storage][102] CRC64 content validation - part 7 - record tests (#46461)

* [Storage] Simplify Encoder seek, fix SM streaming retry (#46564)

* [Storage] Cleanup and prepare content validation for merge to main (#46971)

* Fix changelogs after merge

* Tools black, Copilot feedback

---------

Co-authored-by: Peter Wu <162184229+weirongw23-msft@users.noreply.github.com>
Co-authored-by: Peter Wu <weirongwu@microsoft.com>
ninghu pushed a commit to ninghu/azure-sdk-for-python that referenced this pull request May 22, 2026
* [Storage] [STG 102] Create File with Data (Azure#44901)

* [Storage][102] CRC64 content validation - part 1 (Azure#45096)

* [Storage][102] CRC64 content validation - part 2 (Azure#45567)

* [Storage][102] CRC64 content validation - part 3 (Azure#45861)

* [Storage][102] CRC64 content validation - part 4 (Azure#45949)

* [Storage] [STG 102] Added Support for IPv6 Accounts + Data Lake Tag Tests (Azure#45766)

* Fixed test collection bug

* [Storage][102] CRC64 content validation - part 5 - datalake (Azure#46034)

* [Storage][102] CRC64 content validation - part 6 - file-share (Azure#46262)

* [Storage][102] CRC64 content validation - part 7 - record tests (Azure#46461)

* [Storage] Simplify Encoder seek, fix SM streaming retry (Azure#46564)

* [Storage] Cleanup and prepare content validation for merge to main (Azure#46971)

* Fix changelogs after merge

* Tools black, Copilot feedback

---------

Co-authored-by: Peter Wu <162184229+weirongw23-msft@users.noreply.github.com>
Co-authored-by: Peter Wu <weirongwu@microsoft.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Storage Storage Service (Queues, Blobs, Files)

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants