Skip to content

test(client-tree): unimplemented "minimize" post-processor#27633

Open
jason-ha wants to merge 20 commits into
mainfrom
tree/transaction-minimizer-tests
Open

test(client-tree): unimplemented "minimize" post-processor#27633
jason-ha wants to merge 20 commits into
mainfrom
tree/transaction-minimizer-tests

Conversation

@jason-ha

@jason-ha jason-ha commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

Creates a "minimize" placeholder for transaction post-process functionality.

Unit tests are added to cover the intended new functionality with unsupported tests disabled. (Since implementation is not expected to change observable result tests for observable result can be enabled with the simple do-nothing implementation that is the placeholder.)

  transaction minimize post-processor
    ✔ can be supplied as a transaction post-processor without error (76ms)
    ✔ throws when edits are made before and after a schema change
    ✔ preserves the observable result across an async transaction and new content appears in change
    ✔ temporary schema change throws restoring schema
    self-tests - no minimization applicable
      ✔ embeds surviving markers but not transient marker for a purely additive scenario
      ✔ result carries no build when pre-existing content is only rearranged
      ✔ result carries no build when pre-existing content is only removed
      ✔ reflects the order of only-rearranged inserted nodes and keeps every build
    preserves the observable result and new content appears in change
      ✔ keeps inserted nodes
      ✔ nets a create-then-remove to no change
      ✔ keeps only the persisted node when a transient node is also created
      ✔ reflects only the final value of a node replaced within the transaction
      ✔ reflects only the surviving node when inserted content is relocated then removed
      ✔ keeps the surrounding nodes when a node in the middle of an inserted run is removed
      ✔ keeps the surrounding nodes when an inserted node is moved then removed
      ✔ keeps only the trailing node when a moved node and its successor from leading node are removed
      ✔ keeps only the leading node when a moved node and its insertion companion are removed
      ✔ leaves pre-existing content unchanged when a transient node is inserted then removed
      ✔ keeps pre-existing content and the surviving inserted node
      ✔ reflects only the final value of a root object field set multiple times
      ✔ reflects only the final undefined root when only item's value of a field is set and then the item is removed
      ✔ reflects only the final value of a field of newly inserted root object when it is replaced
      ✔ reflects only the final value of a nested field set multiple times
      ✔ reflects an undefined root when a nested field is set and then the root object is removed
      ✔ reflects an empty root object when a nested field is set and then the nested field is removed
      ✔ reflects an empty root when a nested object with a value is added and then the root object is removed
      ✔ reflects only the final value of a field of a newly inserted nested object when nested field value is replaced
      ✔ reflects only the final value of a newly inserted nested object when nested object is replaced
      ✔ reflects only the final value of a newly inserted nested object whose value was set before it was replaced
      ✔ reflects edits made before a schema change
      ✔ reflects edits made after a schema change
    produces a consistent view and the same observable result as not minimized
      ✔ for A inserted
      ✔ for A then B inserted
      ✔ for A added then removed
      ✔ for A kept and B transient
      ✔ for A replaced by B
      ✔ for B inserted before A then A removed
      ✔ for A,B,C inserted then B removed
      ✔ for A then B,C inserted then rearranged
      ✔ for A,B,C inserted then B moved then removed
      ✔ for A,B,C inserted then B moved then B and A removed
      ✔ for A,B,C inserted then B moved then C and B removed
      ✔ for preexisting content and transient insert
      ✔ for preexisting content and surviving insert
      ✔ for preexisting content rearranged
      ✔ for preexisting content removed
      ✔ for root Box value set twice
      ✔ for nested Box value set twice
      ✔ for root Box value set then root Box removed
      ✔ for nested Box value set then root Box removed
      ✔ for nested Box value set then nested Box removed
      ✔ for nest Box with value then root Box removed
      ✔ for add root Box then replace value
      ✔ for add nested Box then replace value
      ✔ for add nested Box then replace nested Box
      ✔ for add nested Box set value then replace nested Box
      ✔ for edit before schema change
      ✔ for edit after schema change
    removes extraneous data from the squashed changes (expected to fail until minimize is implemented)
      - drops the build and destroy for a create-then-remove
      - keeps only the persisted node's build when a transient node is also created
      - keeps only the final node's build when a node is replaced
      - keeps only the surviving node's build when inserted content is relocated then removed
      - keeps the surrounding builds when a node in the middle of an inserted run is removed
      - drops the build for an inserted node that is moved then removed
      - keeps only the trailing node's [modified] build when a moved node and its successor from leading node build are removed
      - keeps only the leading node's build when a moved node and its insertion companion are removed
      - carries no build for a transient insert over pre-existing content
      - keeps only the surviving inserted node's build over pre-existing content
      - keeps only the final value's build when a field is set multiple times
      - carries no build when root's value of a field is set and then the root is removed
      - keeps only the final value's builds when a field of newly inserted object is replaced
      - keeps only the final value's build when a nested field is set multiple times
      - carries no build when a nested field is set and then the root object is removed
      - keeps one build when a nested field is set and then the nested object is removed
      - carries no build when a nested object with a value is added and then the root object is removed
      - keeps only the final value's builds when a field of a newly inserted nested object is replaced
      - keeps only the final value's builds when a newly inserted nested object is replaced
      - keeps only the final value's builds when a newly inserted nested object's value is set before the nested object is replaced
      - keeps only edits' surviving builds made before a schema change
      - keeps only edits' surviving builds made after a schema change

Additionally bumps tree test lib to ES2022 so that String.replaceAll is available.

Creates a "minimize" placeholder for transaction post-process functionality.

Unit tests are added to cover the intended new functionality with unsupported tests disabled. (Since implementation is not expected to change observable result tests for observable result can be enabled with the simple do-nothing implementation that is the placeholder.)

```text
  transaction minimize post-processor
    ✔ can be supplied as a transaction post-processor without error
    ✔ preserves the observable result across an async transaction
    self-tests - no minimization applicable
      ✔ embeds surviving markers but not transient marker for a purely additive scenario
      ✔ result carries no build when pre-existing content is only rearranged
      ✔ result carries no build when pre-existing content is only removed
      ✔ reflects the order of only-rearranged inserted nodes and keeps every build
    preserves the observable result
      ✔ keeps inserted nodes
      ✔ nets a create-then-remove to no change
      ✔ keeps only the persisted node when a transient node is also created
      ✔ reflects only the final value of a node replaced within the transaction
      ✔ reflects only the surviving node when inserted content is relocated then removed
      ✔ keeps the surrounding nodes when a node in the middle of an inserted run is removed
      ✔ keeps the surrounding nodes when an inserted node is moved then removed
      ✔ keeps only the trailing node when a moved node and its successor from leading node are removed
      ✔ keeps only the leading node when a moved node and its insertion companion are removed
      ✔ leaves pre-existing content unchanged when a transient node is inserted then removed
      ✔ keeps pre-existing content and the surviving inserted node
      ✔ reflects only the final value of a field set multiple times
      ✔ reflects only the final empty array when only item's value of a field is set and then the item is removed
    removes extraneous data from the squashed change (expected to fail until minimize is implemented)
      - drops the build and destroy for a create-then-remove
      - keeps only the persisted node's build when a transient node is also created
      - keeps only the final node's build when a node is replaced
      - keeps only the surviving node's build when inserted content is relocated then removed
      - keeps the surrounding builds when a node in the middle of an inserted run is removed
      - drops the build for an inserted node that is moved then removed
      - keeps only the trailing node's [modified] build when a moved node and its successor from leading node build are removed
      - keeps only the leading node's build when a moved node and its insertion companion are removed
      - carries no build for a transient insert over pre-existing content
      - keeps only the surviving inserted node's build over pre-existing content
      - keeps only the final value's build when a field is set multiple times
      - carries no build when only item's value of a field is set and then the item is removed
```
@jason-ha jason-ha requested a review from a team as a code owner July 1, 2026 21:46
Copilot AI review requested due to automatic review settings July 1, 2026 21:46
@github-actions

github-actions Bot commented Jul 1, 2026

Copy link
Copy Markdown
Contributor

Hi! Thank you for opening this PR. Want me to review it?

Based on the diff (1696 lines, 12 files), I've queued these reviewers:

  • Correctness — logic errors, race conditions, lifecycle issues
  • Security — vulnerabilities, secret exposure, injection
  • API Compatibility — breaking changes, release tags, type design
  • Performance — algorithmic regressions, memory leaks
  • Testing — coverage gaps, hollow tests

How this works

  • Adjust the reviewer set by ticking/unticking boxes above. Reviewer toggles alone don't trigger anything.

  • Tick Start review below to dispatch the review fleet.

  • After review finishes, tick Start review again to request another run — it auto-resets after each dispatch.

  • This comment updates as new commits land; your reviewer selections are preserved.

  • Start review

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Copilot reviewed 10 out of 10 changed files in this pull request and generated no comments.

Comment thread packages/dds/tree/src/feature-libraries/modular-schema/minimizeModularChange.ts Outdated
Comment thread packages/dds/tree/src/shared-tree/transactionMinimize.ts Outdated
Comment thread packages/dds/tree/src/shared-tree/transactionMinimize.ts
for (const inner of change.changes) {
if (inner.type === "data") {
total += inner.innerChange.builds?.size ?? 0;
}

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Note that each build may be building 1+ nodes. I'm not sure if the current tests care about that, but we probably should have some tests that do, so we'll want to sum the top-level length of the chunk on each build entry.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The fact that the tests actually look at the JSON for the changeset make this less of an issue. I'm fine leaving it as is. In fact, do we even care about the number of builds and destroys?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Unfortunately inspecting JSON with hopes of not finding content (our goal) is unreliable. Negative tests are unreliable.
That is mitigated with some positive tests even if those are fussy.
Using the "sum the top-level length of the chunk on each build entry" seems like it should make things less fussy. Will attempt.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I've added top-level length checking as well.
No too interesting at the moment, but could be with more complicated cases.

Comment thread packages/dds/tree/src/test/shared-tree/transactionMinimize.spec.ts
Comment thread packages/dds/tree/src/test/shared-tree/transactionMinimize.spec.ts
Comment thread packages/dds/tree/src/test/shared-tree/transactionMinimize.spec.ts
Comment thread packages/dds/tree/src/test/shared-tree/transactionMinimize.spec.ts
}

// #region Scenario definitions
// Each scenario declares the initial document content and the edits applied to the strongly-typed root node

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

We need a systematic way to think about what scenarios are needed. Was the current set of scenarios based on such a thing?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The collection should cover all fundamental cases where some content is added while under transaction but ultimately is not going to be exhaustive.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think the revised Object scenarios have good coverage now. Each scenario has a classification now.
A glaring omission from object tests are movements.
But I think these are good to get started with.

@yann-achard-MS yann-achard-MS Jul 2, 2026

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Another set of test we want to run is checking that the end state of all peers is consistent when one peer minimizes a transaction. You can test that by having a test for each scenario where the test is applied on one peer and the peers are then synchronized. You can use validateViewConsistency to validate that both peers get the same state.

I expect these tests will start failing once you implement minimization. That's because we're going to need to roll back the changes applied to the local branch and apply the minimized change. I forgot about that when I reviewed #27610.

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You'll have to tell me more. Follow-up PR?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

#27673 has fixes for prior problem.
I have also added some view consistency checks into these cases.

@jason-ha jason-ha requested a review from yann-achard-MS July 7, 2026 10:21
Comment thread packages/dds/tree/src/shared-tree/transactionMinimize.ts Outdated
@github-actions

Copy link
Copy Markdown
Contributor

🔗 No broken links found! ✅

Your attention to detail is admirable.

linkcheck output

1: starting server using command "npm run serve -- --no-open"
and when url "[ 'http://127.0.0.1:3000' ]" is responding with HTTP status code 200
running tests using command "npm run check-links"


> fluid-framework-website@0.0.0 serve
> docusaurus serve --no-open

[SUCCESS] Serving "build" directory at: http://localhost:3000/

> fluid-framework-website@0.0.0 check-links
> linkcheck http://localhost:3000 --skip-file skipped-urls.txt

Crawling...

Stats:
  294296 links
    1937 destination URLs
    2187 URLs ignored
       0 warnings
       0 errors


@github-actions

Copy link
Copy Markdown
Contributor

Bundle size comparison

Base commit: 006b9fcdfe1a7083da88f7b2faf010ec33cad26c
Head commit: 95e9c6e1f7f0f1f9730633b298c640103248880a

Notable changes

  • 🔴 fluidFramework.js: parsed 392708 → 394163 (+1455), gzip 111481 → 111941 (+460)
  • 🔴 sharedTree.js: parsed 382095 → 383543 (+1448), gzip 108869 → 109321 (+452)
Per-bundle deltas

@fluid-example/bundle-size-tests

  • azureClient.js: parsed 619098 → 619154 (+56), gzip 164826 → 164871 (+45)
  • odspClient.js: parsed 591824 → 591880 (+56), gzip 158912 → 158981 (+69)
  • aqueduct.js: parsed 525587 → 525622 (+35), gzip 140710 → 140733 (+23)
  • 🔴 fluidFramework.js: parsed 392708 → 394163 (+1455), gzip 111481 → 111941 (+460)
  • 🔴 sharedTree.js: parsed 382095 → 383543 (+1448), gzip 108869 → 109321 (+452)
  • containerRuntime.js: parsed 303937 → 303951 (+14), gzip 83213 → 83206 (-7)
  • sharedString.js: parsed 175984 → 175991 (+7), gzip 49445 → 49453 (+8)
  • experimentalSharedTree.js: parsed 160798 → 160798 (0), gzip 45804 → 45804 (0)
  • matrix.js: parsed 159845 → 159852 (+7), gzip 45411 → 45418 (+7)
  • loader.js: parsed 145256 → 145270 (+14), gzip 39063 → 39077 (+14)
  • odspDriver.js: parsed 104329 → 104350 (+21), gzip 32646 → 32635 (-11)
  • directory.js: parsed 66616 → 66623 (+7), gzip 18532 → 18541 (+9)
  • 748.js: parsed 58793 → 58793 (0), gzip 17827 → 17827 (0)
  • map.js: parsed 46709 → 46716 (+7), gzip 14310 → 14318 (+8)
  • odspPrefetchSnapshot.js: parsed 45642 → 45656 (+14), gzip 15277 → 15285 (+8)
  • 985.js: parsed 44491 → 44491 (0), gzip 13726 → 13726 (0)
  • summarizerDelayLoadedModule.js: parsed 30749 → 30749 (0), gzip 7753 → 7753 (0)
  • socketModule.js: parsed 26476 → 26483 (+7), gzip 7885 → 7895 (+10)
  • createNewModule.js: parsed 12480 → 12480 (0), gzip 4786 → 4786 (0)
  • summaryModule.js: parsed 3797 → 3797 (0), gzip 1860 → 1860 (0)
  • connectionState.js: parsed 724 → 724 (0), gzip 429 → 429 (0)
  • sharedTreeAttributes.js: parsed 666 → 673 (+7), gzip 432 → 442 (+10)
  • debugAssert.js: parsed 429 → 429 (0), gzip 299 → 299 (0)
  • FluidFramework-HashFallback.js: parsed 422 → 422 (0), gzip 316 → 316 (0)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants