Add UnitedRangedMemoryLinks range allocator and raw link sequences#513
Add UnitedRangedMemoryLinks range allocator and raw link sequences#513konard wants to merge 8 commits into
Conversation
Adding .gitkeep for PR creation (default mode). This file will be removed when the task is complete. Issue: #512
Compiles the requirements analysis, background notes on UnitedMemoryLinks, the chosen allocator design (sorted free-range list with RawMarker tag), related work bibliography and the step-by-step solution plan for the new UnitedRangedMemoryLinks variant. Refs #512
Introduces a new `Platform.Data.Doublets.Memory.UnitedRanged` namespace implementing the design from `docs/case-studies/issue-512`: * `UnitedRangedLinksConstants<T>` adds `RawMarker` and `FreeRangeMarker` sentinels reused from the existing housekeeping slots in `LinksConstants<T>`. * `RangedFreeListMethods<T>` maintains an address-sorted, doubly-linked list of multi-cell free ranges (head stored in `LinksHeader.Reserved8`). Best-fit search, eager coalescing, and tail trimming keep external fragmentation bounded. * `RawBinaryMethods<T>` encodes raw binary blobs that share the link address space: a head cell stamps `Source = RawMarker, Target = byte length`; subsequent cells carry opaque payload. * `UnitedRangedMemoryLinks<T>` is a drop-in substitute for `UnitedMemoryLinks<T>` that overrides `Create`, `Delete`, `Each`, `Count` to honour ranges and blobs, and exposes the public `AllocateRange`/`DeallocateRange`/`AllocateRawBinary`/`WriteRawBinary`/ `ReadRawBinary`/`DeallocateRawBinary` API. Adds `UnitedRangedMemoryLinksTests` covering the drop-in substitution, multi-cell allocation, best-fit reuse, coalescing, tail trimming, raw binary round-trip (single and multi-cell), `Each`/`Count` skipping of non-doublet cells, and a chaos test that exercises the no-fragmentation guarantee. Closes #512
konard
changed the title
* design.md: replace the earlier two-list + high-bit discriminator design with the actually-shipped single-list-plus-two-sentinels design, document the carved-out tail-trim & 1-cell-remainder paths, and update the on-disk compatibility section. * solution-plan.md: drop the dropped `LinksRangedHeader.cs` and `UnitedRangedMemoryLinksBase.cs` steps, list the public API the helper classes actually expose.
Working session summaryPR #513 is ready for review: #513 SummaryShipped the full
All 32 tests pass in Release-mode net8 (mirroring the CI command). PR is no longer draft, mergeable, This summary was automatically extracted from the AI working session output. |
🤖 Solution Draft LogThis log file contains the complete execution trace of the AI solution draft process. 💰 Cost: $12.623662📊 Context and tokens usage:Claude Opus 4.7: (4 sub-sessions)
Total: (6.5K new + 408.5K cache writes + 11.7M cache reads) input tokens, 166.9K output tokens, $12.623662 cost 🤖 Models used:
📎 Log file uploaded as Gist (4512KB)Now working session is ended, feel free to review and add any feedback on the solution draft. |
🔄 Auto-restart triggered (iteration 1)Reason: CI failures detected Starting new session to address the issues. Auto-restart-until-mergeable mode is active. This run will stop after 5 restart iterations. |
- Make per-cell constants in `RawBinaryMethods<TLinkAddress>` private to avoid `S2743` (public static field in generic type). - Drop redundant `: base()` from default `UnitedRangedLinksConstants` constructor (`S3253`). - Use bare `links.Create()` calls in the create/delete test where the return values are unused (`S1481`). - Tag fenced code blocks with `text` and wrap the bare issue link in angle brackets in the case-study docs (markdownlint `MD034`/`MD040`). - Add `.codacy.yaml` so the case-study prose under `docs/case-studies/` is excluded from Codacy analysis, and `.markdownlint.json` mirroring the same intent for local markdownlint runs.
Each static readonly initializer now references TLinkAddress directly (via RawLink<TLinkAddress>.SizeInBytes or Unsafe.SizeOf<TLinkAddress>()) so SonarCSharp S2743 stops firing. Behaviour and field values are unchanged.
Working session summaryAll CI/CD checks now pass on PR #513:
Final fix ( PR: #513 This summary was automatically extracted from the AI working session output. |
🔄 Auto-restart-until-mergeable Log (iteration 1)This log file contains the complete execution trace of the AI solution draft process. 💰 Cost: $3.683368📊 Context and tokens usage:Claude Opus 4.7: (2 sub-sessions)
Total: (2.1K new + 144.0K cache writes + 3.4M cache reads) input tokens, 42.6K output tokens, $3.665933 cost Claude Haiku 4.5:
Total: 15.5K input tokens, 394 output tokens, $0.017435 cost 🤖 Models used:
📎 Log file uploaded as Gist (6164KB)Now working session is ended, feel free to review and add any feedback on the solution draft. |
✅ Ready to mergeThis pull request is now ready to be merged:
Monitored by hive-mind with --auto-restart-until-mergeable flag |
This reverts commit eac6bcb.
|
I think our UnitedRangedMemoryLinks should have configuration to include or not to include raw links sequences (rename terms where possible, including fields and variables, but we can keep explanations that raw links sequences can be used for raw data blobs or binary files and so on). And by default each should include raw links sequences. We also need to double check that each function allows to return IList or similar, so we can actually support. All non essential logic like Or may be I a bit mistaken, but anyway, we may include IsRange, based on Each. And don't use RawBinary terms in code function names or variables. We should use range of links or sequence of links. Also re-read #512 and double check that all possible edge cases are fully covered with tests. So I expect, that we should do as much as possible via our universal ILinks interface, and everything else should that can simplify actual use cases will actually go to extensions not implementation. We need to ensure all changes are correct, consistent, validated, tested, documented, logged and fully meet each and all discussed requirements in deepest and widest possible sense (check issue description and all comments in issue and in pull request, make sure each and every requirement listed before actually checking if they were addressed). Nothing should be defered or delayed. The scope is the entire repository, every change in one place should also be applied in all places in the codebase and docs. Ensure all CI/CD checks pass. Please plan and execute everything in this single pull request, you have unlimited time and context, as context auto-compacts and you can continue indefinitely, until it is each and every requirement fully addressed, and everything is totally done. |
|
🤖 AI Work Session Started Starting automated work session at 2026-05-25T16:01:14.438Z The PR has been converted to draft mode while work is in progress. This comment marks the beginning of an AI work session. Please wait for the session to finish, and provide your feedback. |
konard
changed the title
Working session summaryDone. Updated and pushed PR 513: #513 Commit pushed: What changed:
Verification:
This summary was automatically extracted from the AI working session output. |
🤖 Solution Draft LogThis log file contains the complete execution trace of the AI solution draft process. 💰 Cost estimation:
📊 Context and tokens usage:
Total: (587.8K + 13.7M cached) input tokens, 64.8K output tokens, $22.513984 cost 🤖 Models used:
📎 Log file uploaded as Repository (81163KB)Now working session is ended, feel free to review and add any feedback on the solution draft. |
✅ Ready to mergeThis pull request is now ready to be merged:
Monitored by hive-mind with --auto-restart-until-mergeable flag |
1 participant
Summary
Implements
UnitedRangedMemoryLinks<T>for #512 with a range-aware allocator and raw link sequences stored in the same link address space.RawLinkSequenceMarker,RawLinkSequenceMethods, and extension methods such asAllocateRawLinkSequence,WriteRawLinkSequence,ReadRawLinkSequence, andDeallocateRawLinkSequence.IncludeRawLinkSequencesconfiguration. Raw link sequence heads are included byEach/Countby default and can be excluded; continuation cells and free ranges are always hidden.ILinks<T>extension to detect raw link sequence heads returned through the universalEachsurface.Tests
dotnet test csharp/Platform.Data.Doublets.Tests/Platform.Data.Doublets.Tests.csproj --configuration Releasedotnet test csharp/Platform.Data.Doublets.sln --configuration ReleaseLatest local solution run: 38 passed, 1 skipped. The only warning was the existing Source Link warning for missing
rust/.git.Fixes #512