Skip to content

feat: Flowjo Improve performance - #1067

Merged
nathan-stender merged 3 commits into
mainfrom
jherna-flowjo-performance
Sep 2, 2025
Merged

feat: Flowjo Improve performance#1067
nathan-stender merged 3 commits into
mainfrom
jherna-flowjo-performance

Conversation

@joshua-benchling

Copy link
Copy Markdown
Collaborator

Improve processing time to convert to ASM.
Key improvements:

  • Built a per-sample keyword map once and reused it for all lookups, eliminating repeated Keywords XML scans.
  • Precomputed root-level, cytometer, and SampleList fields once outside the sample loop and merged them, avoiding per-sample attribute re-reads.
  • Replaced repeated keyword extraction functions with set-based filters over the keyword map (O(1) lookups, iterate smaller of keys vs map).
  • Used the keyword map for common fields (measurement time, analyst, well/plate IDs, written name) to avoid extra traversals.

@nathan-stender
nathan-stender merged commit 2987975 into main Sep 2, 2025
7 checks passed
@nathan-stender
nathan-stender deleted the jherna-flowjo-performance branch September 2, 2025 18:59
nathan-stender added a commit that referenced this pull request Sep 2, 2025
### Added

- Flowjo Improve performance (#1067)
- Luminex IntelliFlex - Added support for single table files (#1061)

### Changed

- Add schema validation function for external use (#1068)
joshua-benchling added a commit that referenced this pull request Sep 15, 2025
Improve processing time to convert to ASM.
Key improvements:
* Built a per-sample keyword map once and reused it for all lookups,
eliminating repeated Keywords XML scans.
* Precomputed root-level, cytometer, and SampleList fields once outside
the sample loop and merged them, avoiding per-sample attribute re-reads.
* Replaced repeated keyword extraction functions with set-based filters
over the keyword map (O(1) lookups, iterate smaller of keys vs map).
* Used the keyword map for common fields (measurement time, analyst,
well/plate IDs, written name) to avoid extra traversals.

---------

Co-authored-by: Nathan Stender <nathan.stender@benchling.com>
joshua-benchling pushed a commit that referenced this pull request Sep 15, 2025
### Added

- Flowjo Improve performance (#1067)
- Luminex IntelliFlex - Added support for single table files (#1061)

### Changed

- Add schema validation function for external use (#1068)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants