fix(output): move pass-1 SJ tab into <prefix>_STARpass1/SJ.out.tab#44
Open
pinin4fjords wants to merge 2 commits into
Open
fix(output): move pass-1 SJ tab into <prefix>_STARpass1/SJ.out.tab#44pinin4fjords wants to merge 2 commits into
<prefix>_STARpass1/SJ.out.tab#44pinin4fjords wants to merge 2 commits into
Conversation
STAR writes three log files alongside Log.final.out and keeps two-pass intermediates in <prefix>_STARpass1/. rustar was only writing Log.final.out and emitting the pass-1 SJ tab as <prefix>SJ.pass1.out.tab at the top level. Add minimal Log.out (parameters dump + per-phase timestamps) and Log.progress.out (timestamp + mapping speed) writers next to the existing Log.final.out writer. Move the pass-1 SJ tab into <prefix>_STARpass1/SJ.out.tab and mkdir the parent first. The Log.out content is intentionally a stub matching the file's existence rather than STAR's full verbosity; that's a follow-up. Fixes scverse#28 Co-Authored-By: Claude <noreply@anthropic.com>
The previous commit added writers that mimicked STAR's section-header structure with placeholder content (a Debug-format params dump + three timestamps for Log.out, a header + final-timestamp line for Log.progress.out). That closes the file-existence gap but makes the output look like STAR-equivalent verbose logging when it isn't — downstream tools parsing for memory usage, per-chunk progress, or warnings would silently get nothing. Drop the stub writers. The SJ.pass1.out.tab → <prefix>_STARpass1/SJ.out.tab placement fix stays — that's a real path-parity change with no fakery. Real STAR-equivalent Log.out / Log.progress.out content (per-phase progress, warnings, memory, periodic updates during long runs) is a separate engineering effort, not a stub. Co-Authored-By: Claude <noreply@anthropic.com>
Log.out, Log.progress.out, and <prefix>_STARpass1/SJ.out.tab<prefix>_STARpass1/SJ.out.tab
2 tasks
Author
|
Verified end-to-end on macOS/aarch64 against the rebuilt fix branch (commit PE yeast +
LGTM on the scoped-down PR. |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
STAR keeps two-pass intermediates inside
<prefix>_STARpass1/with the pass-1 splice tab namedSJ.out.tabinside that directory. rustar was emitting it as<prefix>SJ.pass1.out.tabat the top level. This PR moves the file to the STAR-equivalent location.The file content is unchanged — only the path moves. The
<prefix>_STARpass1/directory iscreate_dir_all'd before the write.Scope (changed during review)
Initial scope of this PR also added minimal-stub writers for
Log.outandLog.progress.out. Those have been reverted in the latest commit: writing files that mimic STAR's section-header structure with placeholder content (a Debug-format params dump, three timestamps) closes the file-existence gap but misleads downstream tools that try to parse memory usage, per-chunk progress, or warnings out ofLog.out. Real parity for those two files is a separate engineering effort — periodic per-chunk updates during long runs, warnings, the full STAR parameter format. Tracked as a follow-up; not stubbed here.So this PR now only addresses the
SJ.pass1.out.tabplacement (the second bullet of #28). TheLog.out/Log.progress.outbullet stays open on that issue.Test plan
<prefix>_STARpass1/SJ.out.tabexists after a--twopassMode Basicrun<prefix>SJ.pass1.out.tabdoes NOT existcargo buildcargo clippy --lib -- -D warningscargo fmt --checkcargo test --lib(383 pass) +cargo test --test alignment_features test_two_pass_mode(pass)Refs #28 (placement half only; Log.out / Log.progress.out parity is a follow-up)