You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
This is useful for final cleanup, schema transforms, and format-specific export preparation.
104
104
105
+
## Resume
106
+
107
+
Workflow names are durable artifact identities. Reusing the same name with `resume=ResumeMode.IF_POSSIBLE` reuses compatible completed stages, resumes a matching partial stage through `DataDesigner.create(..., resume=ResumeMode.ALWAYS)`, and reruns the first changed or missing stage plus its descendants.
Use `ResumeMode.ALWAYS` for strict resume before the first recovered checkpoint. A changed stage or missing selected output raises instead of starting fresh. If a matching partial stage resumes successfully, descendants are recreated from that stage's current output.
116
+
117
+
## Review gates
118
+
119
+
Use `targets` to materialize an intermediate stage without running the rest of the workflow. `export_stage()` writes the selected stage output for review. After review, pass the approved parquet as a stage output override and resume the downstream target.
If the reviewed data replaces a stage's selected output in place, run with `resume=ResumeMode.IF_POSSIBLE` and `rerun_from="expanded"` to rebuild that stage and its descendants from the current boundary output.
133
+
105
134
## Current limits
106
135
107
136
- Stages are linear. DAGs, parallel branches, and joins are planned separately.
108
-
- Stage-level resume is not implemented yet.
109
137
-`push_to_hub()` does not support selected processor or callback outputs yet. Use `export()` for the selected workflow output.
110
138
-`on_success` callbacks are trusted user code. If a callback returns a path, Data Designer reads that path as the next stage input.
111
139
- The artifact layout is intended for inspection, but it is not yet a stable public contract.
0 commit comments