Commit b8f9229
hknokh2
feat: release v5-beta with major engine redesign and migration behavior updates
New major version:
- Released major version after runtime model, CSV behavior, and file pipeline redesign.
- Breaking change: standalone Node.js/module execution removed; use `sf sfdmu run`.
- Breaking change: `--verbose`, `--concise`, and `--usesf` runtime effect removed.
These flags are now legacy compatibility no-op flags.
- Breaking CSV behavior: relationship `__r` columns are now generated consistently.
`excludeIdsFromCSVFiles` removes raw `Id` and lookup `...Id` columns.
- Breaking file migration update: transfer was centralized in `core:ExportFiles`.
This now covers `org -> org`, `org -> csvfile`, and `csvfile -> org`.
- Breaking runtime defaults: `--filelog` default changed to `0`.
`--diagnostic` is now the recommended mode for full troubleshooting output.
- Validation hardening: default `apiVersion` moved to `65.0`.
Script/object/operation validation is stricter and fails faster on invalid configs.
- Major refactor: engine rebuilt into API/CSV/mapping/logging modular layers.
Added dedicated Bulk v1, Bulk v2, and REST execution engines.
- Major add-on platform update: custom add-on interfaces moved to `custom-addon-sdk`.
Added template scaffolding and updated runtime adapters.
New features:
- Added Data Loader-oriented CSV and file workflow in the new engine.
Includes unified handling for `ContentVersion`, `ContentDocumentLink`,
`Attachment`, and `Note`.
- Added expanded `core:ExportFiles` behavior for all migration directions.
Improved binary-path handling for org and csvfile flows.
- Added explicit CSV controls: `csvFileDelimiter`, `csvFileEncoding`,
`csvInsertNulls`, `csvUseEuropeanDateFormat`,
`csvWriteUpperCaseHeaders`, `csvUseUtf8Bom`.
- Added `--anonymise` flag for `.log` files with deterministic per-run hashes.
Helps share diagnostics without exposing secrets, domains, emails, paths.
Deprecations/Removed features:
- Deprecated `csvReadFileDelimiter` and `csvWriteFileDelimiter`.
Use `csvFileDelimiter` for current configurations.
- Removed standalone Node.js/module execution mode.
Migration runs through `sf sfdmu run`.
- Deprecated runtime effect of `--verbose`, `--concise`, and `--usesf`.
These flags are now legacy no-op compatibility flags.
Fixes:
- Fixed CSV id/reference edge cases by tightening `Id`, lookup-id, and `__r`.
Reduced broken parent and lookup resolution during migration.
- Fixed file pipeline consistency by centralizing processing in `core:ExportFiles`.
Reduced format drift between org and csvfile paths.
Improvements:
- Improved validation behavior with `apiVersion=65.0` and stricter checks.
Invalid configs fail earlier and more predictably.
- Changed diagnostic defaults: `--filelog` now defaults to `0`.
`--diagnostic` is the recommended troubleshooting mode.
- Improved support workflow security with complete `--anonymise` docs.
Added full masking matrix of what is hashed and what stays unchanged.1 parent 14e5d96 commit b8f9229
314 files changed
Lines changed: 53589 additions & 21777 deletions
File tree
- .github
- ISSUE_TEMPLATE
- workflows
- .husky
- addons
- bin
- custom-addon-sdk
- custom-modules
- demo
- resources
- interfaces
- messages
- scripts
- src
- addons
- components
- common
- sfdmu-run
- custom
- messages
- modules/sfdmu-run
- ExportFiles
- OnAfter
- OnBefore
- RecordsFilter
- RecordsTransform
- custom-addons
- CustomSfdmuRunAddonTemplate
- package
- commands/sfdmu
- images
- modules
- addons
- bridge
- messages
- models
- modules/sfdmu-run
- ExportFiles
- OnAfter
- OnBefore
- RecordsFilter
- RecordsTransform
- api
- engines
- models
- app
- commands_processors
- common
- components
- api_engines
- common_components
- constants
- csv
- models
- dependencies
- models
- logging
- models
- mapping
- mock
- models
- api_models
- common_models
- common
- job_models
- job
- script_models
- script
- sf_models
- sf
- org
- models
- run
- models
- script
- types
- esm-dependency-paths
- sfdmu-addon-sdk-interfaces
- test
- fixtures/addons
- modules
- addons
- api
- common
- csv
- dependencies
- job
- logging
- mapping
- org
- run
- script
Some content is hidden
Large Commits have some content hidden by default. Use the searchbox below for content that may be hidden.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
Lines changed: 0 additions & 28 deletions
This file was deleted.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
1 | 1 | | |
2 | 2 | | |
3 | | - | |
4 | | - | |
5 | | - | |
6 | | - | |
7 | | - | |
8 | | - | |
9 | | - | |
10 | | - | |
11 | | - | |
12 | | - | |
13 | | - | |
14 | | - | |
15 | | - | |
16 | | - | |
17 | | - | |
18 | | - | |
19 | | - | |
20 | | - | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
This file was deleted.
This file was deleted.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
| 37 | + | |
| 38 | + | |
| 39 | + | |
| 40 | + | |
| 41 | + | |
| 42 | + | |
| 43 | + | |
| 44 | + | |
| 45 | + | |
| 46 | + | |
| 47 | + | |
| 48 | + | |
| 49 | + | |
| 50 | + | |
| 51 | + | |
| 52 | + | |
| 53 | + | |
| 54 | + | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
| 60 | + | |
| 61 | + | |
1 | 62 | | |
2 | 63 | | |
3 | | - | |
4 | | - | |
5 | | - | |
6 | | - | |
7 | | - | |
8 | | - | |
9 | | - | |
10 | 64 | | |
11 | 65 | | |
12 | | - | |
13 | 66 | | |
14 | 67 | | |
15 | 68 | | |
16 | | - | |
17 | | - | |
18 | | - | |
19 | | - | |
20 | | - | |
21 | 69 | | |
22 | 70 | | |
23 | | - | |
| 71 | + | |
| 72 | + | |
24 | 73 | | |
25 | | - | |
26 | | - | |
| |||
0 commit comments