Commit 73b4d7e
Fix bugs in migration script (#4501)
* fix argument -t
* fix path can not find error - upload to wrong destination
* fix format
* modify logging info
* fix delete bundle issue
* add more checks when deleting
* add checks
* change sanity check in migration
* test logging
* fix dir size check
* fix sanity check
* fix is dir
* black
* fix
* modify dependencies
* add migration
* add more logging
* add try-catch
* add more try catch
* fix logging format
* test all bundles
* test all bundles
* add migration
* add migration
* change the way to get bundle uuid
* fix format
* add logging level
* check linked bundle
* change linked bundle
* add file size check
* add file size counter
* clean up files
* 1) Fix major bug that caused many bundles to be skipped as being linked even though they weren't linked. 2) remove dependency on a file to determine which bundles to delete and what their original locations were.
* Fix some issues
* Added in timing code
* Updated migration script to fix a few timing bugs
* change disk usage calculation
* fix format
* Added in -k and added in multiprocessing
* Fix bugs
* Finalize migration script
* Add in multiprocessing
* minor comments
* Fix minor error with logic for when to upload bundle
* One more update to that pesky if statement: I think I got it working now
* Fix formatting
---------
Co-authored-by: Ashwin Ramaswami <aramaswamis@gmail.com>
Co-authored-by: AndrewJGaut <ajg@umail.ucsb.edu>1 parent bf1dff7 commit 73b4d7e
3 files changed
Lines changed: 292 additions & 98 deletions
0 commit comments