In #551 rclone is now used for all searches. Unfrtouantely because rlcone is caleld through subprocess it is much slower, because spawning a new process is very slow.
There are two solutions, either:
- Revert back to using local filesystem search. This is okay but it is nice to use
lsjson for everything because we only need to test once thing
- Spawn a process upfront with POpen and hold it on the datashuttle class to use for all rclone calls. This (should) be fast and allow us to use a single call for all file searches, but is trickier to manage.
In #551
rcloneis now used for all searches. Unfrtouantely becauserlconeis caleld throughsubprocessit is much slower, because spawning a new process is very slow.There are two solutions, either:
lsjsonfor everything because we only need to test once thing