ADD: Tests for Google Drive and AWS Connection Methods

[cs7-shrey]

Description

This PR adds tests for Google Drive and AWS connection methods including tests for transfers, TUI and unit tests for certain functions.

Checklist:

• The code has been tested locally
• Tests have been added to cover all new functionality
• The documentation has been updated to reflect any changes
• The code has been formatted with pre-commit

[cs7-shrey]

Hey @JoeZiminski, I have written the tests to test google drive and aws transfers via the datashuttle python api. These are quite similar to the one in the SSH. If this approach looks good, can you please add the credentials to the github secrets and then we can run the tests in the CI.
We'd need the following variables in the github secrets

GDRIVE_CLIENT_ID
GDRIVE_CLIENT_SECRET
GDRIVE_ROOT_FOLDER_ID
GDRIVE_CONFIG_TOKEN

AWS_ACCESS_KEY_ID
AWS_REGION
AWS_BUCKET_NAME
AWS_SECRET_ACCESS_KEY

Also, the tests for Google drive are extremely slow. On my pc, it took about 20 minutes to run. What do you think can be done about this?

[JoeZiminski]

Hey @cs7-shrey cheers for this! I added the secrets, I tested locally with gdrive (will also check aws) by simply adding to os.environ at the top of the test script and it worked (with some formatting adjustments) but not sure if this will translate to the CI.

I think because this is on your fork you cannot see the main repo's secrets. If you can branch off the NIU main to create gdrive_aws_tests then merge this branch into that, it will hopefully work 🤞