fix: feed files are not been extracted

[davidgamez]

Summary:

Closes: #1298

The extracted file's path was built in two different places with a minor logic difference. In this PR, the folder path is created only once and passed along to the functions where needed. The extraction of the files was moved to further ahead in the flow making sure it only happens when a dataset update is needed.

As a minor addition, I added a "verifier" function to be able to run locally the download, unzipping and bucker upload using a local GCP storage emulator.

Expected behavior:
The extracted feeds files are copy over the GCP bucket.

Testing tips:

You can test locally using the download_verifier.py file.

• Update your pip dependencies locally
• Open download_verifier.py and change the PRODUCER_URL to an actual URL from a feed
• Execute download_verifier.py via terminal or IDE
• Review the newly created .cloudstoragefolder and verify that it contains a proper file structure like the following image

Please make sure these boxes are checked before submitting your pull request - thanks!

• Run the unit tests with ./scripts/api-tests.sh to make sure you didn't break anything
• Add or update any needed documentation to the repo
• Format the title like "feat: [new feature short description]". Title must follow the Conventional Commit Specification(https://www.conventionalcommits.org/en/v1.0.0/).
• Linked all relevant issues
• Include screenshot(s) showing how this pull request works and fixes the issue(s)

[Copilot]

Pull Request Overview

This PR fixes an issue where extracted feed files were not being copied to the GCP bucket. The fix ensures that the extracted file path is created consistently in one location and passed to functions that need it, rather than being calculated in multiple places with slight differences.

• Refactored download_content to return the extracted files path as a third value
• Modified upload_file_to_storage to accept the extracted files path as a parameter instead of recalculating it
• Updated test mocks to handle the new return signature

Reviewed Changes

Copilot reviewed 4 out of 4 changed files in this pull request and generated 1 comment.

File	Description
functions-python/batch_process_dataset/src/main.py	Updated method signatures to pass extracted files path consistently and fixed extraction logic
functions-python/batch_process_dataset/tests/test_batch_process_dataset_main.py	Updated test mocks to handle the new return signature with extracted files path
functions-python/batch_process_dataset/src/scripts/download_verifier.py	Added verification script for testing download functionality locally
functions-python/batch_process_dataset/.coveragerc	Excluded scripts directory from coverage reporting

[davidgamez]

Extracted feed in DEV environment: