Add fix for #151 - Google hourly / annual data mixup#156
Conversation
…ta mixup Add distinguish between the kinds of CFE in the gcp import script, and add tests
|
Verified the data fix against Google's source ( One change to request before merge, on the Concretely: set your |
The other week, one thing we identified an issue with the data relating to annual and hourly carbon intensity figures from Google. These were lower that I think the hourly data suggests, and there were also new cloud regions added to the published google csv file in December that were not in this dataset before.
This PR proposes a fix for the numbers that were likely wrong, and also includes the new data.
But before it's merged in, it likely makes sense to ask @VincentPoncet about what the annual claim that Google makes is, as I have tried to capture the detail. I'd want a sense check from someone closer to the data, and he's joined the WG meetings before.
If there is not a per-region annual matching claim like this, it might make more sense to leave the data blank, so I've set a constant
GOOGLE_ANNUAL_MATCHING_CLAIMthat we can set to an empty /Nonevalue if need be.A machine generated summary of the changes is below.
This pull request updates the GCP data update script, improves documentation, and refreshes the GCP region data for 2024 in
Cloud_Region_Metadata.csv. The main focus is to clarify and correctly apply Google's annual renewable energy matching claim, distinguish between hourly and annual CFE values, and improve testability and documentation.Key changes:
GCP Data Handling and Script Updates
gcp-data-update.pytogcp_data_update.pythroughout the codebase and documentation for consistency and Python module naming conventions. [1] [2] [3] [4]provider-cfe-annual = 1.0) for all GCP regions, reflecting Google's public sustainability statements. [1] [2]provider-cfe-hourly(region-specific) andprovider-cfe-annual(fleet-wide claim) in both data normalization and metadata update logic. [1] [2] [3] [4] [5] [6] [7]Data and CSV Updates
Cloud_Region_Metadata.csv:provider-cfe-annualto1.0for all regions.provider-cfe-hourlyvalues as per the latest data.Documentation and Testing Improvements
README.mdwith:These changes ensure the project reflects the latest GCP sustainability data and claims, improves maintainability and clarity, and enhances test coverage for future updates.