[AI] Is there an error in the Google's 2024 data in the latest data snapshot?

[mrchrisadams]

Outline Action Item Details

Hi folks, it looks like there might be an error in some of Google's latest hourly carbon free energy numbers In this dataset.

If we look at the dev branch of this project, we can see examples of missing CFE data in Google's 2024 provider-cfe-hourly numbers. I've linked directly to the line to demonstrate.

https://github.com/Green-Software-Foundation/real-time-cloud/blob/Dev/Cloud_Region_Metadata.csv#L41

When I compare this to the source CSV disclosed by Google, it looks like the hourly CFE data is there, but I think in the example above, it has been listed as provider-cfe-annual in the RTC dataset - as in being filled in one column over, where it shows as 0.68.

I would expect that to be 1.0 or 100% for Google, because it corresponds to 100% annual matching - something Google Cloud Platform has had for a while.

However for hourly, or provider-cfe-hourly, I would expect it to be less than 1.0 or less than 100%, as it's that much harder to achieve a 100% of your consumption hours matched with generation.

What I think needs to be changed

I think we'd need provider-cfe-annual to be 1.0 across the board, and we'd need to revisit the hourly figures so they all have a value.

Making this concrete with an example where we are missing data in the RTC dataset:

In this row for europe-west-10, the value for provider-cfe-hourly should be 0.68, and the value for provider-cfe-annual should be 1.0
https://github.com/Green-Software-Foundation/real-time-cloud/blob/Dev/Cloud_Region_Metadata.csv#L41

I've linked to the source information below where you can see a hourly CFE value of 0.68 for europe-west10, as my source.

https://github.com/GoogleCloudPlatform/region-carbon-info/blob/main/data/yearly/2024.csv#L25

I think I can get a pull request together in the next week or so, but I think I need a sense check on what the other values for 2024 provider CFE annual and CFRE annual ought to be.

Can I get a second pair of eyes before I make a PR to fix this?

Supporting info

I've attached the rows where I think provider-cfe-annual has been added where it ought to be provider-cfe-hourly instead.

You can see the filtered view on our datasets website, where we republish this dataset. This allows us to link to specific queries or views on the dataset - and the link below shows the rows that need to be changed.

https://datasets.greenweb.org/cloud_regions/cloud_regions_metadata?_sort=rowid&_facet=cloud-provider&provider-cfe-hourly__exact=&cloud-provider__exact=Google+Cloud

Issue dependency with other WGs Groups

No response

cloud_regions_metadata-missing-hourly-values-5b2ac28.csv

[mrchrisadams]

Discussed on the call. it does seem to be a bug, and the change would need to be made in this file.

https://github.com/Green-Software-Foundation/real-time-cloud/blob/main/code/gcp-data-update.py

[mrchrisadams]

Hey folks, I've created this PR here for the revised GCP code

#156

[mrchrisadams]

We discussed this, and I've messaged @VincentPoncet to ask about the annual energy claim.