Skip to content

fix: More reliable electricity data extraction from M365#158

Merged
martyngigg merged 4 commits into
mainfrom
more-reliable-electric-data-extraction
Oct 23, 2025
Merged

fix: More reliable electricity data extraction from M365#158
martyngigg merged 4 commits into
mainfrom
more-reliable-electric-data-extraction

Conversation

@martyngigg

Copy link
Copy Markdown
Member

Summary

More robust extract of electricity data from sharepoint:

  • Loading now stops if file content cannot be read to avoid
    silently missing data.
  • Number of threads capped to 8
  • Retry on network errors when reading file content
  • Content merged on filename
  • Removed dlt lag widow that didn't function as expected

Refs #156

- Loading now stops if file content cannot be read to avoid
silently missing data.
- Number of threads capped to 8
- Retry on network errors when reading file content
- Content merged on filename
- Removed dlt lag widow that didn't function as expected
Allows override by environment variable.
Python 3.14 was released but some dependencies fail to build with it
@martyngigg

Copy link
Copy Markdown
Member Author

@coderabbitai full review

@martyngigg
martyngigg merged commit c7be0cb into main Oct 23, 2025
3 checks passed
@martyngigg
martyngigg deleted the more-reliable-electric-data-extraction branch October 23, 2025 09:46
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant