Skip to content

Making the trace component of SparseKernelNormalizer more memory-frie…#219

Open
rosecers wants to merge 4 commits into
mainfrom
fix/memory_overload
Open

Making the trace component of SparseKernelNormalizer more memory-frie…#219
rosecers wants to merge 4 commits into
mainfrom
fix/memory_overload

Conversation

@rosecers

@rosecers rosecers commented Nov 17, 2023

Copy link
Copy Markdown
Collaborator

…ndly

Using the equality of traces under cyclic products, I've modified the sparse kernel
normalizer to be less memory-hungry. Had a few issues using this and having RAM crash

Contributor (creator of PR) checklist

  • Tests updated (for new features and bugfixes)?
  • Documentation updated (for new features)?
  • Issue referenced (for PRs that solve an issue)?

For Reviewer

  • CHANGELOG updated if important change?

📚 Documentation preview 📚: https://scikit-matter--219.org.readthedocs.build/en/219/

Comment thread src/skmatter/preprocessing/_data.py Outdated
rosecers and others added 2 commits November 20, 2023 09:26
Co-authored-by: Alexander Goscinski <alex.goscinski@posteo.de>
@rosecers rosecers force-pushed the fix/memory_overload branch from a8ccfe6 to ca19af2 Compare November 20, 2023 15:32
@PicoCentauri

Copy link
Copy Markdown
Collaborator

What is the status here?

Seems like we have to fix some assertions in the test_sparse_kernel_centerer.py

@ceriottm

Copy link
Copy Markdown
Collaborator

@rosecers if you have a look, we can maybe merge this finally?

)

self.scale_ = np.sqrt(np.trace(Khat) / Knm.shape[0])
self.scale_ = Khat_trace / Knm.shape[0]

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Where did the square root go to?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants