Skip to content

Add performance tests#129

Open
akrzgc wants to merge 17 commits into
mainfrom
performance-tests
Open

Add performance tests#129
akrzgc wants to merge 17 commits into
mainfrom
performance-tests

Conversation

@akrzgc
Copy link
Copy Markdown
Contributor

@akrzgc akrzgc commented Oct 19, 2023

This branch is adding performance tests for nanoDFT.

So far it is possible to just execute initial 5 tests with simple purest command purest tests/test_benchmark_performance.py.

The code injecting the ipu_cycle_count into the _nanoDFT() jitted method is WIP.

The branch is going to:

  • add nanoDFT() performance evaluation with ipu_cycle_count
  • use pytest for performance testing
  • add new fullerene molecules such as C80 or C100
  • consider using GitHub Action benchmark for performance tracking (either already within this branch or as a separate change)
  • refactor the ipu_cycle_count code and move it to utils

@akrzgc akrzgc requested a review from balancap October 19, 2023 15:40
Copy link
Copy Markdown
Contributor

@hatemhelal hatemhelal left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

An idea to capture the cycle count measurement would be to make it a function decorator. That way we could reuse it outside of nanoDFT as I imagine it would be useful to define micro-benchmarks. I have a preference to break things down into smaller PRs but lets discuss.

Comment thread .pytest.ini
Comment on lines +3 to +5
filterwarnings =
error
ignore::DeprecationWarning
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I wasn't familiar with these options, looks useful!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants