Skip to content

Add a chapter about scikit-learn-intelex#40

Open
Vika-F wants to merge 6 commits into
intel:mainfrom
Vika-F:sklex
Open

Add a chapter about scikit-learn-intelex#40
Vika-F wants to merge 6 commits into
intel:mainfrom
Vika-F:sklex

Conversation

@Vika-F

@Vika-F Vika-F commented Jun 30, 2026

Copy link
Copy Markdown

Add information about sklearnex configurations that can provide better performance.

CC @napetrov @david-cortes-intel @avolkov-intel @Alexandr-Solovev

@david-cortes-intel david-cortes-intel left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some comments:

  • Could make it clear that OMP settings related to affinity will not have an effect.
  • Could provide commands to do all of this programmatically instead of manually listing the core IDs after looking at output.
  • This advise is not really specific to sklearnex. Maybe could be put as an additional section and then linked from all the relevant articles, like NumPy and scikit-learn.

Comment thread software/scikit-learn-intelex/README.md Outdated

To set EPB to Performance mode:
```
sudo cpupower set -b 0

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It doesn't explain the longevity of the effect from this command. Same for the other CPU settings.

@Vika-F

Vika-F commented Jun 30, 2026

Copy link
Copy Markdown
Author

Could make it clear that OMP settings related to affinity will not have an effect.

Ok, will do.

Could provide commands to do all of this programmatically instead of manually listing the core IDs after looking at output.

You mean, python commands doing the same things like affinity modification?

This advise is not really specific to sklearnex. Maybe could be put as an additional section and then linked from all the relevant articles, like NumPy and scikit-learn.

Yes, I thought about it as well, but was not sure. I will restructure the pages accordingly.

@david-cortes-intel

Copy link
Copy Markdown
Contributor

You mean, python commands doing the same things like affinity modification?

I guess they'd have to be shell commands, otherwise they wouldn't have an effect on an already-launched python process.

@Vika-F

Vika-F commented Jul 1, 2026

Copy link
Copy Markdown
Author

I guess they'd have to be shell commands, otherwise they wouldn't have an effect on an already-launched python process.

I understand the idea, but it will be a multi-line script for sure. Not a single sed .... Will it be Ok? I mean, I do not see similar code in the other chapters.

@david-cortes-intel

Copy link
Copy Markdown
Contributor

I guess they'd have to be shell commands, otherwise they wouldn't have an effect on an already-launched python process.

I understand the idea, but it will be a multi-line script for sure. Not a single sed .... Will it be Ok? I mean, I do not see similar code in the other chapters.

@Vika-F isn't there any built-in numactl command do something like "run only physical cores"?

@Vika-F

Vika-F commented Jul 1, 2026

Copy link
Copy Markdown
Author

@Vika-F isn't there any built-in numactl command do something like "run only physical cores"?

No, there is no such option.

@Vika-F

Vika-F commented Jul 1, 2026

Copy link
Copy Markdown
Author

@david-cortes-intel An example of a script that runs a process only on physical nodes:
run_no_ht.sh

For me it looks too heavy for the page like this. What do you think?

@david-cortes-intel

Copy link
Copy Markdown
Contributor

@david-cortes-intel An example of a script that runs a process only on physical nodes: run_no_ht.sh

For me it looks too heavy for the page like this. What do you think?

@Vika-F How about something in a pipeline (perhaps with awk?) getting the result from lscpu with arguments, filtering, and selecting a column?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants