Add a chapter about scikit-learn-intelex#40
Conversation
david-cortes-intel
left a comment
There was a problem hiding this comment.
Some comments:
- Could make it clear that OMP settings related to affinity will not have an effect.
- Could provide commands to do all of this programmatically instead of manually listing the core IDs after looking at output.
- This advise is not really specific to sklearnex. Maybe could be put as an additional section and then linked from all the relevant articles, like NumPy and scikit-learn.
|
|
||
| To set EPB to Performance mode: | ||
| ``` | ||
| sudo cpupower set -b 0 |
There was a problem hiding this comment.
It doesn't explain the longevity of the effect from this command. Same for the other CPU settings.
Ok, will do.
You mean, python commands doing the same things like affinity modification?
Yes, I thought about it as well, but was not sure. I will restructure the pages accordingly. |
I guess they'd have to be shell commands, otherwise they wouldn't have an effect on an already-launched python process. |
I understand the idea, but it will be a multi-line script for sure. Not a single |
@Vika-F isn't there any built-in numactl command do something like "run only physical cores"? |
No, there is no such option. |
|
@david-cortes-intel An example of a script that runs a process only on physical nodes: For me it looks too heavy for the page like this. What do you think? |
@Vika-F How about something in a pipeline (perhaps with awk?) getting the result from lscpu with arguments, filtering, and selecting a column? |
Add information about sklearnex configurations that can provide better performance.
CC @napetrov @david-cortes-intel @avolkov-intel @Alexandr-Solovev