Replies: 1 comment
-
|
Yes a good question, I've wondered this myself. You can look for the function features.push_back() in the ggml source to see what gets added where. But you could also look directly at the build objects. For example, I took a look at this file: When I ran bin-cpuflags-x86 on it, I got a list of features that is consistent with what I see on the system_info line. |
Beta Was this translation helpful? Give feedback.
Uh oh!
There was an error while loading. Please reload this page.
-
I have built whisper on a RISCV platform that supports RVV1.0 as well as some NPU things. I see that there is code in GGML that can take advantage of this through compiler intrinsics provided the right modules are selected at link time and the correct conditional compilations are taken. How can I check that these are in fact being used instead of some generic C code? The reason I ask is that when I run the JFK sample through
whisper-cliit is spending 89% of its time in the 'encode' phase and taking nearly 3x the duration of the input audio.Beta Was this translation helpful? Give feedback.
All reactions