Skip to content

Commit 05bcc8a

Browse files
committed
Update on "[Executorch][llama] Enable quantized sdpa"
Enable leveraging quantized sdpa op when quantized kv cache is used. Instead of adding yet another arg, at the moment I have chosen to leverage quantize_kv_cache option. Differential Revision: [D71833064](https://our.internmc.facebook.com/intern/diff/D71833064/) [ghstack-poisoned]
2 parents ebfb137 + 11a2e98 commit 05bcc8a

1 file changed

Lines changed: 3 additions & 1 deletion

File tree

extension/llm/custom_ops/CMakeLists.txt

Lines changed: 3 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -21,7 +21,9 @@ if(NOT EXECUTORCH_ROOT)
2121
endif()
2222

2323
set(_common_compile_options -Wno-deprecated-declarations -fPIC)
24-
list(APPEND _common_compile_options "-march=armv8.2-a+dotprod")
24+
if(CMAKE_SYSTEM_PROCESSOR MATCHES "arm64|aarch64")
25+
list(APPEND _common_compile_options "-march=armv8.2-a+dotprod")
26+
endif()
2527

2628
include(${EXECUTORCH_ROOT}/tools/cmake/Utils.cmake)
2729
include(${EXECUTORCH_ROOT}/tools/cmake/Codegen.cmake)

0 commit comments

Comments
 (0)