Skip to content

Commit 1e1bd6b

Browse files
authored
Make fp16 flash attention fallback to mkl implementation on platforms that do not support amx fp16 (#3386)
* make fp16 flash attention fallback to mkl implementation on platforms that do not support amx fp16 * fix format * add amx check for bf16 * upgrade mkl version and minor changes * minor changes * minor fix * add vnni support for bf16 odd shapes
1 parent f1aa2de commit 1e1bd6b

File tree

4 files changed

+307
-245
lines changed

4 files changed

+307
-245
lines changed

cmake/Modules/FindoneMKL.cmake

+1-1
Original file line numberDiff line numberDiff line change
@@ -35,7 +35,7 @@ set(mkl_root_hint)
3535
# install mkl-include and mkl-static for CPU build
3636
function (install_mkl_packages)
3737
message(STATUS "Download and install mkl-include and mkl-static for IPEX CPU build automatically.")
38-
set(REQ_MKL_VERSION 2021.0.0)
38+
set(REQ_MKL_VERSION 2024.0.0)
3939
execute_process(COMMAND ${PYTHON_EXECUTABLE} -m pip install "mkl-include>=${REQ_MKL_VERSION}"
4040
RESULT_VARIABLE mkl_iret COMMAND_ERROR_IS_FATAL ANY)
4141
execute_process(COMMAND ${PYTHON_EXECUTABLE} -m pip install --no-deps "mkl-static>=${REQ_MKL_VERSION}"

0 commit comments

Comments
 (0)