Skip to content

Commit 4c614e1

Browse files
gongchensugongchensu
committed
Add native nvidia backend for flash attention.
1 parent 90cb1b5 commit 4c614e1

4 files changed

Lines changed: 544 additions & 12 deletions

File tree

‎src/infinicore/ops/flash_attention/flash_attention.cc‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,7 @@
11
#include "infinicore/ops/flash_attention.hpp"
22

33
#include "../../utils.hpp"
4+
#include "infinicore/context/context.hpp"
45

56
namespace infinicore::op {
67

0 commit comments

Comments
 (0)