Hansung Kim e5e65312d2 flash: Restructure to inter-warpgroup parallelism ...

This is similar to
https://tridao.me/blog/2024/flash3/#inter-warpgroup-overlapping-with-pingpong-scheduling

2024-09-01 19:58:33 -07:00

..

.gitignore

flash: gitignore

2024-08-15 21:04:59 -07:00

common.h

flash: Change kernel arg to contain qkv; strip stimulus gen from host code

2024-08-15 21:03:02 -07:00

half.hpp

Add flash attention kernel skeleton

2024-08-14 20:46:09 -07:00

kernel.cpp

flash: Restructure to inter-warpgroup parallelism

2024-09-01 19:58:33 -07:00

main.cpp

flash: Fix load addr for V tile; test with seqlen=128

2024-08-20 14:34:09 -07:00

Makefile

Add flash attention kernel skeleton

2024-08-14 20:46:09 -07:00