Skip to main content

Module attention

Module attention 

Source

Modules§

flash_attn2
Flash Attention 2 — forward and backward kernels.