Can We implement Flash attention 2 in MXnet
Author: rajveer43Created Oct 5, 2023Updated Oct 5, 2023
LabelsFeature request
Description
Flash Attention 2 is a library that provides attention operation kernels for faster and more memory efficient inference and training:
References
Source: apache/mxnet