Add support for new flash-attn (and kernel) interface in ring-flash-attention
Author: NanoCode012Created Sep 4, 2026Updated Sep 4, 2026
Labelsenhancement
⚠️ Please check that this feature request hasn't been suggested before.
- I searched previous Ideas in Discussions didn't find any similar feature requests.
- I searched previous Issues didn't find any similar feature requests.
Feature description
Ring FA only supports FA2
✔️ Solution
We'd need to either fork or make it into a plugin?
❓ Alternatives
No response
Additional Context
No response
Acknowledgements
- My issue title is concise, descriptive, and in title casing.
- I have searched the existing issues to make sure this feature has not been requested yet.
- I have provided enough information for the maintainers to understand and evaluate this request.
Source: axolotl-ai-cloud/axolotl