[ Dep conflict ] FA4 uses cutlass 4.6.0.dev0 whereas sonicmoe EP 4.6.0

Please check that this issue hasn't been reported before.

• I searched previous Bug Reports didn't find any similar reports.

Expected Behavior

No error

Current behaviour

Seems like upstream requires https://github.com/Dao-AILab/flash-attention/pull/2689

Running it forced via 4.6.0 seems fine for smoke test, but I haven't done extensive test yet. Some warnings are thrown for the NamedTuple.

Steps to reproduce

1. Install FA4
2. Install cutlass 4.6.0

Config yaml

Possible solution

No response

Which Operating Systems are you using?

• Linux
• macOS
• Windows

Python Version

3.12

axolotl branch-commit

main

Acknowledgements

• My issue title is concise, descriptive, and in title casing.
• I have searched the existing issues to make sure this bug has not been reported yet.
• I am using the latest version of axolotl.
• I have provided enough information for the maintainers to reproduce and diagnose the issue.