Ampere architecture FlashMLA bring-up
Author: pzhao-engCreated Mar 11, 2025Updated Jun 1, 2026
Based on the Hopper architecture FlashMLA and FlashAttentionV2, the FlashMLA based on the Ampere architecture is implemented.
Without using double buffer optimization, the performance can achiev up to 300 GB/s in and 125 TFLOPS on A100.
This is the code repository:
https://github.com/pzhao-eng/FlashMLA
Source: deepseek-ai/FlashMLA