[Feature] Automatic LoRA rank recommendation based on dataset size
Author: rehan243Created Apr 24, 2026Updated Aug 7, 2026
Labelsgood first issue
Description
Choosing the right LoRA rank is largely trial-and-error. An automatic recommendation based on dataset size, task type, and base model would save time.
Use Case
- New users don't know what rank to choose
- Different tasks benefit from different ranks (classification vs generation)
- Could be a
--auto-rankflag or a preprocessing analysis step
Based on our experience, rank 16 works for most tasks under 10K samples, but this heuristic could be formalized.
Source: axolotl-ai-cloud/axolotl