Bug in SFT script
Author: ChenDRAGCreated Feb 17, 2025Updated Feb 3, 2026
Evaluation raise an error
[rank0]: ValueError: You are attempting to perform batched generation with padding_side='right' this may lead to unexpected behaviour for Flash Attention version of Qwen2. Make sure to call tokenizer.padding_side = 'left'before tokenizing the input.
Any idea how to solve it?
Source: huggingface/open-r1