in SFT script, distributed training got stuck if set `packing=false`

I tried to follow the exact README setup for SFT experiments. However, I find that if setting packing = false . Then the process will get stuck at the beginning of the training.

This is ok in a single GPU setting. SO I assume it must be correlated with NCCL communication

Any ideas why this happens?