[BUG]

Describe the bug bash vllm_inference.sh --model_name_or_path ./Llama-2-7b-hf --dataset_path data/alpaca/test_conversation --output_dir data/inference_results [2025-04-03 14:16:08,168] [INFO] [real_accelerator.py:239:get_accelerator] Setting ds_accelerator to cuda (auto detect) Consider install flash_attn for better performance. Checking dataset keys: 100%|██████████| 1/1 [00:00<00:00, 2833.99it/s] Downloading data files: 100%|██████████| 1/1 [00:00<00:00, 13066.37it/s] Extracting data files: 100%|██████████| 1/1 [00:00<00:00, 1470.14it/s] Generating train split: 252 examples [00:00, 59018.63 examples/s] Map (num_proc=16): 0%| | 0/252 [00:00<?, ? examples/s]Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Map (num_proc=16): 6%|▋ | 16/252 [00:00<00:02, 83.50 examples/s]Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Map (num_proc=16): 38%|███▊ | 96/252 [00:00<00:00, 354.95 examples/s]Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Map (num_proc=16): 57%|█████▋ | 144/252 [00:00<00:00, 382.18 examples/s]Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since the conversation doesn't end up with an user message. Skip. Not a valid conversation for generation, since th