vLLM (0.11.0>=) is not working with Dolphin. Got the following issue: ModuleNotFoundError: No module named 'vllm.model_executor.models.bart'
Author: neilbhutadaCreated Oct 28, 2025Updated Mar 25, 2026
I followed the steps as is for using vllm with Dolphin. I installed the plugins as described in the documentation here: . I'll try downgrading vllm and hopefully it will work - but just wanted to call this out. https://github.com/bytedance/Dolphin/tree/master/deployment/vllm.
Source: bytedance/Dolphin