Does Vanna2.0 support connecting with vLLM?
Author: viphonestsongCreated Feb 26, 2026Updated Feb 26, 2026
My environment uses an Oracle database, and the large model is deployed locally via vLLM. On the official website, I only found documentation for OpenAI or Ollama, but no instructions for a locally deployed vLLM model. I would like to know:
- Does Vanna 2.0 support locally deployed vLLM, or large models that follow the OpenAI-compatible API specification?
- If not, can I implement support by extending the code myself?
- Could you provide some guidance and hints? Thank you.
Source: vanna-ai/vanna