为大家提供一份使用本地ollama 或 vllm 的配置
作者: 15608447849创建于 2025年8月13日更新于 2026年1月9日
Because vllm or ollama are both compatible with OpenAI api, they can be used as model interfaces for OpenAI. Refer to the litellm library for compatibility with OpenAI api, and it has been tested to work successfully.
内容来源: jd-opensource/joyagent-jdgenie