#1186·OpenLLM

错误: 使用 OpenLLM 入门时出现问题

作者: iamobservable创建于 2025年5月3日更新于 2025年7月11日
bash
rm -rf ~/.openllm

2 Create new folder for project

bash
# ~/local-gpt
mkdir openllm-api
cd openllm-api

3. Initialize folder with uv with Python 3.12.8

bash
# ~/local-gpt/openllm-api
uv init -p 3.12

Initialized project openllm-api

4. Add openllm to project

bash
# ~/local-gpt/openllm-api
uv add openllm

Using CPython 3.12.8 Creating virtual environment at: .venv Resolved 98 packages in 1.36s Prepared 94 packages in 16.38s Installed 94 packages in 244ms

  • a2wsgi==1.10.8
  • aiohappyeyeballs==2.6.1
  • aiohttp==3.11.18
  • aiosignal==1.3.2
  • aiosqlite==0.21.0
  • annotated-types==0.7.0
  • anyio==4.9.0
  • appdirs==1.4.4
  • asgiref==3.8.1
  • attrs==25.3.0
  • bentoml==1.4.8
  • cattrs==23.1.2
  • certifi==2025.4.26
  • charset-normalizer==3.4.2
  • click==8.1.8
  • click-option-group==0.5.7
  • cloudpickle==3.1.1
  • deprecated==1.2.18
  • distro==1.9.0
  • dulwich==0.22.8
  • filelock==3.18.0
  • frozenlist==1.6.0
  • fs==2.4.16
  • fsspec==2025.3.2
  • h11==0.16.0
  • hf-xet==1.1.0
  • httpcore==1.0.9
  • httpx==0.28.1
  • httpx-ws==0.7.2
  • huggingface-hub==0.30.2
  • idna==3.10
  • importlib-metadata==8.6.1
  • jinja2==3.1.6
  • jiter==0.9.0
  • kantoku==0.18.3
  • markdown-it-py==3.0.0
  • markupsafe==3.0.2
  • mdurl==0.1.2
  • multidict==6.4.3
  • numpy==2.2.5
  • nvidia-ml-py==12.570.86
  • OpenAI==1.73.0
  • openllm==0.6.30
  • opentelemetry-api==1.32.1
  • opentelemetry-instrumentation==0.53b1
  • opentelemetry-instrumentation-aiohttp-client==0.53b1
  • opentelemetry-instrumentation-asgi==0.53b1
  • opentelemetry-sdk==1.32.1
  • opentelemetry-semantic-conventions==0.53b1
  • opentelemetry-util-http==0.53b1
  • packaging==25.0
  • pathspec==0.12.1
  • pip-requirements-parser==32.0.1

内容来源: bentoml/OpenLLM