错误: 使用 OpenLLM 入门时出现问题
作者: iamobservable创建于 2025年5月3日更新于 2025年7月11日
rm -rf ~/.openllm2 Create new folder for project
# ~/local-gpt
mkdir openllm-api
cd openllm-api3. Initialize folder with uv with Python 3.12.8
# ~/local-gpt/openllm-api
uv init -p 3.12Initialized project openllm-api
4. Add openllm to project
# ~/local-gpt/openllm-api
uv add openllmUsing CPython 3.12.8 Creating virtual environment at: .venv Resolved 98 packages in 1.36s Prepared 94 packages in 16.38s Installed 94 packages in 244ms
- a2wsgi==1.10.8
- aiohappyeyeballs==2.6.1
- aiohttp==3.11.18
- aiosignal==1.3.2
- aiosqlite==0.21.0
- annotated-types==0.7.0
- anyio==4.9.0
- appdirs==1.4.4
- asgiref==3.8.1
- attrs==25.3.0
- bentoml==1.4.8
- cattrs==23.1.2
- certifi==2025.4.26
- charset-normalizer==3.4.2
- click==8.1.8
- click-option-group==0.5.7
- cloudpickle==3.1.1
- deprecated==1.2.18
- distro==1.9.0
- dulwich==0.22.8
- filelock==3.18.0
- frozenlist==1.6.0
- fs==2.4.16
- fsspec==2025.3.2
- h11==0.16.0
- hf-xet==1.1.0
- httpcore==1.0.9
- httpx==0.28.1
- httpx-ws==0.7.2
- huggingface-hub==0.30.2
- idna==3.10
- importlib-metadata==8.6.1
- jinja2==3.1.6
- jiter==0.9.0
- kantoku==0.18.3
- markdown-it-py==3.0.0
- markupsafe==3.0.2
- mdurl==0.1.2
- multidict==6.4.3
- numpy==2.2.5
- nvidia-ml-py==12.570.86
- OpenAI==1.73.0
- openllm==0.6.30
- opentelemetry-api==1.32.1
- opentelemetry-instrumentation==0.53b1
- opentelemetry-instrumentation-aiohttp-client==0.53b1
- opentelemetry-instrumentation-asgi==0.53b1
- opentelemetry-sdk==1.32.1
- opentelemetry-semantic-conventions==0.53b1
- opentelemetry-util-http==0.53b1
- packaging==25.0
- pathspec==0.12.1
- pip-requirements-parser==32.0.1
…
内容来源: bentoml/OpenLLM