bug: OpenLLM has incompatibilities with Ubuntu 24.04, python 3.11, setuptools 79.0.1
Describe the bug
I have an Ubuntu 24.04 distribution, Nvidia RTX4090, and get the following failure when running openllm hello. Please see the attached file for all the details.
Traceback (most recent call last): File "", line 198, in _run_module_as_main File "", line 88, in _run_code File "/home/chris/.openllm/venv/2007316187285956469/lib/python3.11/site-packages/bentoml/main.py", line 2, in from bentoml_cli.cli import cli File "/home/chris/.openllm/venv/2007316187285956469/lib/python3.11/site-packages/bentoml_cli/cli.py", line 63, in cli = create_bentoml_cli() ^^^^^^^^^^^^^^^^^^^^ File "/home/chris/.openllm/venv/2007316187285956469/lib/python3.11/site-packages/bentoml_cli/cli.py", line 9, in create_bentoml_cli from bentoml._internal.context import server_context File "/home/chris/.openllm/venv/2007316187285956469/lib/python3.11/site-packages/bentoml/_internal/context.py", line 15, in from .utils.filesystem import TempfilePool File "/home/chris/.openllm/venv/2007316187285956469/lib/python3.11/site-packages/bentoml/_internal/utils/filesystem.py", line 14, in import fs File "/home/chris/.openllm/venv/2007316187285956469/lib/python3.11/site-packages/fs/init.py", line 4, in import("pkg_resources").declare_namespace(name) # type: ignore ^^^^^^^^^^^^^^^^^^^^^^^^^^^ ModuleNotFoundError: No module named 'pkg_resources'
To reproduce
chris@chris-MS-7C56:$ python -m venv OpenLLM_P311
chris@chris-MS-7C56:$ source OpenLLM_P311/bin/activate
(OpenLLM_P311) chris@chris-MS-7C56:$ pip install openllm
(OpenLLM_P311) chris@chris-MS-7C56:$ openllm hello
Logs
Environment
(OpenLLM_P311) chris@chris-MS-7C56:~$ bentoml env Using Python 3.11.14 environment at: OpenLLM_P311
Environment variable
BENTOML_DEBUG=''
BENTOML_QUIET=''
BENTOML_BUNDLE_LOCAL_BUILD=''
BENTOML_DO_NOT_TRACK=''
BENTOML_CONFIG=''
BENTOML_CONFIG_OPTIONS=''
BENTOML_PORT=''
BENTOML_HOST=''
BENTOML_API_WORKERS=''System information
bentoml: 1.4.8
python: 3.11.14
platform: Linux-6.17.0-14-generic-x86_64-with-glibc2.39
uid_gid: 1000:1000
pip_packagesa2wsgi==1.10.10
aiohappyeyeballs==2.6.1
aiohttp==3.13.3
aiosignal==1.4.0
aiosqlite==0.22.1
annotated-doc==0.0.4
annotated-types==0.7.0
anyio==4.12.1
appdirs==1.4.4
asgiref==3.11.1
attrs==25.4.0
bentoml==1.4.8
cattrs==23.1.2
certifi==2026.1.4
click==8.3.1
click-option-group==0.5.9
cloudpickle==3.1.2
distro==1.9.0
dulwich==1.1.0
filelock==3.24.2
frozenlist==1.8.0
fs==2.4.16
fsspec==2026.2.0
h11==0.16.0
hf-xet==1.2.0
httpcore==1.0.9
httpx==0.28.1
httpx-ws==0.8.2
huggingface-hub==1.4.1
idna==3.11
importlib-metadata==8.7.1
jinja2==3.1.6
jiter==0.13.0
kantoku==0.18.3
markdown-it-py==4.0.0
markupsafe==3.0.3
mdurl==0.1.2
multidict==6.7.1
numpy==2.4.2
nvidia-ml-py==13.590.48
openai==1.73.0
openllm==0.6.30
opentelemetry-api==1.39.1
opentelemetry-instrumentation==0.60b1
opentelemetry-instrumentation-aiohttp-client==0.60b1
opentelemetry-instrumentation-asgi==0.60b1
opentelemetry-sdk==1.39.1
opentelemetry-semantic-conventions==0.60b1
opentelemetry-util-http==0.60b1
packaging==26.0
pathspec==1.0.4
pip==24.0
pip-requirements-parser==32.0.1
prometheus-client==0.24.1
prompt-toolkit==3.0.52
propcache==0.4.1
psutil==7.2.2
pyaml==26.2.1
pydantic==2.12.5
pydantic-core==2.41.5
pygments==2.19.2
pyparsing==3.3.2
python-dateutil==2.9.0.post0
python-dotenv==1.2.1
python-json-logger==4.0.0
python-multipart==0.0.22
pyyaml==6.0.3
pyzmq==27.1.0
questionary==2.1.1
rich==14.3.2
schema==0.7.8
setuptools==79.0.1
shellingham==1.5.4
simple-di==0.1.5
six==1.17.0
sniffio==1.3.1
starlette==0.52.1
tabulate==0.9.0
tomli-w==1.2.0
tornado==6.5.4
tqdm==4.67.3
typer==0.24.0
typer-slim==0.24.0
typing-extensions==4.15.0
typing-inspection==0.4.2
urllib3==2.6.3
uv==0.10.4
uvicorn==0.41.0
watchfiles==1.1.1
wcwidth==0.6.0
wrapt==1.17.3
wsproto==1.3.2
yarl==1.22.0
zipp==3.23.0========================================================================== (OpenLLM_P311) chris@chris-MS-7C56:~$ transformers-cli env transformers-cli: command not found
System information (Optional)
Operating System: Ubuntu 24.04.4 LTS Kernel: Linux 6.17.0-14-generic Architecture: x86-64
memory 64GiB System Memory processor AMD Ryzen 7 5700X 8-Core Processor storage NVMe disk (ADATA LEGEND 700) GPU: chris@chris-MS-7C56:~$ nvidia-smi Wed Feb 18 13:46:02 2026 +-----------------------------------------------------------------------------------------+ | NVIDIA-SMI 590.48.01 Driver Version: 590.48.01 CUDA Version: 13.1 | +-----------------------------------------+------------------------+----------------------+ | GPU Name Persistence-M | Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap | Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |=========================================+========================+======================| | 0 NVIDIA GeForce RTX 4090 Off | 00000000:2B:00.0 On | Off | | 0% 41C P8 30W / 450W | 641MiB / 24564MiB | 0% Default | | | | N/A | +-----------------------------------------+------------------------+----------------------+
+-----------------------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=========================================================================================| | 0 N/A N/A 1551 G /usr/lib/xorg/Xorg 248MiB | | 0 N/A N/A 1769 G /usr/bin/gnome-shell 61MiB | | 0 N/A N/A 6222 G .../7836/usr/lib/firefox/firefox 267MiB | +-----------------------------------------------------------------------------------------+
I have the following pythons installed, using deadsnake.
$ ls -l /usr/bin | grep python lrwxrwxrwx 1 root root 24 Oct 10 04:52 pdb3.10 -> ../lib/python3.10/pdb.py lrwxrwxrwx 1 root root 24 Oct 10 04:54 pdb3.11 -> ../lib/python3.11/pdb.py lrwxrwxrwx 1 root root 24 Jan 22 15:57 pdb3.12 -> ../lib/python3.12/pdb.py lrwxrwxrwx 1 root root 31 Nov 12 07:15 py3versions -> ../share/python3/py3versions.py -rwxr-xr-x 1 root root 956 Nov 24 2023 pybabel-python3 lrwxrwxrwx 1 root root 10 Nov 12 07:15 python3 -> python3.12 -rwxr-xr-x 1 root root 5232024 Oct 10 04:52 python3.10 -rwxr-xr-x 1 root root 6637240 Oct 10 04:54 python3.11 -rwxr-xr-x 1 root root 8020928 Jan 22 15:57 python3.12 lrwxrwxrwx 1 root root 34 Jan 22 15:57 python3.12-config -> x86_64-linux-gnu-python3.12-config lrwxrwxrwx 1 root root 17 Nov 12 07:15 python3-config -> python3.12-config -rwxr-xr-x 1 root root 3027 Jan 22 15:57 x86_64-linux-gnu-python3.12-config lrwxrwxrwx 1 root root 34 Nov 12 07:15 x86_64-linux-gnu-python3-config -> x86_64-linux-gnu-python3.12-config
I set aliases in my bashrc for python 3.11.14
alias python=/usr/bin/python3.11 alias python3=/usr/bin/python3.11
Source: bentoml/OpenLLM