昆仑芯xpu vlm-http-client调用报错IndexError: list index out of range
Search before asking | 提交之前请先搜索
- I have searched the MinerU Readme and found no similar bug report.
- I have searched the MinerU Issues and found no similar bug report.
- I have searched the MinerU Discussions and found no similar bug report.
Consult the online AI assistant for assistance | 在线 AI 助手咨询
- I have consulted the online AI assistant but was unable to obtain a solution to the issue.
Description of the bug | 错误描述
操作步骤如下: 1)用官方构建的镜像:wget https://gcore.jsdelivr.net/gh/opendatalab/MinerU@master/docker/china/kxpu.Dockerfile
2)http client启动:XPU_VISIBLE_DEVICES=5 CUDA_VISIBLE_DEVICES=5 mineru-openai-server --port 3000 --host 0.0.0.0 --gpu-memory-utilization ${MINERU_GPU_MEMORY_UTLIZATION} --enforce-eager --dtype float16
3)mineru -p test.jpg -o ./output/ -b vlm-http-client -u http://x.x.x.x:3000 调用时报错:
"POST /v1/chat/completions HTTP/1.1" 500 Internal Server Error ERROR:
Exception in ASGI application
(APIServer pid=17) File "/root/miniconda/envs/vllm_kunlun_0.10.1.1/lib/python3.10/site-packages/vllm/engine/multiprocessing/client.py", line 583, in _process_request
(APIServer pid=17) raise request_output
(APIServer pid=17) IndexError: list index out of range
How to reproduce the bug | 如何复现
操作步骤如下: 1)用官方构建的镜像:wget https://gcore.jsdelivr.net/gh/opendatalab/MinerU@master/docker/china/kxpu.Dockerfile
2)http client启动:XPU_VISIBLE_DEVICES=5 CUDA_VISIBLE_DEVICES=5 mineru-openai-server --port 3000 --host 0.0.0.0 --gpu-memory-utilization ${MINERU_GPU_MEMORY_UTLIZATION} --enforce-eager --dtype float16
3)mineru -p test.jpg -o ./output/ -b vlm-http-client -u http://x.x.x.x:3000 调用时报错:
"POST /v1/chat/completions HTTP/1.1" 500 Internal Server Error ERROR:
Exception in ASGI application
(APIServer pid=17) File "/root/miniconda/envs/vllm_kunlun_0.10.1.1/lib/python3.10/site-packages/vllm/engine/multiprocessing/client.py", line 583, in _process_request
(APIServer pid=17) raise request_output
(APIServer pid=17) IndexError: list index out of range
Operating System Mode | 操作系统类型
Linux
Operating System Version| 操作系统版本
Ubuntu 22.04
Python version | Python 版本
3.10
Software version | 软件版本 (mineru --version)
>=2.5
Backend name | 解析后端
vlm
Device mode | 设备模式
No response
Source: opendatalab/MinerU