LangChain + xinference LLM.with_structured_output 在高并发情况下会发生概率性错误报告

Traceback (most recent call last): File "/xxxx/xxxx.py", line 130, in classification_execution final_answer = structured_llm.invoke(messages) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/xxxx/site-packages/langchain_core/runnables/base.py", line 3149, in invoke input_ = context.run(step.invoke, input_, config, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/xxxx/lib/python3.12/site-packages/langchain_core/language_models/chat_models.py", line 402, in invoke self.generate_prompt( File "/xxxx/lib/python3.12/site-packages/langchain_core/language_models/chat_models.py", line 1121, in generate_prompt return self.generate(prompt_messages, stop=stop, callbacks=callbacks, **kwargs) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/xxxx/site-packages/langchain_core/language_models/chat_models.py", line 931, in generate self._generate_with_cache( File "/xxxx/lib/python3.12/site-packages/langchain_core/language_models/chat_models.py", line 1225, in _generate_with_cache result = self._generate( ^^^^^^^^^^^^^^^ File "/xxxx/lib/python3.12/site-packages/langchain_xinference/chat_models.py", line 226, in _generate final_chunk = self._chat_with_aggregation( ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/xxxx/lib/python3.12/site-packages/langchain_xinference/chat_models.py", line 310, in _chat_with_aggregation for stream_resp in response: ^^^^^^^^ File "/xxxx/lib/python3.12/site-packages/xinference/client/common.py", line 62, in streaming_response_iterator raise Exception(str(error)) Exception: [address=127.0.0.1:39175, pid=167075] Expecting ',' delimiter: line 3 column 1 (char 120)