#600·GPTCache

[Bug]: benchmark script

Author: songseyCreated Jan 15, 2024Updated Aug 30, 2026

Current Behavior

The llm adapter does not fail but it only to generate directly from llm when the similarity threshold is close enough to the maximum distance. It means what you get is either a positive or a negative hit. There is no cache miss. So I'm not sure what it is trying to do with try-except block in the code below ?

https://github.com/zilliztech/GPTCache/blob/main/examples/benchmark/benchmark_sqlite_faiss_onnx.py

Can you update for the benchmark code that you used to generate the figures in the report in the examples folder ?

Expected Behavior

No response

Steps To Reproduce

No response

Environment

No response

Anything else?

No response