#611·shell_gpt

Error Messages with local Ollama Models

Author: zuli12-devCreated Aug 13, 2024Updated Dec 25, 2025

Hi,

first of all, MANY thanks for building this great app for us! I was able to get an local ollama installation working with sgpt, ccommands and everything are working fine. However there are some Issues i cannot get to find in the issues here on github and cannot solve/get rid of it:

When using a model like DEFAULT_MODEL=ollama/llama3.1:latest or gemma2:2b i get the following erros:

❯ sgpt -s "create a folder named test, place a file in that new folder calle hello.log" mkdir test && touch test/hello.log [2024-08-13T11:12:56Z ERROR cached_path::cache] ETAG fetch for https://huggingface.co/gemma2:2b/resolve/main/tokenizer.json failed with fatal error 13:12:56 - LiteLLM:WARNING: litellm_logging.py:1302 - Model=gemma2:2b not found in completion cost map. Setting 'response_cost' to None

I also tried with ollama/llama3.1 and got the same error messages. Just to be clear, everything seems to work fine, this is just an annoying message :) However i cannot find any reference to huggingface or the messages in the src code, so i wanted to share this here.

Some Examples:

sgpt -c "python function to calculate pi"

python
def calculate_pi(iterations):
  """Calculates an approximation of Pi using the Leibniz formula.

  Args:
    iterations: The number of iterations to perform.

  Returns:
    An approximation of Pi.
  """
  pi = 0
  for i in range(iterations):
    pi += 4 / (2 * i + 1)
  return pi * 4

[2024-08-13T11:22:24Z ERROR cached_path::cache] ETAG fetch for https://huggingface.co/gemma2:2b/resolve/main/tokenizer.json failed with fatal error 13:22:24 - LiteLLM:WARNING: litellm_logging.py:1302 - Model=gemma2:2b not found in completion cost map. Setting 'response_cost' to None