Nonsense output
Hobbyist only here, hoping for some help.
I'm running Windows 11, miniforge3, Ollama 0.5.1-ipexllm-20250123, Ubuntu 22.04, using Openwebui via Docker Desktop on the front. I have a Ryzen 9 5950X CPU, 64 GB system RAM, an a770 w/ 16GB VRAM.
Installed Ollama using instructions https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Quickstart/ollama_quickstart.md and https://github.com/intel/ipex-llm/blob/main/docs/mddocs/Quickstart/llama_cpp_quickstart.md
The output attached is using the model Deepseek-r1:7b but I can get similar symptoms with other models.
The symptom is that I am getting gibberish output from even fairly simple prompts. My experience has been that this is most often after my first question, or after switching models, but it is in fact quite random.
Attaching my miniforge prompt and screenshots of the open webui output.
Source: intel/ipex-llm