[FEATURE REQUEST] Ollama compatibility
Author: jb-reeferCreated Feb 19, 2024Updated Jul 4, 2024
It looks like there's a repo that gets close - https://github.com/anaisbetts/TypeChat/tree/main - but now that Ollama has OpenAI API compatibility, it would be great to have on-device LLMs supported.
I took a crack at it but couldn't hack it in an hour or so, so filing this.
Source: microsoft/TypeChat