如何使用"Gemma-4-E4B-it-heretic-GGUF"?
作者: TimmyHeart创建于 2026年4月6日更新于 2026年6月11日
Hi I'm currently tried every models possible from Qwen3.5-9B-Claude-4.6-Opus-abliterated to c4ai-command-r7b but since the Gemma-4-E4B just released, I found it interesting and I want do some research with it but I couldn't get it to work the way I want it to. When I ask it to translate stuffs or asking to help about any project, it would just spamming stuffs or just analyze feelings, explaining nonsenses. Unlike via Koboldcpp, it worked smoothly and could answering me correctly but I want to use it on Python only not Koboldcpp. Any assistant would be appreciated! Below is my code
内容来源: abetlen/llama-cpp-python