Request for Gemma 3 4B & Gemma 4 Integration Support with llama-cpp-python

Author: LeConsulat2Created May 25, 2026Updated Sep 6, 2026

Hi team,

I would like to request official support and documentation for Gemma 3 4B and Gemma 4 integration within llama-cpp-python.

It would be helpful to have clarification regarding:

  • Current compatibility status
  • Required llama.cpp / llama-cpp-python versions
  • Chat template handling requirements
  • Recommended GGUF formats and quantizations
  • Known limitations or issues
  • Recommended inference parameters for stable usage

Any guidance, implementation notes, or examples would be greatly appreciated (without using ollama)

Kind regards, Jonathan Park

Source: abetlen/llama-cpp-python