#654·mergekit

Gated MOE - 4 bit bug

Author: David-AU-githubCreated Dec 15, 2025Updated Mar 17, 2026

When attempting to create a GATED moe ("hidden") ; received a 4 bit error from bits and bytes.

Corrected via edit to:

https://github.com/arcee-ai/mergekit/tree/main/mergekit/moe/router.py

commented out lines:

122, and 123

Seems to be an issue with 4bit/8 bit defaults change(s).

Once commented out and regen MERGEKIT - > no issues.