MiniMax M2.7: AttributeError: 'LlamafileMoEWrapper' object has no attribute 'submit_write_weight_scale_to_buffer'

Author: mrgaoleiCreated Jul 31, 2026Updated Aug 5, 2026

Reminder

  • I have read the above rules and searched the existing issues.

System Info

AMD 7k62 with avx2 DDR4 256G 4090 48G *2

Ubuntu 24.04 miniconda kt 0.6.4

Reproduction

/home/aigao/miniconda3/envs/kt-kernel/bin/python3 -m sglang.launch_server   --host 0.0.0.0 --port 30000   --model /home/aigao/models/MiniMax-M2.7   --kt-weight-path /home/aigao/models/MiniMax-M2.7-GGUF/UD-Q4_K_M   --kt-cpuinfer 76   --kt-threadpool-count 1   --kt-num-gpu-experts 8   --kt-method LLAMAFILE   --kt-gpu-prefill-token-threshold 500   --kt-enable-dynamic-expert-update   --attention-backend flashinfer   --trust-remote-code   --mem-fraction-static 0.9   --chunked-prefill-size 32768   --max-running-requests 1   --max-total-tokens 32768   --watchdog-timeout 3000   --enable-mixed-chunk   --tensor-parallel-size 2   --enable-p2p-check   --disable-shared-experts-fusion
  File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/fused_moe_triton/layer.py", line 998, in forward
    return self.forward_impl(hidden_states, topk_output)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/fused_moe_triton/layer.py", line 1017, in forward_impl
    combine_input = self.run_moe_core(
                    ^^^^^^^^^^^^^^^^^^
  File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/fused_moe_triton/layer.py", line 1038, in run_moe_core
    return self.quant_method.apply(
           ^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/kt_ep_wrapper.py", line 2959, in apply
    ctx = self._build_full_context(layer)
          ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/kt_ep_wrapper.py", line 3319, in _build_full_context
    _SHARED_FULL_CONTEXT.load(
  File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/kt_ep_wrapper.py", line 1678, in load
    self._prepare_weight_fp8(wrapper, None, gpu_experts_mask,
  File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/kt_ep_wrapper.py", line 1181, in _prepare_weight_fp8
    submit_write_expert(cpu_expert_ids[0], 0)
  File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/kt_ep_wrapper.py", line 1171, in submit_write_expert
    wrapper.submit_write_weight_scale_to_buffer(
    ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'LlamafileMoEWrapper' object has no attribute 'submit_write_weight_scale_to_buffer'

[2026-07-31 14:22:09] SIGQUIT received. signum=None, frame=None. It usually means one child failed.
已杀死```


### Others

看起来是sglang没有针对纯avx2进行优化。请问我要切换到sglang的那个版本可以兼容纯avx2的CPU?

Source: kvcache-ai/ktransformers