MiniMax M2.7: AttributeError: 'LlamafileMoEWrapper' object has no attribute 'submit_write_weight_scale_to_buffer'
Author: mrgaoleiCreated Jul 31, 2026Updated Aug 5, 2026
Reminder
- I have read the above rules and searched the existing issues.
System Info
AMD 7k62 with avx2 DDR4 256G 4090 48G *2
Ubuntu 24.04 miniconda kt 0.6.4
Reproduction
/home/aigao/miniconda3/envs/kt-kernel/bin/python3 -m sglang.launch_server --host 0.0.0.0 --port 30000 --model /home/aigao/models/MiniMax-M2.7 --kt-weight-path /home/aigao/models/MiniMax-M2.7-GGUF/UD-Q4_K_M --kt-cpuinfer 76 --kt-threadpool-count 1 --kt-num-gpu-experts 8 --kt-method LLAMAFILE --kt-gpu-prefill-token-threshold 500 --kt-enable-dynamic-expert-update --attention-backend flashinfer --trust-remote-code --mem-fraction-static 0.9 --chunked-prefill-size 32768 --max-running-requests 1 --max-total-tokens 32768 --watchdog-timeout 3000 --enable-mixed-chunk --tensor-parallel-size 2 --enable-p2p-check --disable-shared-experts-fusion File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/fused_moe_triton/layer.py", line 998, in forward
return self.forward_impl(hidden_states, topk_output)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/fused_moe_triton/layer.py", line 1017, in forward_impl
combine_input = self.run_moe_core(
^^^^^^^^^^^^^^^^^^
File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/fused_moe_triton/layer.py", line 1038, in run_moe_core
return self.quant_method.apply(
^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/kt_ep_wrapper.py", line 2959, in apply
ctx = self._build_full_context(layer)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/kt_ep_wrapper.py", line 3319, in _build_full_context
_SHARED_FULL_CONTEXT.load(
File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/kt_ep_wrapper.py", line 1678, in load
self._prepare_weight_fp8(wrapper, None, gpu_experts_mask,
File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/kt_ep_wrapper.py", line 1181, in _prepare_weight_fp8
submit_write_expert(cpu_expert_ids[0], 0)
File "/home/aigao/miniconda3/envs/kt-kernel/lib/python3.11/site-packages/sglang/srt/layers/moe/kt_ep_wrapper.py", line 1171, in submit_write_expert
wrapper.submit_write_weight_scale_to_buffer(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
AttributeError: 'LlamafileMoEWrapper' object has no attribute 'submit_write_weight_scale_to_buffer'
[2026-07-31 14:22:09] SIGQUIT received. signum=None, frame=None. It usually means one child failed.
已杀死```
### Others
看起来是sglang没有针对纯avx2进行优化。请问我要切换到sglang的那个版本可以兼容纯avx2的CPU?Source: kvcache-ai/ktransformers