#626·mergekit

Qwen3 MoE 错误

作者: ehristoforu创建于 2025年9月7日更新于 2026年2月4日

我的配置:

base_model: Qwen/Qwen3-1.7B
architecture: Qwen
gate_mode: hidden
experts_per_token: 2
dtype: bfloat16
experts:
  - source_model: Qwen/Qwen3-1.7B
    positive_prompts:
    - "chat"
    - "assistant"
    - "tell me"
    - "explain"
  - source_model: Qwen/Qwen3-1.7B-Base
    positive_prompts:
    - "write a story"
    - "compose an email"
    - "create a blog post"
    - "generate a report"

输出:

[2025-09-07 16:16:40] [INFO] Running mergekit-moe config.yaml merge --copy-tokenizer --allow-crimes --lazy-unpickle --lora-merge-cache /tmp/tmpihbkppto/.lora_cache --out-shard-size 5B
[2025-09-07 16:16:44] [INFO] ERROR:root:没有找到与给定模型兼容的输出架构。
[2025-09-07 16:16:44] [INFO] ERROR:root:所有支持的输出架构:
[2025-09-07 16:16:44] [INFO] ERROR:root:  * Mixtral
[2025-09-07 16:16:44] [INFO] ERROR:root:  * DeepSeek MoE
[2025-09-07 16:16:44] [INFO] ERROR:root:  * Qwen MoE

内容来源: arcee-ai/mergekit