Qwen3 MoE 错误
作者: ehristoforu创建于 2025年9月7日更新于 2026年2月4日
我的配置:
base_model: Qwen/Qwen3-1.7B
architecture: Qwen
gate_mode: hidden
experts_per_token: 2
dtype: bfloat16
experts:
- source_model: Qwen/Qwen3-1.7B
positive_prompts:
- "chat"
- "assistant"
- "tell me"
- "explain"
- source_model: Qwen/Qwen3-1.7B-Base
positive_prompts:
- "write a story"
- "compose an email"
- "create a blog post"
- "generate a report"输出:
[2025-09-07 16:16:40] [INFO] Running mergekit-moe config.yaml merge --copy-tokenizer --allow-crimes --lazy-unpickle --lora-merge-cache /tmp/tmpihbkppto/.lora_cache --out-shard-size 5B
[2025-09-07 16:16:44] [INFO] ERROR:root:没有找到与给定模型兼容的输出架构。
[2025-09-07 16:16:44] [INFO] ERROR:root:所有支持的输出架构:
[2025-09-07 16:16:44] [INFO] ERROR:root: * Mixtral
[2025-09-07 16:16:44] [INFO] ERROR:root: * DeepSeek MoE
[2025-09-07 16:16:44] [INFO] ERROR:root: * Qwen MoE内容来源: arcee-ai/mergekit