#476·Amphion

[BUG]: VevoSing AR 推理崩溃——生成的令牌 ID 为 17925 (BOS) 在流匹配中触发 CUDA OOB 错误

作者: Arain233创建于 2026年1月16日更新于 2026年1月26日
标签bug

Hi, thank you for the great work on Amphion and VevoSing. I am currently trying to reproduce the VevoSing inference pipeline using the provided pretrained models. During the AR inference stage (inference_ar_and_fm), I encountered a RuntimeError: CUDA error: device-side assert triggered. After debugging, I found that the AR model generates out-of-bound token IDs (specifically 17925) in predicted_coco_codecs. When these tokens are passed to the Flow Matching model's embedding layer (self.fmt_model.cond_emb), which has an embedding size of 16384, it causes an index out of bounds error.

内容来源: open-mmlab/Amphion