🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference a
🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference a
AutoTokenizer with tokenizer_class=LlamaTokenizerFast silently builds a sentencepiece pipeline for a byte-level BPE tokenizer.json, dropping all CJK input
Encoder repetition penalty uses incorrect source rows after beam or sampled-return expansion
ExponentialDecayLengthPenalty creates NaN EOS scores when combined with minimum-length constraints
[eager MOE] Selected expert IDs should probably not be treated as 0-d GPU tensors
RoPE corruption due to TF32 on B200 (possibly others) when using `torch.set_float32_matmul_precision("high")`
Rename `gradient_checkpointing` to `activation_checkpointing` in the next major
Trainer counts fp16 steps skipped by GradScaler as completed update steps (`global_step`, `max_steps`, `on_optimizer_step`)
[serge] integration failure triage - 2026-10-01
Right-padded prefill produces a corrupted cache in Mamba-family models (zero conv state, decayed SSM state)
Native TP does not shard qwen3_vl_moe experts (weights fully replicated per rank)