#49237·transformers

训练器将 GradScaler 跳过的 fp16 步骤视为已完成的更新步骤(`global_step`,`max_steps`,`on_optimizer_step`)

作者: SeverinVisionary创建于 2026年10月1日更新于 2026年10月2日

"""HF Trainer fp16: a GradScaler-skipped update is counted in state.global_step, fires on_optimizer_step/on_step_end, and counts toward max_steps. On CUDA run as-is; on CPU a GradScaler is installed on the Accelerator to emulate the CUDA fp16 path (CPU fp16 otherwise creates no scaler).""" import tempfile, torch from transformers import Trainer, TrainingArguments, TrainerCallback

内容来源: huggingface/transformers