AttributeError: 'DeepSpeedZeRoOffload' object has no attribute 'backward'
Author: lizhidomgCreated May 11, 2023Updated Jan 31, 2024
File "finetune_moss.py", line 241, in train accelerator.backward(loss) 代码运行到这一行报错， AttributeError: 'DeepSpeedZeRoOffload' object has no attribute 'backward'
Source: OpenMOSS/MOSS