[DOC]: How to use sgd optimizer?
Author: fancyeriiCreated Nov 10, 2023Updated Sep 1, 2026
Labelsdocumentation
The doc issue
I want to replace adam with sgd in Colossal-LLaMA-2 because I don't have enough gpu but have time to adjust hyper-parameters. Is there any examples of sgd optimizer?
Source: hpcaitech/ColossalAI