bf16 & tf32，can they be used together
Author: DSXiangLiCreated May 3, 2023Updated Feb 4, 2025
In the hyperparameter, I saw the bf16 and tf32 are both set to true. However I don't they can be used together?
Source: tatsu-lab/stanford_alpaca
In the hyperparameter, I saw the bf16 and tf32 are both set to true. However I don't they can be used together?
Source: tatsu-lab/stanford_alpaca