How to write the pre-training startup script on a single physical machine with 16 A100 cards?
Author: zhangliang605Created Feb 20, 2025Updated Feb 20, 2025
How to write the pre-training startup script on a single physical machine with 16 A100 cards?
Source: jzhang38/TinyLlama