Add Training Speed Datapoints for new users
Author: aflah02Created Jun 24, 2026Updated Jun 27, 2026
Labelsfeature request
I think it would be nice to let users know about expected training speeds for a few popular models across different hardware? It would allow them to compare with their existing setups.
I'm thinking of doing this with Llama 1B and 8B architectures on A100/H100 GPUs. Any feedback on what to include etc. would be great!
Source: EleutherAI/gpt-neox