#1395·gpt-neox

Add Training Speed Datapoints for new users

Author: aflah02Created Jun 24, 2026Updated Jun 27, 2026
Labelsfeature request

I think it would be nice to let users know about expected training speeds for a few popular models across different hardware? It would allow them to compare with their existing setups.

I'm thinking of doing this with Llama 1B and 8B architectures on A100/H100 GPUs. Any feedback on what to include etc. would be great!