examples · Issues· 253 open

Example code (mnist) does not work under torch.utils.bottleneck

improvement for examples/mnist_forward_forward

torch.multiprocessing subprocess receives tensor with zeros rather than actual data

Update all examples to latest versions of pytorch

word_language_model with torch.nn.modules.transformer

Add nn.SyncBatchNorm in ImageNet example

examples/language_translation/src/data.py Code iterators will fail.

fsdp2 example.py: checkpoint error

Can not fetch mnist data set

https://github.com/pytorch/examples/blob/main/distributed/FSDP/utils/environment.py

tensor_parallel_example.py and sequence_parallel_example.py

mnist example contains bad practices leading to wrongful results

minGPT example does not verify the GPU count across all nodes

FSDP2 mixed precision example is misleading, assertions are ineffective

fsdp2 example unsharded_param.grad zero