1.. role:: hidden 2 :class: hidden-section 3 4Distributed Optimizers 5====================== 6 7.. warning :: 8 Distributed optimizer is not currently supported when using CUDA tensors 9 10.. automodule:: torch.distributed.optim 11 :members: DistributedOptimizer, PostLocalSGDOptimizer, ZeroRedundancyOptimizer 12