Searched defs:replica_grads (Results 1 – 1 of 1) sorted by relevance
38 def aggregate_gradients_using_nccl(replica_grads): argument52 def aggregate_gradients_using_hierarchical_copy(avail_devices, replica_grads): argument420 def sum_gradients_all_reduce(dev_prefixes, replica_grads, num_workers, alg, argument557 def pack_small_tensors(replica_grads, max_bytes=0, max_group=0): argument613 def unpack_small_tensors(replica_grads, packing): argument