Searched refs:build_nccl_then_ring (Results 1 – 2 of 2) sorted by relevance
396 summed_grads = all_reduce.build_nccl_then_ring(scaled_grads, num_shards,
773 def build_nccl_then_ring(input_tensors, subdiv, red_op, un_op=None): function