Searched defs:all_reduce (Results 1 – 6 of 6) sorted by relevance
19 all_reduce = P.AllReduce().add_prim_attr("fusion", 1) variable
21 all_reduce = P.AllReduce() variable
189 AnfNodePtr all_reduce = NewCNode({all_reduce_prim, add}, fg); in operator ()() local
135 def all_reduce(tensor, op=ReduceOp.SUM, group=GlobalComm.WORLD_COMM_GROUP): function
322 auto all_reduce = VectorRef({is_all_reduce, matmul2}); in DefinePatternMoEFfn() local418 auto all_reduce = VectorRef({is_all_reduce, matmul2}); in DefinePatternSigmaFfn() local535 auto all_reduce = VectorRef({is_all_reduce, matmul2}); in DefinePatternEncoderAlpha() local
553 auto all_reduce = VectorRef({is_all_reduce, matmul3}); in DefinePatternPangu() local