Home
last modified time | relevance | path

Searched defs:num_heads_k (Results 1 – 1 of 1) sorted by relevance

/external/pytorch/aten/src/ATen/native/transformers/cuda/flash_attn/
Dflash_api.cpp393 const int num_heads_k = k.size(2); in mha_fwd() local
606 const int num_heads_k = paged_KV ? k.size(2) : k.size(1); in mha_varlen_fwd() local
870 const int num_heads_k = k.size(2); in mha_bwd() local
1092 const int num_heads_k = k.size(1); in mha_varlen_bwd() local
1318 const int num_heads_k = kcache.size(2); in mha_fwd_kvcache() local