Home
last modified time | relevance | path

Searched defs:k_num_heads (Results 1 – 2 of 2) sorted by relevance

/external/pytorch/aten/src/ATen/native/transformers/
Dsdp_utils_cpp.h215 auto k_num_heads = params.key.size(1); in check_for_seq_len_0_nested_tensor() local
348 const auto k_num_heads = params.key.sym_size(-3); in check_grouped_query_attention() local
398 auto k_num_heads = params.key.sym_size(-3); in check_batch_size_and_num_heads_dense() local
/external/pytorch/aten/src/ATen/native/nested/cuda/
DNestedTensorTransformerUtils.cpp223 const int64_t k_num_heads = key.size(1); in sdpa_nested_preprocessing_with_broadcast() local
397 const int64_t k_num_heads = key.size(1); in sdpa_nested_preprocessing() local
474 const int64_t k_num_heads = key.size(1); in sdpa_nested_preprocessing_backward() local