Searched defs:prompt_token_batch_size (Results 1 – 3 of 3) sorted by relevance
22 size_t prompt_token_batch_size = 1; member
182 const auto prompt_token_batch_size = llama_runtime.GetTokenBatchSize(); in digest_prompt() local
191 const auto prompt_token_batch_size = llama_runtime.GetTokenBatchSize(); in digest_prompt() local