Searched refs:token_used (Results 1 – 1 of 1) sorted by relevance
1337 std::vector<bool> token_used(TokenSpanSize(inference_span)); in ModelChunk() local1343 if (token_used[i - inference_span.first]) { in ModelChunk()1355 token_used[i - inference_span.first] = true; in ModelChunk()