Searched refs:ngram_token_idx (Results 1 – 1 of 1) sorted by relevance
94 int token_idx = 0, ngram_token_idx = 0, skip_remain = 0; in IsNGramMatch() local95 for (; token_idx < num_tokens && ngram_token_idx < num_ngram_tokens;) { in IsNGramMatch()96 if (tokens[token_idx] == ngram_tokens[ngram_token_idx]) { in IsNGramMatch()99 ++ngram_token_idx; in IsNGramMatch()110 return ngram_token_idx == num_ngram_tokens; in IsNGramMatch()