Searched refs:ngram_token_idx (Results 1 – 1 of 1) sorted by relevance
96 int token_idx = 0, ngram_token_idx = 0, skip_remain = 0; in IsNGramMatch() local97 for (; token_idx < num_tokens && ngram_token_idx < num_ngram_tokens;) { in IsNGramMatch()98 if (tokens[token_idx] == ngram_tokens[ngram_token_idx]) { in IsNGramMatch()101 ++ngram_token_idx; in IsNGramMatch()112 return ngram_token_idx == num_ngram_tokens; in IsNGramMatch()