Searched refs:token_prefixes (Results 1 – 1 of 1) sorted by relevance
146 std::vector<absl::string_view> token_prefixes; in FindSkipgrams() local158 token_prefixes.emplace_back(token.data(), token.size() - n); in FindSkipgrams()188 for (const auto& token_prefix : token_prefixes) { in FindSkipgrams()