Searched refs:token_match_start (Results 1 – 1 of 1) sorted by relevance
91 std::unordered_map<CodepointIndex, CodepointIndex> token_match_start; in SortedSymbolsForInput() local97 token_match_start[token_start] = prev_token_end; in SortedSymbolsForInput()160 MapCodepointToTokenPaddingIfPresent(token_match_start, span.first), in SortedSymbolsForInput()174 MapCodepointToTokenPaddingIfPresent(token_match_start, in SortedSymbolsForInput()