Searched refs:token_begin_it (Results 1 – 1 of 1) sorted by relevance
837 auto token_begin_it = context_unicode.begin(); in ICUTokenize() local843 auto token_end_it = token_begin_it; in ICUTokenize()848 for (auto char_it = token_begin_it; char_it < token_end_it; ++char_it) { in ICUTokenize()856 context_unicode.UTF8Substring(token_begin_it, token_end_it); in ICUTokenize()864 token_begin_it = token_end_it; in ICUTokenize()