Searched refs:token_begin_it (Results 1 – 1 of 1) sorted by relevance
228 auto token_begin_it = context_unicode.begin(); in ICUTokenize() local234 auto token_end_it = token_begin_it; in ICUTokenize()239 for (auto char_it = token_begin_it; char_it < token_end_it; ++char_it) { in ICUTokenize()247 context_unicode.UTF8Substring(token_begin_it, token_end_it); in ICUTokenize()255 token_begin_it = token_end_it; in ICUTokenize()