Searched refs:last_unicode_index (Results 1 – 1 of 1) sorted by relevance
226 int last_unicode_index = 0; in ICUTokenize() local232 unicode_index = last_unicode_index + token_length; in ICUTokenize()250 result->push_back(Token(token, last_unicode_index, unicode_index)); in ICUTokenize()254 last_unicode_index = unicode_index; in ICUTokenize()