Home
last modified time | relevance | path

Searched refs:last_unicode_index (Results 1 – 1 of 1) sorted by relevance

/external/libtextclassifier/
Dfeature-processor.cc835 int last_unicode_index = 0; in ICUTokenize() local
841 unicode_index = last_unicode_index + token_length; in ICUTokenize()
859 result->push_back(Token(token, last_unicode_index, unicode_index)); in ICUTokenize()
863 last_unicode_index = unicode_index; in ICUTokenize()