Searched refs:InternalRetokenize (Results 1 – 2 of 2) sorted by relevance
119 void InternalRetokenize(const UnicodeText& unicode_text,
114 InternalRetokenize(text_unicode, &result); in Tokenize()202 void Tokenizer::InternalRetokenize(const UnicodeText& unicode_text, in InternalRetokenize() function in libtextclassifier3::Tokenizer