Home
last modified time | relevance | path

Searched refs:stripped_token (Results 1 – 1 of 1) sorted by relevance

/external/libtextclassifier/native/annotator/vocab/
Dvocab-annotator-impl.cc105 const UnicodeText stripped_token = UnicodeText::Substring( in ClassifyTextInternal() local
108 unilib_.ToLowerText(stripped_token).ToUTF8String(); in ClassifyTextInternal()
115 unilib_.IsUpper(*stripped_token.begin())) { in ClassifyTextInternal()