Home
last modified time | relevance | path

Searched defs:token_text (Results 1 – 3 of 3) sorted by relevance

/external/libtextclassifier/native/utils/
Dtokenizer-utils.h79 const std::string token_text = UnicodeText::UTF8Substring(start_it, it); in TokenizeWithFilter() local
96 const std::string token_text = in TokenizeWithFilter() local
/external/libtextclassifier/native/annotator/number/
Dnumber.cc197 bool NumberAnnotator::TryParseNumber(const UnicodeText& token_text, in TryParseNumber()
233 const UnicodeText token_text = in FindAll() local
/external/libtextclassifier/native/annotator/pod_ner/
Dpod-ner-impl.cc359 const std::string token_text = in PrepareText() local