Home
last modified time | relevance | path

Searched defs:token_unicode (Results 1 – 2 of 2) sorted by relevance

/external/libtextclassifier/native/utils/
Dtoken-feature-extractor.cc110 UnicodeText token_unicode = in ExtractDenseFeatures() local
140 UnicodeText token_unicode = in ExtractDenseFeatures() local
/external/libtextclassifier/native/utils/grammar/parsing/
Dlexer.cc35 UnicodeText token_unicode = UTF8ToUnicodeText(value.data(), value.size(), in AppendTokenSymbols() local