Home
last modified time | relevance | path

Searched refs:token_end_unicode (Results 1 – 1 of 1) sorted by relevance

/external/libtextclassifier/native/annotator/
Dfeature-processor.cc226 const UnicodeText token_end_unicode = in LabelToSpan() local
228 UnicodeText::const_iterator token_end = token_end_unicode.end(); in LabelToSpan()
234 CountIgnoredSpanBoundaryCodepoints(token_end_unicode.begin(), token_end, in LabelToSpan()