Home
last modified time | relevance | path

Searched refs:context_unicode_size (Results 1 – 1 of 1) sorted by relevance

/external/libtextclassifier/native/utils/
Dtokenizer.cc241 const int context_unicode_size = context_unicode.size_codepoints(); in ICUTokenize() local
248 if (token_length + last_unicode_index > context_unicode_size) { in ICUTokenize()