Home
last modified time | relevance | path

Searched refs:icu_preserve_whitespace_tokens_ (Results 1 – 2 of 2) sorted by relevance

/external/libtextclassifier/utils/
Dtokenizer.cc37 icu_preserve_whitespace_tokens_(icu_preserve_whitespace_tokens) { in Tokenizer()
249 if (!is_whitespace || icu_preserve_whitespace_tokens_) { in ICUTokenize()
Dtokenizer.h119 const bool icu_preserve_whitespace_tokens_; variable