Home
last modified time | relevance | path

Searched refs:remove_extra_whitespaces (Results 1 – 5 of 5) sorted by relevance

/external/libtextclassifier/utils/sentencepiece/
Dtest_utils.cc29 bool remove_extra_whitespaces, in NormalizerFromSpec() argument
39 add_dummy_prefix, remove_extra_whitespaces, escape_whitespaces); in NormalizerFromSpec()
Dnormalizer.h47 bool remove_extra_whitespaces = true,
52 remove_extra_whitespaces_(remove_extra_whitespaces), in charsmap_trie_()
Dtest_utils.h30 bool remove_extra_whitespaces,
/external/libtextclassifier/utils/tflite/
Dtext_encoder_config.fbs53 remove_extra_whitespaces:bool = true;
Dtext_encoder.cc99 config->add_dummy_prefix(), config->remove_extra_whitespaces(), in Initialize()