Home
last modified time | relevance | path

Searched refs:BuildTokenizer (Results 1 – 5 of 5) sorted by relevance

/external/libtextclassifier/native/annotator/grammar/
Dutils.h29 Tokenizer BuildTokenizer(const UniLib* unilib,
Dutils.cc28 Tokenizer BuildTokenizer(const UniLib* unilib, in BuildTokenizer() function
Dgrammar-annotator.cc84 tokenizer_(BuildTokenizer(unilib, model->tokenizer_options())), in GrammarAnnotator()
/external/libtextclassifier/native/annotator/
Dfeature-processor.h44 Tokenizer BuildTokenizer(const FeatureProcessorOptions* options,
113 tokenizer_(internal::BuildTokenizer(options, unilib)) { in FeatureProcessor()
Dfeature-processor.cc31 Tokenizer BuildTokenizer(const FeatureProcessorOptions* options, in BuildTokenizer() function