Home
last modified time | relevance | path

Searched defs:vocab_id (Results 1 – 6 of 6) sorted by relevance

/external/tflite-support/tensorflow_lite_support/cc/text/tokenizers/
Dsentencepiece_tokenizer.h60 bool LookupWord(int vocab_id, absl::string_view* result) const override { in LookupWord()
Dbert_tokenizer.cc49 bool FlatHashMapBackedWordpiece::LookupWord(int vocab_id, in LookupWord()
Dregex_tokenizer.cc101 bool RegexTokenizer::LookupWord(int vocab_id, absl::string_view* result) const { in LookupWord()
Dbert_tokenizer.h131 bool LookupWord(int vocab_id, absl::string_view* result) const override { in LookupWord()
/external/libtextclassifier/native/utils/
Dbert_tokenizer.h135 bool LookupWord(int vocab_id, absl::string_view* result) const override { in LookupWord()
Dbert_tokenizer.cc67 bool FlatHashMapBackedWordpiece::LookupWord(int vocab_id, in LookupWord()