Home
last modified time | relevance | path

Searched defs:unknown_token_id (Results 1 – 2 of 2) sorted by relevance

/external/tflite-support/tensorflow_lite_support/cc/text/tokenizers/
Dtokenizer_utils.cc92 int unknown_token_id = 0; in CreateTokenizerFromProcessUnit() local
/external/tflite-support/tensorflow_lite_support/cc/task/text/nlclassifier/
Dnl_classifier.cc122 int unknown_token_id = 0; in CreateRegexTokenizerFromProcessUnit() local
236 int unknown_token_id = 0; in Preprocess() local