Searched defs:vocab_buffer_size (Results 1 – 5 of 5) sorted by relevance
71 const size_t vocab_buffer_size) { in LoadVocabFromBuffer()86 const char* vocab_buffer_data, const size_t vocab_buffer_size) { in LoadVocabAndIndexFromBuffer()
111 const char* vocab_buffer_data, size_t vocab_buffer_size) { in CreateBertQuestionAnswererFromBuffer()374 const char* vocab_buffer_data, size_t vocab_buffer_size) { in InitializeBertTokenizerFromBinary()
56 size_t vocab_buffer_size) in RegexTokenizer()
109 utils::LoadVocabFromBuffer(vocab_buffer_data, vocab_buffer_size), in BertTokenizer() argument
100 : BertTokenizer(LoadVocabFromBuffer(vocab_buffer_data, vocab_buffer_size), in BertTokenizer() argument