Searched refs:FindSpecialWordpieceIds (Results 1 – 1 of 1) sorted by relevance
142 bool FindSpecialWordpieceIds(const std::unique_ptr<BertTokenizer> &tokenizer, in FindSpecialWordpieceIds() function193 if (!FindSpecialWordpieceIds(tokenizer, &cls_id, &sep_id, &period_id, in Create()