Home
last modified time | relevance | path

Searched defs:SentencePieceTokenizerOp (Results 1 – 1 of 1) sorted by relevance

/third_party/mindspore/mindspore/ccsrc/minddata/dataset/text/kernels/
Dsentence_piece_tokenizer_op.cc27 SentencePieceTokenizerOp::SentencePieceTokenizerOp(const std::shared_ptr<SentencePieceVocab> vocab, in SentencePieceTokenizerOp() function in mindspore::dataset::SentencePieceTokenizerOp
40 SentencePieceTokenizerOp::SentencePieceTokenizerOp(const std::string &model_path, const std::string… in SentencePieceTokenizerOp() function in mindspore::dataset::SentencePieceTokenizerOp