Home
last modified time | relevance | path

Searched defs:basic_start (Results 1 – 1 of 1) sorted by relevance

/third_party/mindspore/mindspore-src/source/mindspore/ccsrc/minddata/dataset/text/kernels/
Dwordpiece_tokenizer_op.cc57 …tus WordpieceTokenizerOp::FoundNoToken(const std::string &input_token, const uint32_t &basic_start, in FoundNoToken()
84 Status WordpieceTokenizerOp::GetTokens(const std::string &input_token, const uint32_t &basic_start, in GetTokens()
129 uint32_t basic_start = 0; in Compute() local