Searched defs:RegexTokenizer (Results 1 – 3 of 3) sorted by relevance
734 … : RegexTokenizer(StringToChar(delim_pattern), StringToChar(keep_delim_pattern), with_offsets) {} in RegexTokenizer() function
1487 class RegexTokenizer(TextTensorOperation): class
320 RegexTokenizer::RegexTokenizer(const std::vector<char> &delim_pattern, const std::vector<char> &kee… in RegexTokenizer() function in mindspore::dataset::text::RegexTokenizer