Searched defs:UnicodeScriptTokenizer (Results 1 – 2 of 2) sorted by relevance
1566 class UnicodeScriptTokenizer(TextTensorOperation): class
465 UnicodeScriptTokenizer::UnicodeScriptTokenizer(bool keep_whitespace, bool with_offsets) in UnicodeScriptTokenizer() function in mindspore::dataset::text::UnicodeScriptTokenizer