Searched defs:UnicodeScriptTokenizer (Results 1 – 2 of 2) sorted by relevance
841 class UnicodeScriptTokenizer(TextTensorOperation): class
422 UnicodeScriptTokenizer::UnicodeScriptTokenizer(bool keep_whitespace, bool with_offsets) in UnicodeScriptTokenizer() function in mindspore::dataset::text::UnicodeScriptTokenizer