Searched defs:regex_tokenizer (Results 1 – 3 of 3) sorted by relevance
| /third_party/mindspore/mindspore-src/source/tests/ut/python/dataset/ |
| D | test_text_tokenizer.py | 327 def regex_tokenizer(first, last, expect_str, delim_pattern, keep_delim_pattern): function
360 …def regex_tokenizer(first, last, expect_str, expected_offsets_start, expected_offsets_limit, delim… function
|
| /third_party/mindspore/mindspore-src/source/mindspore/ccsrc/minddata/dataset/api/python/bindings/dataset/text/kernels/ir/ |
| D | bindings.cc | 116 auto regex_tokenizer = in __anon2bada04b0f02() local
|
| /third_party/mindspore/mindspore-src/source/tests/ut/cpp/dataset/ |
| D | c_api_text_test.cc | 2743 …std::shared_ptr<TensorTransform> regex_tokenizer = std::make_shared<text::RegexTokenizer>("\\s+", … in TEST_F() local
2802 …std::shared_ptr<TensorTransform> regex_tokenizer = std::make_shared<text::RegexTokenizer>("\\s+", … in TEST_F() local
|