Searched defs:normalization_form (Results 1 – 4 of 4) sorted by relevance
| /third_party/mindspore/mindspore-src/source/tests/ut/python/dataset/ |
| D | test_text_basic_tokenizer.py | 71 … normalization_form=text.utils.NormalizeForm.NONE, preserve_unused_token=False): argument
95 … normalization_form=text.utils.NormalizeForm.NONE, preserve_unused_token=False): argument
|
| D | test_text_bert_tokenizer.py | 175 normalization_form=text.utils.NormalizeForm.NONE, argument
204 normalization_form=text.utils.NormalizeForm.NONE, argument
|
| /third_party/mindspore/mindspore-src/source/mindspore/ccsrc/minddata/dataset/text/kernels/ |
| D | basic_tokenizer_op.cc | 52 … const NormalizeForm &normalization_form, const bool &preserve_unused_token, in BasicTokenizerOp()
|
| /third_party/mindspore/mindspore-src/source/mindspore/python/mindspore/dataset/text/ |
| D | transforms.py | 1156 … def __init__(self, lower_case=False, keep_whitespace=False, normalization_form=NormalizeForm.NONE, argument
1272 lower_case=False, keep_whitespace=False, normalization_form=NormalizeForm.NONE, argument
|