Searched defs:never_split (Results 1 – 1 of 1) sorted by relevance
| /third_party/mindspore/tests/st/fl/albert/src/ |
| D | tokenization.py | 77 never_split=("[UNK]", "[SEP]", "[PAD]", "[CLS]", "[MASK]")): argument
170 never_split=("[UNK]", "[SEP]", "[PAD]", "[CLS]", "[MASK]")): argument
389 …def __init__(self, do_lower_case=True, never_split=("[UNK]", "[SEP]", "[PAD]", "[CLS]", "[MASK]"),… argument
450 never_split=("[UNK]", "[SEP]", "[PAD]", "[CLS]", "[MASK]"), keywords=None): argument
537 never_split=("[UNK]", "[SEP]", "[PAD]", "[CLS]", "[MASK]"), argument
|