Searched refs:AutoUpdatingDetokenizer (Results 1 – 4 of 4) sorted by relevance
16 from pw_tokenizer.detokenize import AutoUpdatingDetokenizer, Detokenizer
211 class AutoUpdatingDetokenizer: class261 _Detokenizer = Union[Detokenizer, AutoUpdatingDetokenizer]
410 detok = detokenize.AutoUpdatingDetokenizer(file.name,434 detok = detokenize.AutoUpdatingDetokenizer(file,
789 The ``pw_tokenizer`` package also provides the ``AutoUpdatingDetokenizer``