Searched refs:PSTokenizer (Results 1 – 1 of 1) sorted by relevance
47 class PSTokenizer(object): class182 tokenizer = self.tokenizer = PSTokenizer(data, self.encoding)