Searched refs:whitespace_transform (Results 1 – 2 of 2) sorted by relevance
32 WhitespaceTransform whitespace_transform =58 WhitespaceTransform whitespace_transform);
73 WhitespaceTransform whitespace_transform) in Tokenizer() argument77 whitespace_transform_(whitespace_transform) {} in Tokenizer()85 WhitespaceTransform whitespace_transform) { in Tokenize() argument86 Tokenizer t(input_file, err, whitespace_transform); in Tokenize()