Searched defs:tokenizer (Results 1 – 3 of 3) sorted by relevance
27 Tokenizer tokenizer; member
145 DirectiveParser::DirectiveParser(Tokenizer *tokenizer, in DirectiveParser()
413 lunr.tokenizer = function (obj, metadata) { function in lunr