Searched defs:Tokenize (Results 1 – 3 of 3) sorted by relevance
116 func Tokenize(m *Map, filename string, src []byte) (tokens []Token, comments []string, retErr error… func
82 std::vector<Token> Tokenizer::Tokenize( in Tokenize() function in Tokenizer
1084 def Tokenize(self): member in Tokenizer