Searched refs:_tokenize_js (Results 1 – 2 of 2) sorted by relevance
14 tokens = list(parse_deps._tokenize_js(''))18 tokens = list(parse_deps._tokenize_js('\n'))22 tokens = list(parse_deps._tokenize_js('A // foo'))26 tokens = list(parse_deps._tokenize_js("""A // foo32 tokens = list(parse_deps._tokenize_js("""A /* foo */"""))36 tokens = list(parse_deps._tokenize_js("""A /* foo
97 def _tokenize_js(text): function120 token_stream = _tokenize_js(text).__iter__()