Home
last modified time | relevance | path

Searched defs:token_generator (Results 1 – 3 of 3) sorted by relevance

/external/icing/icing/
Dicing-search-engine_flush_benchmark.cc161 token_generator(language, &random); in BM_FlushBenchmark() local
Dicing-search-engine_benchmark.cc173 token_generator(language, &random); in GenerateRandomDocuments() local
398 token_generator(language, &random); in BM_MutlipleIndices() local
/external/python/cpython3/Lib/test/
Dtest_tokenize.py18 def stringify_tokens_from_source(token_generator, source_string): argument