Searched refs:internal_tokenizer_codepoint_ranges_ (Results 1 – 2 of 2) sorted by relevance
144 std::vector<CodepointRangeStruct> internal_tokenizer_codepoint_ranges_; variable
52 &internal_tokenizer_codepoint_ranges_); in Tokenizer()212 internal_tokenizer_codepoint_ranges_)) { in InternalRetokenize()