Searched refs:FindTokenizationRange (Results 1 – 3 of 3) sorted by relevance
101 const TokenizationCodepointRangeT* FindTokenizationRange(int codepoint) const;
59 const TokenizationCodepointRangeT* Tokenizer::FindTokenizationRange( in FindTokenizationRange() function in libtextclassifier3::Tokenizer87 const TokenizationCodepointRangeT* range = FindTokenizationRange(codepoint); in GetScriptAndRole()
43 using Tokenizer::FindTokenizationRange;86 tokenizer_->FindTokenizationRange(c); in TestFindTokenizationRole()104 TEST(TokenizerTest, FindTokenizationRange) { in TEST() argument