Searched refs:TestFindTokenizationRole (Results 1 – 1 of 1) sorted by relevance
84 TokenizationCodepointRange_::Role TestFindTokenizationRole(int c) const { in TestFindTokenizationRole() function in libtextclassifier3::__anona7bb6bfb0111::TestingTokenizerProxy132 EXPECT_EQ(tokenizer.TestFindTokenizationRole(0), in TEST()134 EXPECT_EQ(tokenizer.TestFindTokenizationRole(5), in TEST()136 EXPECT_EQ(tokenizer.TestFindTokenizationRole(10), in TEST()140 EXPECT_EQ(tokenizer.TestFindTokenizationRole(31), in TEST()142 EXPECT_EQ(tokenizer.TestFindTokenizationRole(32), in TEST()144 EXPECT_EQ(tokenizer.TestFindTokenizationRole(33), in TEST()148 EXPECT_EQ(tokenizer.TestFindTokenizationRole(1233), in TEST()150 EXPECT_EQ(tokenizer.TestFindTokenizationRole(1234), in TEST()152 EXPECT_EQ(tokenizer.TestFindTokenizationRole(12344), in TEST()[all …]