Home
last modified time | relevance | path

Searched refs:CodepointSpanToTokenSpan (Results 1 – 4 of 4) sorted by relevance

/external/libtextclassifier/
Dfeature-processor_test.cc1094 TEST(FeatureProcessorTest, CodepointSpanToTokenSpan) { in TEST() argument
1100 EXPECT_EQ(TokenSpan(0, 1), CodepointSpanToTokenSpan(tokens, {0, 5})); in TEST()
1101 EXPECT_EQ(TokenSpan(1, 2), CodepointSpanToTokenSpan(tokens, {6, 23})); in TEST()
1102 EXPECT_EQ(TokenSpan(2, 3), CodepointSpanToTokenSpan(tokens, {24, 29})); in TEST()
1103 EXPECT_EQ(TokenSpan(0, 2), CodepointSpanToTokenSpan(tokens, {0, 23})); in TEST()
1104 EXPECT_EQ(TokenSpan(1, 3), CodepointSpanToTokenSpan(tokens, {6, 29})); in TEST()
1105 EXPECT_EQ(TokenSpan(0, 3), CodepointSpanToTokenSpan(tokens, {0, 29})); in TEST()
1108 EXPECT_EQ(TokenSpan(0, 1), CodepointSpanToTokenSpan(tokens, {0, 5}, true)); in TEST()
1109 EXPECT_EQ(TokenSpan(1, 2), CodepointSpanToTokenSpan(tokens, {6, 23}, true)); in TEST()
1110 EXPECT_EQ(TokenSpan(2, 3), CodepointSpanToTokenSpan(tokens, {24, 29}, true)); in TEST()
[all …]
Dfeature-processor.h78 TokenSpan CodepointSpanToTokenSpan(
Dfeature-processor.cc342 TokenSpan CodepointSpanToTokenSpan(const std::vector<Token>& selectable_tokens, in CodepointSpanToTokenSpan() function
401 CodepointSpanToTokenSpan(selectable_tokens, span); in CenterTokenFromClick()
428 CodepointSpanToTokenSpan(selectable_tokens, span); in CenterTokenFromMiddleOfSelection()
Dtext-classifier.cc838 CodepointSpanToTokenSpan(tokens, selection_indices); in ModelClassifyText()