Home
last modified time | relevance | path

Searched defs:TokenizeOnSpace (Results 1 – 3 of 3) sorted by relevance

/external/libtextclassifier/native/utils/
Dtokenizer-utils.cc31 std::vector<Token> TokenizeOnSpace(const std::string& text) { in TokenizeOnSpace() function
Dtokenizer-utils_test.cc25 TEST(TokenizerUtilTest, TokenizeOnSpace) { in TEST() argument
Dtokenizer_test.cc162 TEST(TokenizerTest, TokenizeOnSpace) { in TEST() argument