Home
last modified time | relevance | path

Searched refs:IsChineseLetter (Results 1 – 5 of 5) sorted by relevance

/external/libtextclassifier/native/utils/utf8/
Dunilib.h132 bool IsChineseLetter(char32 codepoint) const { in IsChineseLetter() function
133 return libtextclassifier3::IsChineseLetter(codepoint); in IsChineseLetter()
Dunilib-common.cc625 bool IsChineseLetter(char32 codepoint) { in IsChineseLetter() function
650 return IsJapaneseLetter(codepoint) || IsChineseLetter(codepoint) || in IsCJTletter()
658 IsChineseLetter(codepoint); in IsLetter()
Dunilib-common.h45 bool IsChineseLetter(char32 codepoint);
Dunilib_test-include.cc69 EXPECT_TRUE(unilib_->IsChineseLetter(u'豈')); // CJK COMPATIBILITY IDEOGRAPH in TEST_F()
142 EXPECT_TRUE(unilib_->IsChineseLetter(0xF900)); // CJK COMPATIBILITY IDEOGRAPH in TEST_F()
/external/libtextclassifier/native/utils/
Dtokenizer-utils.cc51 is_whitespace || IsPunctuation(codepoint) || IsChineseLetter(codepoint); in TokenizeOnWhiteSpacePunctuationAndChineseLetter()