Home
last modified time | relevance | path

Searched refs:FinishTokenAndAddSeparator (Results 1 – 1 of 1) sorted by relevance

/external/libtextclassifier/native/utils/
Dtokenizer.cc306 auto FinishTokenAndAddSeparator = in NumberTokenize() local
336 FinishTokenAndAddSeparator(codepoint_index, it); in NumberTokenize()
339 FinishTokenAndAddSeparator(codepoint_index, it); in NumberTokenize()