Searched defs:token_span (Results 1 – 2 of 2) sorted by relevance
215 TokenSpan token_span; in LabelToSpan() local326 const std::vector<Token>& selectable_tokens, TokenSpan token_span) { in TokenSpanToCodepointSpan()532 TokenSpan token_span{l, r}; in MakeLabelMaps() local
231 TokenSpan token_span; in TEST() local