Searched defs:tokenLength (Results 1 – 1 of 1) sorted by relevance
154 size_t tokenLength = currentToken.End().index - currentToken.Start().index; in GetSyntacticClassifications() local206 size_t tokenLength = currentToken.End().index - currentToken.Start().index; in GetSemanticClassifications() local