Searched refs:input_token_index (Results 1 – 1 of 1) sorted by relevance
218 size_t input_token_index = 0; in Preprocess() local221 input_token_index = 1; in Preprocess()225 (input_token_index < max_sentence_length); in Preprocess()226 ++i, ++input_token_index) { in Preprocess()230 input_tokens[input_token_index] = token_id; in Preprocess()232 input_tokens[input_token_index] = unknown_token_id; in Preprocess()