Searched refs:smallest_batch_size (Results 1 – 1 of 1) sorted by relevance
337 int smallest_batch_size = -1; in GetCompatibleCachedEngine() local350 if ((smallest_batch_size == -1) || in GetCompatibleCachedEngine()351 (cached_batch_size < smallest_batch_size)) { in GetCompatibleCachedEngine()352 smallest_batch_size = cached_batch_size; in GetCompatibleCachedEngine()355 (*engine_input_shapes)[i].set_dim(0, smallest_batch_size); in GetCompatibleCachedEngine()360 return (smallest_batch_size != -1); in GetCompatibleCachedEngine()