Searched defs:QuantizedKVCache (Results 1 – 2 of 2) sorted by relevance
| /external/executorch/examples/models/llama/source_transformation/ | ||
| D | quantized_kv_cache.py | 30 class QuantizedKVCache(nn.Module): class |
| D | sdpa.py | 25 kv_cache: Union[KVCache, QuantizedKVCache], argument |