| /external/tensorflow/tensorflow/lite/toco/ |
| D | types.proto | 23 // Float32, not quantized
26 // Uint8, quantized
29 // Int32, not quantized
32 // Int64, not quantized
35 // String, not quantized
38 // Int16, quantized
44 // Complex64, not quantized
47 // Int8, quantized based on QuantizationParameters in schema.
50 // Half precision float, not quantized.
53 // Double precision float, not quantized.
[all …]
|
| /external/ComputeLibrary/arm_compute/core/ |
| D | QuantizationInfo.h | 228 const int quantized = support::cpp11::lround(value / qinfo.scale) + qinfo.offset; in quantize() local
229 …_cast<QUANTIZED_TYPE>(arm_compute::utility::clamp<decltype(quantized), QUANTIZED_TYPE>(quantized)); in quantize()
248 … const int quantized = arm_compute::round(value / qinfo.scale, rounding_policy) + qinfo.offset; in quantize() local
249 …_cast<QUANTIZED_TYPE>(arm_compute::utility::clamp<decltype(quantized), QUANTIZED_TYPE>(quantized)); in quantize()
264 … const int quantized = arm_compute::round(value / uqinfo.scale, rounding_policy) + uqinfo.offset; member
265 …_cast<QUANTIZED_TYPE>(arm_compute::utility::clamp<decltype(quantized), QUANTIZED_TYPE>(quantized));
331 … int quantized = arm_compute::round(value / qinfo.uniform().scale, RoundingPolicy::TO_NEAREST_UP); in quantize_qsymm8() local
332 quantized = std::max(-128, std::min(quantized, 127)); in quantize_qsymm8()
333 return quantized; in quantize_qsymm8()
346 …int quantized = arm_compute::round(value / qinfo.scale()[channel_id], RoundingPolicy::TO_NEAREST_U… variable
[all …]
|
| /external/tensorflow/tensorflow/core/api_def/base_api/ |
| D | api_def_UniformQuantizedDotHybrid.pbtxt | 34 The output data is the original output data itself (Not quantized).
46 The type of rhs (quantized) input Tensor.
67 The min value of the quantized data stored in rhs.
68 For example, if Trhs is qint8, this must be set to -127 if narrow range quantized or -128 if not.
74 The max value of the quantized data stored in rhs.
78 summary: "Perform hybrid quantized dot of float Tensor `lhs` and quantized Tensor `rhs`."
80 Given float `lhs` and quantized `rhs`, internally performs quantization on `lhs`, and then performs…
83 `rhs` must be quantized Tensor, where its data value is quantized using the formula:
|
| D | api_def_QuantizedAdd.pbtxt | 6 The float value that the lowest quantized `x` value represents.
12 The float value that the highest quantized `x` value represents.
18 The float value that the lowest quantized `y` value represents.
24 The float value that the highest quantized `y` value represents.
30 The float value that the lowest quantized output value represents.
36 The float value that the highest quantized output value represents.
42 summary: "Returns x + y element-wise, working on quantized buffers."
|
| D | api_def_QuantizedMul.pbtxt | 6 The float value that the lowest quantized `x` value represents.
12 The float value that the highest quantized `x` value represents.
18 The float value that the lowest quantized `y` value represents.
24 The float value that the highest quantized `y` value represents.
30 The float value that the lowest quantized output value represents.
36 The float value that the highest quantized output value represents.
42 summary: "Returns x * y element-wise, working on quantized buffers."
|
| D | api_def_QuantizedBatchNormWithGlobalNormalization.pbtxt | 12 The value represented by the lowest quantized input.
18 The value represented by the highest quantized input.
32 The value represented by the lowest quantized mean.
38 The value represented by the highest quantized mean.
52 The value represented by the lowest quantized variance.
58 The value represented by the highest quantized variance.
71 The value represented by the lowest quantized offset.
77 The value represented by the highest quantized offset.
91 The value represented by the lowest quantized gamma.
97 The value represented by the highest quantized gamma.
|
| D | api_def_QuantizedConv2D.pbtxt | 12 The float value that the lowest quantized input value represents.
18 The float value that the highest quantized input value represents.
24 The float value that the lowest quantized filter value represents.
30 The float value that the highest quantized filter value represents.
36 The float value that the lowest quantized output value represents.
42 The float value that the highest quantized output value represents.
68 summary: "Computes a 2D convolution given quantized 4D input and filter tensors."
70 The inputs are quantized tensors where the lowest value represents the real
72 This means that you can only interpret the quantized output in the same way, by
|
| D | api_def_QuantizedDepthwiseConv2D.pbtxt | 15 The float value that the minimum quantized input value represents.
21 The float value that the maximum quantized input value represents.
27 The float value that the minimum quantized filter value represents.
33 The float value that the maximum quantized filter value represents.
43 The float value that the minimum quantized output value represents.
49 The float value that the maximum quantized output value represents.
72 summary: "Computes quantized depthwise Conv2D."
|
| D | api_def_QuantizedDepthwiseConv2DWithBias.pbtxt | 19 The float value that the minimum quantized input value represents.
25 The float value that the maximum quantized input value represents.
31 The float value that the minimum quantized filter value represents.
37 The float value that the maximum quantized filter value represents.
47 The float value that the minimum quantized output value represents.
53 The float value that the maximum quantized output value represents.
76 summary: "Computes quantized depthwise Conv2D with Bias."
|
| D | api_def_QuantizedDepthwiseConv2DWithBiasAndRelu.pbtxt | 19 The float value that the minimum quantized input value represents.
25 The float value that the maximum quantized input value represents.
31 The float value that the minimum quantized filter value represents.
37 The float value that the maximum quantized filter value represents.
47 The float value that the minimum quantized output value represents.
53 The float value that the maximum quantized output value represents.
76 summary: "Computes quantized depthwise Conv2D with Bias and Relu."
|
| D | api_def_Requantize.pbtxt | 6 The float value that the minimum quantized input value represents.
12 The float value that the maximum quantized input value represents.
18 The float value that the minimum quantized output value represents.
24 The float value that the maximum quantized output value represents.
52 "Converts the quantized `input` tensor into a lower-precision `output`."
54 Converts the quantized `input` tensor into a lower-precision `output`, using the
59 `input_max` is 1.0f, and we are dealing with `quint16` quantized data, then a 0
|
| D | api_def_QuantizedBiasAdd.pbtxt | 12 The float value that the lowest quantized input value represents.
18 The float value that the highest quantized input value represents.
24 The float value that the lowest quantized bias value represents.
30 The float value that the highest quantized bias value represents.
36 The float value that the lowest quantized output value represents.
42 The float value that the highest quantized output value represents.
|
| D | api_def_QuantizedMatMulWithBiasAndReluAndRequantize.pbtxt | 26 The float value that the lowest quantized `a` value represents.
32 The float value that the highest quantized `a` value represents.
38 The float value that the lowest quantized `b` value represents.
44 The float value that the highest quantized `b` value represents.
50 The float value that the lowest quantized output value after requantize.
56 The float value that the highest quantized output value after requantize.
63 The float value that the lowest quantized output value represents.
69 The float value that the highest quantized output value represents.
87 Perform a quantized matrix multiplication of `a` by the matrix `b` with bias
|
| D | api_def_QuantizedMatMul.pbtxt | 18 The float value that the lowest quantized `a` value represents.
24 The float value that the highest quantized `a` value represents.
30 The float value that the lowest quantized `b` value represents.
36 The float value that the highest quantized `b` value represents.
42 The float value that the lowest quantized output value represents.
48 The float value that the highest quantized output value represents.
70 summary: "Perform a quantized matrix multiplication of `a` by the matrix `b`."
|
| D | api_def_QuantizedDepthwiseConv2DWithBiasAndReluAndRequantize.pbtxt | 19 The float value that the minimum quantized input value represents.
25 The float value that the maximum quantized input value represents.
31 The float value that the minimum quantized filter value represents.
37 The float value that the maximum quantized filter value represents.
59 The float value that the minimum quantized output value represents.
65 The float value that the maximum quantized output value represents.
92 summary: "Computes quantized depthwise Conv2D with Bias, Relu and Requantize."
|
| D | api_def_QuantizedMatMulWithBias.pbtxt | 26 The float value that the lowest quantized `a` value represents.
32 The float value that the highest quantized `a` value represents.
38 The float value that the lowest quantized `b` value represents.
44 The float value that the highest quantized `b` value represents.
50 The float value that the lowest quantized output value represents.
56 The float value that the highest quantized output value represents.
74 Performs a quantized matrix multiplication of `a` by the matrix `b` with bias
|
| D | api_def_QuantizedMatMulWithBiasAndRelu.pbtxt | 26 The float value that the lowest quantized `a` value represents.
32 The float value that the highest quantized `a` value represents.
38 The float value that the lowest quantized `b` value represents.
44 The float value that the highest quantized `b` value represents.
50 The float value that the lowest quantized output value represents.
56 The float value that the highest quantized output value represents.
74 Perform a quantized matrix multiplication of `a` by the matrix `b` with bias
|
| D | api_def_QuantizeV2.pbtxt | 24 The quantized data produced from the float input.
31 and rounding them to quantized values.
40 and rounding them to quantized values.
49 used to convert the float values to their quantized equivalents. The
51 when rounding float values to their quantized equivalents.
80 quantized = round(input * range_scale) - round(range_min * range_scale) +
82 quantized = max(quantized, numeric_limits<T>::min())
83 quantized = min(quantized, numeric_limits<T>::max())
132 The input tensor can now be quantized by clipping values to the range
146 If true, we do not use the minimum quantized value.
[all …]
|
| D | api_def_QuantizedRelu.pbtxt | 6 The float value that the lowest quantized value represents.
12 The float value that the highest quantized value represents.
24 The float value that the lowest quantized value represents.
30 The float value that the highest quantized value represents.
|
| D | api_def_QuantizedAvgPool.pbtxt | 12 The float value that the lowest quantized input value represents.
18 The float value that the highest quantized input value represents.
24 The float value that the lowest quantized output value represents.
30 The float value that the highest quantized output value represents.
53 summary: "Produces the average pool of the input tensor for quantized types."
|
| D | api_def_QuantizedMaxPool.pbtxt | 12 The float value that the lowest quantized input value represents.
18 The float value that the highest quantized input value represents.
24 The float value that the lowest quantized output value represents.
30 The float value that the highest quantized output value represents.
53 summary: "Produces the max pool of the input tensor for quantized types."
|
| D | api_def_QuantizedReluX.pbtxt | 6 The float value that the lowest quantized value represents.
12 The float value that the highest quantized value represents.
24 The float value that the lowest quantized value represents.
30 The float value that the highest quantized value represents.
|
| D | api_def_QuantizedRelu6.pbtxt | 6 The float value that the lowest quantized value represents.
12 The float value that the highest quantized value represents.
24 The float value that the lowest quantized value represents.
30 The float value that the highest quantized value represents.
|
| /external/tensorflow/tensorflow/lite/g3doc/r1/convert/ |
| D | cmdline_reference.md | 72 is quantized. Only needed if `inference_input_type` is `INT8` or `UINT8`.
74 quantized value in the quantized input array will be interpreted as a
79 quantized input, the quantized input would be immediately dequantized by
82 * When performing quantized inference (`inference_type` is `INT8` or
86 fixed-point multipliers used in the quantized inference code.The
87 `mean_value` must be an integer when performing quantized inference.
99 This flag only impacts real-number arrays including float and quantized
104 file. If they were quantized in the input file, then they get
106 * If `INT8`, then real-numbers arrays will be quantized as int8 in the
108 quantized.
[all …]
|
| /external/tensorflow/tensorflow/java/src/gen/resources/ |
| D | tftypes.csv | 12 QInt8,n,,n,,quantized int8
13 QUInt8,n,,n,,quantized uint8
14 QInt32,n,,n,,quantized int32
16 QInt16,n,,n,,quantized int16
17 QUInt16,n,,n,,quantized uint16
|