Home
last modified time | relevance | path

Searched refs:quantized (Results 1 – 25 of 160) sorted by relevance

1234567

/external/tensorflow/tensorflow/lite/toco/
Dtypes.proto23 // Float32, not quantized
26 // Uint8, quantized
29 // Int32, not quantized
32 // Int64, not quantized
35 // String, not quantized
38 // Int16, quantized
44 // Complex64, not quantized
47 // Int8, quantized based on QuantizationParameters in schema.
50 // Half precision float, not quantized.
53 // Double precision float, not quantized.
[all …]
/external/tensorflow/tensorflow/lite/micro/
Dmicro_utils_test.cc91 int8_t quantized[length]; in TF_LITE_MICRO_TEST() local
92 tflite::Quantize(values, quantized, length, 0.5, 1); in TF_LITE_MICRO_TEST()
94 TF_LITE_MICRO_EXPECT_EQ(quantized[i], goldens[i]); in TF_LITE_MICRO_TEST()
102 uint8_t quantized[length]; in TF_LITE_MICRO_TEST() local
103 tflite::Quantize(values, quantized, length, 0.5, 127); in TF_LITE_MICRO_TEST()
105 TF_LITE_MICRO_EXPECT_EQ(quantized[i], goldens[i]); in TF_LITE_MICRO_TEST()
113 int32_t quantized[length]; in TF_LITE_MICRO_TEST() local
114 tflite::SymmetricQuantize(values, quantized, length, 0.5); in TF_LITE_MICRO_TEST()
116 TF_LITE_MICRO_EXPECT_EQ(quantized[i], goldens[i]); in TF_LITE_MICRO_TEST()
Dtesting_helpers_test.cc26 int32_t quantized[tensor_size]; in TF_LITE_MICRO_TEST() local
33 pre_quantized, quantized, dims, input_scale, weight_scale); in TF_LITE_MICRO_TEST()
49 int32_t quantized[tensor_size]; in TF_LITE_MICRO_TEST() local
59 pre_quantized, quantized, dims, input_scale, weight_scales, scales, in TF_LITE_MICRO_TEST()
79 int8_t quantized[12]; in TF_LITE_MICRO_TEST() local
92 pre_quantized, quantized, dims, scales, zero_points, &quant, 0); in TF_LITE_MICRO_TEST()
/external/tensorflow/tensorflow/core/api_def/base_api/
Dapi_def_QuantizedMul.pbtxt6 The float value that the lowest quantized `x` value represents.
12 The float value that the highest quantized `x` value represents.
18 The float value that the lowest quantized `y` value represents.
24 The float value that the highest quantized `y` value represents.
30 The float value that the lowest quantized output value represents.
36 The float value that the highest quantized output value represents.
42 summary: "Returns x * y element-wise, working on quantized buffers."
Dapi_def_QuantizedAdd.pbtxt6 The float value that the lowest quantized `x` value represents.
12 The float value that the highest quantized `x` value represents.
18 The float value that the lowest quantized `y` value represents.
24 The float value that the highest quantized `y` value represents.
30 The float value that the lowest quantized output value represents.
36 The float value that the highest quantized output value represents.
42 summary: "Returns x + y element-wise, working on quantized buffers."
Dapi_def_QuantizedBatchNormWithGlobalNormalization.pbtxt12 The value represented by the lowest quantized input.
18 The value represented by the highest quantized input.
32 The value represented by the lowest quantized mean.
38 The value represented by the highest quantized mean.
52 The value represented by the lowest quantized variance.
58 The value represented by the highest quantized variance.
71 The value represented by the lowest quantized offset.
77 The value represented by the highest quantized offset.
91 The value represented by the lowest quantized gamma.
97 The value represented by the highest quantized gamma.
Dapi_def_QuantizedConv2D.pbtxt12 The float value that the lowest quantized input value represents.
18 The float value that the highest quantized input value represents.
24 The float value that the lowest quantized filter value represents.
30 The float value that the highest quantized filter value represents.
36 The float value that the lowest quantized output value represents.
42 The float value that the highest quantized output value represents.
68 summary: "Computes a 2D convolution given quantized 4D input and filter tensors."
70 The inputs are quantized tensors where the lowest value represents the real
72 This means that you can only interpret the quantized output in the same way, by
Dapi_def_QuantizedDepthwiseConv2D.pbtxt15 The float value that the minimum quantized input value represents.
21 The float value that the maximum quantized input value represents.
27 The float value that the minimum quantized filter value represents.
33 The float value that the maximum quantized filter value represents.
43 The float value that the minimum quantized output value represents.
49 The float value that the maximum quantized output value represents.
72 summary: "Computes quantized depthwise Conv2D."
Dapi_def_QuantizedDepthwiseConv2DWithBias.pbtxt19 The float value that the minimum quantized input value represents.
25 The float value that the maximum quantized input value represents.
31 The float value that the minimum quantized filter value represents.
37 The float value that the maximum quantized filter value represents.
47 The float value that the minimum quantized output value represents.
53 The float value that the maximum quantized output value represents.
76 summary: "Computes quantized depthwise Conv2D with Bias."
Dapi_def_QuantizedDepthwiseConv2DWithBiasAndRelu.pbtxt19 The float value that the minimum quantized input value represents.
25 The float value that the maximum quantized input value represents.
31 The float value that the minimum quantized filter value represents.
37 The float value that the maximum quantized filter value represents.
47 The float value that the minimum quantized output value represents.
53 The float value that the maximum quantized output value represents.
76 summary: "Computes quantized depthwise Conv2D with Bias and Relu."
Dapi_def_QuantizedBiasAdd.pbtxt12 The float value that the lowest quantized input value represents.
18 The float value that the highest quantized input value represents.
24 The float value that the lowest quantized bias value represents.
30 The float value that the highest quantized bias value represents.
36 The float value that the lowest quantized output value represents.
42 The float value that the highest quantized output value represents.
Dapi_def_Requantize.pbtxt6 The float value that the minimum quantized input value represents.
12 The float value that the maximum quantized input value represents.
18 The float value that the minimum quantized output value represents.
24 The float value that the maximum quantized output value represents.
52 "Converts the quantized `input` tensor into a lower-precision `output`."
54 Converts the quantized `input` tensor into a lower-precision `output`, using the
59 `input_max` is 1.0f, and we are dealing with `quint16` quantized data, then a 0
Dapi_def_QuantizedMatMul.pbtxt18 The float value that the lowest quantized `a` value represents.
24 The float value that the highest quantized `a` value represents.
30 The float value that the lowest quantized `b` value represents.
36 The float value that the highest quantized `b` value represents.
42 The float value that the lowest quantized output value represents.
48 The float value that the highest quantized output value represents.
70 summary: "Perform a quantized matrix multiplication of `a` by the matrix `b`."
Dapi_def_QuantizedDepthwiseConv2DWithBiasAndReluAndRequantize.pbtxt19 The float value that the minimum quantized input value represents.
25 The float value that the maximum quantized input value represents.
31 The float value that the minimum quantized filter value represents.
37 The float value that the maximum quantized filter value represents.
59 The float value that the minimum quantized output value represents.
65 The float value that the maximum quantized output value represents.
92 summary: "Computes quantized depthwise Conv2D with Bias, Relu and Requantize."
Dapi_def_QuantizedMatMulWithBiasAndReluAndRequantize.pbtxt26 The float value that the lowest quantized `a` value represents.
32 The float value that the highest quantized `a` value represents.
38 The float value that the lowest quantized `b` value represents.
44 The float value that the highest quantized `b` value represents.
50 The float value that the lowest quantized output value after requantize.
56 The float value that the highest quantized output value after requantize.
63 The float value that the lowest quantized output value represents.
69 The float value that the highest quantized output value represents.
87 Perform a quantized matrix multiplication of `a` by the matrix `b` with bias
Dapi_def_QuantizedMatMulWithBias.pbtxt26 The float value that the lowest quantized `a` value represents.
32 The float value that the highest quantized `a` value represents.
38 The float value that the lowest quantized `b` value represents.
44 The float value that the highest quantized `b` value represents.
50 The float value that the lowest quantized output value represents.
56 The float value that the highest quantized output value represents.
74 Performs a quantized matrix multiplication of `a` by the matrix `b` with bias
Dapi_def_QuantizedMatMulWithBiasAndRelu.pbtxt26 The float value that the lowest quantized `a` value represents.
32 The float value that the highest quantized `a` value represents.
38 The float value that the lowest quantized `b` value represents.
44 The float value that the highest quantized `b` value represents.
50 The float value that the lowest quantized output value represents.
56 The float value that the highest quantized output value represents.
74 Perform a quantized matrix multiplication of `a` by the matrix `b` with bias
Dapi_def_QuantizedRelu.pbtxt6 The float value that the lowest quantized value represents.
12 The float value that the highest quantized value represents.
24 The float value that the lowest quantized value represents.
30 The float value that the highest quantized value represents.
Dapi_def_QuantizeV2.pbtxt24 The quantized data produced from the float input.
31 and rounding them to quantized values.
40 and rounding them to quantized values.
49 used to convert the float values to their quantized equivalents. The
51 when rounding float values to their quantized equivalents.
80 quantized = round(input * range_scale) - round(range_min * range_scale) +
82 quantized = max(quantized, numeric_limits<T>::min())
83 quantized = min(quantized, numeric_limits<T>::max())
132 The input tensor can now be quantized by clipping values to the range
146 If true, we do not use the minimum quantized value.
[all …]
Dapi_def_QuantizedRelu6.pbtxt6 The float value that the lowest quantized value represents.
12 The float value that the highest quantized value represents.
24 The float value that the lowest quantized value represents.
30 The float value that the highest quantized value represents.
Dapi_def_QuantizedReluX.pbtxt6 The float value that the lowest quantized value represents.
12 The float value that the highest quantized value represents.
24 The float value that the lowest quantized value represents.
30 The float value that the highest quantized value represents.
Dapi_def_QuantizedMaxPool.pbtxt12 The float value that the lowest quantized input value represents.
18 The float value that the highest quantized input value represents.
24 The float value that the lowest quantized output value represents.
30 The float value that the highest quantized output value represents.
53 summary: "Produces the max pool of the input tensor for quantized types."
Dapi_def_QuantizedAvgPool.pbtxt12 The float value that the lowest quantized input value represents.
18 The float value that the highest quantized input value represents.
24 The float value that the lowest quantized output value represents.
30 The float value that the highest quantized output value represents.
53 summary: "Produces the average pool of the input tensor for quantized types."
/external/tensorflow/tensorflow/java/src/gen/resources/
Dtftypes.csv12 QInt8,n,,n,,quantized int8
13 QUInt8,n,,n,,quantized uint8
14 QInt32,n,,n,,quantized int32
16 QInt16,n,,n,,quantized int16
17 QUInt16,n,,n,,quantized uint16
/external/tensorflow/tensorflow/lite/g3doc/r1/convert/
Dcmdline_reference.md72 is quantized. Only needed if `inference_input_type` is `INT8` or `UINT8`.
74 quantized value in the quantized input array will be interpreted as a
79 quantized input, the quantized input would be immediately dequantized by
82 * When performing quantized inference (`inference_type` is `INT8` or
86 fixed-point multipliers used in the quantized inference code.The
87 `mean_value` must be an integer when performing quantized inference.
99 This flag only impacts real-number arrays including float and quantized
104 file. If they were quantized in the input file, then they get
106 * If `INT8`, then real-numbers arrays will be quantized as int8 in the
108 quantized.
[all …]

1234567