Searched refs:float32 (Results 1 – 5 of 5) sorted by relevance
| /packages/modules/NeuralNetworks/runtime/test/fuzzing/ |
| D | TestRandomGraph.cpp | 479 .float32 = {.bias = 1e-7f, .mse = 1e-10f, .atol = 1e-6f, .rtol = 1e-6f},
493 .float32 = {.bias = 1e-6f, .mse = 1e-8f, .atol = 1e-5f, .rtol = 1e-5f},
507 .float32 = {.bias = 3e-5f, .mse = 1e-6f, .atol = 1e-3f, .rtol = 1e-3f},
519 .float32 = {.bias = 4e-4f, .mse = 1e-5f, .atol = 2e-2f, .rtol = 2e-2f},
750 .float32 = {.bias = 4e-4f, .mse = 1e-5f, .atol = 1e-2f, .rtol = 1e-2f},
761 .float32 = {.bias = 1e-2f, .mse = 1e-4f, .atol = 1e-1f, .rtol = 1e-1f},
|
| /packages/modules/NeuralNetworks/tools/test_generator/test_harness/ |
| D | TestHarness.cpp | 209 expectNear<float>(operand, result, criteria.float32, criteria.allowInvalidFpValues); in checkResults()
263 .float32 = {.atol = 1e-5, .rtol = 5.0f * 1.1920928955078125e-7}, in checkResults()
285 criteria.float32 = criteria.float16; in checkResults()
|
| /packages/modules/NeuralNetworks/tools/test_generator/test_harness/include/ |
| D | TestHarness.h | 488 AccuracyCriterion float32; member
|
| /packages/modules/NeuralNetworks/tools/test_generator/ |
| D | README.md | 125 Convert input/parameter/output to the specified type, e.g. float32 -> quant8. The target data type …
|
| D | test_generator.py | 793 v = Dequantize(op.GetValueAsNumpy().astype(np.float32), op.type)
|