Searched refs:relativeError (Results 1 – 3 of 3) sorted by relevance
135 double relativeError = Double.MAX_VALUE; in evaluate() local136 while (n < maxIterations && relativeError > epsilon) { in evaluate()190 relativeError = FastMath.abs(r / c - 1.0); in evaluate()
265 float relativeError = sk_float_abs(exact - estimate)/exact; in test_rsqrt() local266 REPORTER_ASSERT(reporter, relativeError <= maxRelativeError); in test_rsqrt()275 float relativeError = sk_float_abs(exact - estimate)/exact; in test_rsqrt() local276 REPORTER_ASSERT(reporter, relativeError <= maxRelativeError); in test_rsqrt()285 float relativeError = sk_float_abs(exact - estimate)/exact; in test_rsqrt() local286 REPORTER_ASSERT(reporter, relativeError <= maxRelativeError); in test_rsqrt()