Lines Matching refs:fraction
15 fractions. For example, the decimal fraction ::
19 has value 1/10 + 2/100 + 5/1000, and in the same way the binary fraction ::
32 The problem is easier to understand at first in base 10. Consider the fraction
33 1/3. You can approximate that as a base 10 fraction::
50 decimal value 0.1 cannot be represented exactly as a base 2 fraction. In base
51 2, 1/10 is the infinitely repeating fraction ::
56 machines today, floats are approximated using a binary fraction with
58 with the denominator as a power of two. In the case of 1/10, the binary fraction
78 of 1/10, the actual stored value is the nearest representable binary fraction.
81 nearest approximate binary fraction. For example, the numbers ``0.1`` and
167 fraction::
220 Why is that? 1/10 is not exactly representable as a binary fraction. Almost all
224 convert 0.1 to the closest fraction it can of the form *J*/2**\ *N* where *J* is
256 Dividing both the numerator and denominator by two reduces the fraction to::
264 So the computer never "sees" 1/10: what it sees is the exact fraction given
270 If we multiply that fraction by 10\*\*55, we can see the value out to