Representation Error for Real Numbers in Binary Computer Arithmetic
William Marshall McKeeman · IEEE Transactions on Electronic Computers · 1967
Real numbers can be represented in a binary computer by the form i-Bewhere i is the integer part, B the base, and e the exponent. The accuracy of the representation will depend upon the number of bits allocated to the integer part and exponent part as well as what base is chosen. If L(i) and L(e) are the number of bits allocated to the magnitudes of the integer and exponent parts and we define I= 2L(i)and E = 2L(e), the exponent range is given by B±E, the maximum relative representation error is given by B/2I, and the average relative representation error is given by (B-1)/(4I 1n B). The formulas provide quantitative comparison for the effectiveness of alternative formats for real number representations.