Processing Decimal Values

By Dietmar Kühl

For typical interactions we are used to processing values represented in decimal. Computers are much more versatile processing using binary representations. As a result it is quite common that decimal values are processed using a binary presentation. Sadly, doing so does cause problems when fractional values are involved.

This presentation explains the representation of floating points in a computer and analyses typical problems encountered when using binary floating points to represent decimal values. It then describes alternative representation, in particular decimal floating point and decimal fixed point, and why these solve the relevant problems.

A decimal fixed point representation is the preferred approach when the number of fractional digits used in an application is known. However, that is often not the case. Thus, the design of a library implementation for decimal floating point is discussed.





Your Privacy

By clicking "Accept Non-Essential Cookies" you agree ACCU can store non-essential cookies on your device and disclose information in accordance with our Privacy Policy and Cookie Policy.

Current Setting: Non-Essential Cookies REJECTED


By clicking "Include Third Party Content" you agree ACCU can forward your IP address to third-party sites (such as YouTube) to enhance the information presented on this site, and that third-party sites may store cookies on your device.

Current Setting: Third Party Content EXCLUDED



Settings can be changed at any time from the Cookie Policy page.