Sign Up to our social questions and Answers Engine to ask questions, answer people’s questions, and connect with other people.
Login to our social questions & Answers Engine to ask questions answer people’s questions & connect with other people.
Lost your password? Please enter your email address. You will receive a link and will create a new password via email.
Please briefly explain why you feel this question should be reported.
Please briefly explain why you feel this answer should be reported.
Please briefly explain why you feel this user should be reported.
I happened upon these values in my ColdFusion code but the Google calculator seems to have the same “bug” where the difference is non-zero.
416582.2850 – 411476.8100 – 5105.475 = -2.36468622461E-011
JavaCast’ing these to long/float/double doesn’t help- it results in other non-zero differences.
This is because decimal numbers that “look” round in base 10, are not exactly representable in base 2 (which is what computers use to represent floating point numbers). Please see the article What Every Computer Scientist Should Know About Floating-Point Arithmetic for a detailed explanation of this problem and workarounds.