Question

I’m doing what seems like simple math in an android app, however I keep getting massive rounding errors. For example.

Float.toString(0.4*0.4*12.5);

I would expect to get 2 as the result of the above equation. However I get 2.0000002

Answer 1

So I ended up making two functions, one to round Doubles and one for Floats. Seems like a PITA, but other then being limited to a preset level of precision (which I’ll look at making a app setting) it does work.

public static float fRound(float Rval, int Rpl) {
    float p = (float)Math.pow(10,Rpl);
    Rval = Rval * p;
    float tmp = Math.round(Rval);
    return (float)tmp/p;
}
public static Double dRound(double d, int decimalPlace){
    BigDecimal bd = new BigDecimal(Double.toString(d));
    bd = bd.setScale(decimalPlace,BigDecimal.ROUND_HALF_UP);
    return bd.doubleValue();
}