Gustav Brock
Gustav at cactus.dk
Thu Apr 28 03:35:33 CDT 2005
Hi Marty
That's right, but Charlotte mentioned adding 1 not 0.01.
However, if anyone at this point still are confident using Double (or <
gosh> Single) for decimals, I modified your test.
This is scary. Notes follow the function:
Sub CalcSum()
' This will take a fraction of a second to run.
' Add 1 cent up to 1 billion times and apply rounding.
' Exit at first encountered error.
Dim i As Long
Dim iMax As Long
Dim fSum As Double
Dim fSuma As Double
Dim fPenny As Double
i = 0
fPenny = 0.01
iMax = 1000000000
fSum = 0#
fSuma = 0#
For i = 0 To iMax - 1
fSum = fSum + fPenny
fSuma = fSuma + fPenny
'intermediate round to 2 decimal point precision
fSuma = Round(fSuma, 2)
' Exit if an error has occurred.
If fSum <> fSuma Then Exit For
Next i
Debug.Print fSum; fSuma, fSum - fSuma
End Sub
Now, take your guess - how many loops will run? Ten thousand?
You'll be in for a surprise!
Note that even though fSum and fSuma display the same result, they
don't compare.
You have to do the fSum - fSuma subtraction to have the error
displayed.
/gustav
>>> martyconnelly at shaw.ca 04/27 10:32 pm >>>
Don't forget you must round to the precision needed in the
intermediate
calculations to avoid bias or roundoff errors, regardless of the
precision
of the variables used or compiler.
After doing one billion additions of .01 or say 1 cent
The difference in calculated values can be seen when you apply the
intermediate rounding function.
Applying this method will keep demented accountants out of your hair.
Final Total unrounded decimal accurate intermediate rounded total
9999999.82515867 10000000
Sub CalcSum()
'this may take several minutes to run
' add 1 cent 1 billion times and apply rounding
Dim i As Long
Dim iMax As Long
Dim fSum As Double
Dim fSuma As Double
Dim fPenny As Double
i = 0
fPenny = 0.01
iMax = 1000000000
fSum = 0#
fSuma = 0#
For i = 0 To iMax - 1
fSum = fSum + fPenny
fSuma = fSuma + fPenny
'intermediate round to 2 decimal point
precision
fSuma = Round(fSuma, 2)
Next i
Debug.Print fSum; fSuma
End Sub
Gustav Brock wrote:
>Hi Charlotte
>
>It fails all right, but not you have to go beyond 16 mio.:
>
>Public Sub TestSingle()
>
> Dim sng As Single
> Dim lng As Long
>
> For lng = 0 To 100000000
> If lng <> sng Then Exit For
> sng = sng + 1
> Next
> Debug.Print lng, sng
>
>End Sub
>
>It runs to:
> 16777217 1.677722E+07
>
>/gustav
>
>
>
>>>>cfoust at infostatsystems.com 04/27 7:17 pm >>>
>>>>
>>>>
>I've seen it with addition as well. You can build a test in code and
>loop multiple times adding 1 to the integer of a floating point and
>testing the mod to see if there is a remainder. Believe me, it will
>occur.
>
>Charlotte Foust
>
>
>-----Original Message-----
>From: Gustav Brock [mailto:Gustav at cactus.dk]
>Sent: Wednesday, April 27, 2005 9:37 AM
>To: accessd at databaseadvisors.com
>Subject: RE: [AccessD] A2K - Adding decimal error
>
>
>Hi Reuben
>
>Charlotte a guy? You better be careful!
>
>You mostly see this with subtraction (which includes addition of
>negative values); I've never seen it with addition of positives.
>
>If you can't change the source data type be sure to wrap the values
in
>CCur(). If you need more than the four decimals of Currency you may
>choose Double but round the results whenever possible.
>
>/gustav
>
>
>
>>>>reuben at gfconsultants.com 04/27 6:26 pm >>>
>>>>
>>>>
>You guys nailed that one. HoursWorked is a single. I never
>considered it would cause a problem with addition. Of course, after
all the work
>I did on payroll calculations I can't beleive it was still a single.
>
>Thanks.
>
>Reuben Cummings
>GFC, LLC
>phone: 812.523.1017
>email: reuben at gfconsultants.com
>
>
>-----Original Message-----
>From: accessd-bounces at databaseadvisors.com
>[mailto:accessd-bounces at databaseadvisors.com]On Behalf Of Gustav
Brock
>Sent: Wednesday, April 27, 2005 10:53 AM
>To: accessd at databaseadvisors.com
>Subject: Re: [AccessD] A2K - Adding decimal error
>
>
>Hi Reuben
>
>He is probably adding and subtraction 0.1 hour as well and you are
>using
>data type Single for that. Change to data type Currency ...
>
>/gustav
>
>
>
>>>>reuben at gfconsultants.com 04/27 5:38 pm >>>
>>>>
>>>>
>A client came across this for me...
>
>One employee has 10 pay records on one day that are each .6 hours.
>After gathering all the pay info I use a standard grouping query with
a sum
>to get the total hours.
>
>Rather than adding up to 6 hours, these 10 records resolve to
>6.00000023841858
>
>Why the strange decimals?
>
>Thanks.
>
>Reuben Cummings
>GFC, LLC
>phone: 812.523.1017
>email: reuben at gfconsultants.com