[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: percentage discount not calculating properly



Hi Chris:
As it was:
quantity 7, unit price $100.05, discount 15%, extended price $595.28

your test:
quantity 7, unit price $100.050, discount 15%, extended price $595.29.

my calculator says:
7*100.05*.85=595.2975, so I think the correct answer should be
$595.30...

On Wed, 2010-02-24 at 17:10 -0800, Chris Travers wrote:
> Can anyone verify that adding 0's to the end of the unit price even in
> 1.2.18 changes the rounding precision?
> 
> I just tested as follows:
> 
> unit price 0.01, qty 100, 90% discount.  Extended price 0.
> 
> So far so good.
> 
> unit price 0.010, qty 100, 90% discount, extended price $0.10
> 
> Also correct.
> 
> Looks like this may have been fixed some time ago.  I will try to find
> out in which version.
> 
> Best Wishes,
> Chris Travers
> 
> ------------------------------------------------------------------------------
> Download Intel® Parallel Studio Eval
> Try the new software tools for yourself. Speed compiling, find bugs
> proactively, and fine-tune applications for parallel performance.
> See why Intel Parallel Studio got high marks during beta.
> http://p.sf.net/sfu/intel-sw-dev
> _______________________________________________
> Ledger-smb-users mailing list
> ..hidden..
> https://lists.sourceforge.net/lists/listinfo/ledger-smb-users
Bob Miller
334-7117/633-3760
http://computerisms.ca
..hidden..
Network, Internet, Server,
and Open Source Solutions