REBOL 3.0

Comments on: How many decimal-digits?

Carl Sassenrath, CTO
REBOL Technologies
9-Aug-2007 0:04 GMT

Article #0096
Main page || Index || Prior Article [0095] || Next Article [0097] || 1 Comments || Send feedback

Our friend Geomol has been testing the 64bit decimal capabilities of R3. Specifically, he is looking at the decimal-digits default, which is set to 15 digits (because that's what clib specifies).

He uses this test:

>> d: 3 loop 16 [print 1.9 * d d: d * 10 + 3]
5.7
62.7
632.7
6332.7
63332.7
633332.7
6333332.7
63333332.7
633333332.7
6333333332.7
63333333332.7
633333333332.7
6333333333332.7
63333333333332.7
633333333333333.0
6.33333333333333E+15
== 33333333333333333

And he asks:

Is 15 digits always ok? Can anyone come up with a test, which shows, that 15 digits give bad results for some calculation?

So, there's a question for you. Know the answer?

1 Comments

Comments:

Rebolinth
10-Aug-2007 3:02:51
How many digits does a HP caculator display? (Thake the version that scientists use)

If you use that, than i guess you have 99% of the 'requesting users' satisfied.

(personal avarage is a 5 digits number daily use.)

Post a Comment:

You can post a comment here. Keep it on-topic.

Name:

Blog id:

R3-0096


Comment:


 Note: HTML tags allowed for: b i u li ol ul font span div a p br pre tt blockquote
 
 

This is a technical blog related to the above topic. We reserve the right to remove comments that are off-topic, irrelevant links, advertisements, spams, personal attacks, politics, religion, etc.

REBOL 3.0
Updated 28-Jun-2017 - Edit - Copyright REBOL Technologies - REBOL.net