Subject: Float precision
Posted By: nulogix Post Date: 11/10/2005 2:05:51 PM
a float variable has a value of -3.4E38 to +3.4E38 with 6 digit precision. What does it mean to have 6 digit precision. Is this just the number of digits the compiler will display before it truncates the value i.e 3.465783??

Also what is the difference between single and double precision?

thanks

Reply By: Paramesh Reply Date: 11/10/2005 8:53:20 PM
The precision determines the maximum number of digits that shall be output on express floating-point values, counting both the digits before and after the decimal point.

"Don't walk behind me; I may not lead.
 Don't walk in front of me; I may not follow.
 Just walk beside me and be my friend."

Go to topic 35955

Return to index page 438
Return to index page 437
Return to index page 436
Return to index page 435
Return to index page 434
Return to index page 433
Return to index page 432
Return to index page 431
Return to index page 430
Return to index page 429